These properties are used to configure tClassify running in the Spark Streaming Job framework.
The Spark Streaming tClassify component belongs to the Machine Learning family.
This component is available in Talend Real-Time Big Data Platform and Talend Data Fabric.
Schema and Edit Schema
A schema is a row description. It defines the number of fields (columns) to be processed and passed on to the next component. When you create a Spark Job, avoid the reserved word line when naming the fields.
Click Edit schema to make changes to the schema. If the current schema is of the Repository type, three options are available:
Note that the schema of this component is read-only. Its single column LABEL is used to load the class names from the classifier model for use in the classification process.
Model on filesystem
Select this radio box if the model to be used is stored on a file system. The button for browsing does not work with the Spark Local mode; if you are using the Spark Yarn or the Spark Standalone mode, ensure that you have properly configured the connection in a configuration component in the same Job, such as tHDFSConfiguration.
In the HDFS folder field that is displayed, enter the HDFS URI in which this model is stored.
This component is used as an intermediate step.
In the Spark Configuration tab in the Run view, define the connection to a given Spark cluster for the whole Job. In addition, since the Job expects its dependent jar files for execution, you must specify the directory in the file system to which these jar files are transferred so that Spark can access these files:
This connection is effective on a per-Job basis.