tHMapRecord properties for Apache Spark Streaming - 6.5

Data mapping

EnrichVersion
6.5
EnrichProdName
Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
EnrichPlatform
Talend Studio
task
Data Governance > Third-party systems > Processing components (Integration) > Data mapping
Data Quality and Preparation > Third-party systems > Processing components (Integration) > Data mapping
Design and Development > Third-party systems > Processing components (Integration) > Data mapping

These properties are used to configure tHMapRecord running in the Spark Streaming Job framework.

The Spark Streaming tHMapRecord component belongs to the Processing family.

The component in this framework is available in Talend Real Time Big Data Platform and in Talend Data Fabric.

Basic settings

Storage

To connect to an HDFS installation, select the Define a storage configuration component check box and then select the name of the component to use from those available in the drop-down list.

This option requires you to have previously configured the connection to the HDFS installation to be used, as described in the documentation for the tHDFSConfiguration component.

If you leave the Define a storage configuration component check box unselected, you can only convert files locally.

Open Map Editor

Click the [...] button to open the map for editing in the Map Editor of Talend Data Mapper .

For more information, see Talend Data Mapper User Guide.

Die on error

Clear the check box to skip any rows on error and complete the process for error-free rows.

Usage

Usage rule

This component is used with a tHDFSConfiguration component which defines the connection to the HDFS storage, or as a standalone component for mapping local files only.