tHMapRecord properties for Apache Spark Streaming - Cloud - 8.0

Data mapping

Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
Talend Studio
ジョブデザインと開発 > サードパーティーシステム > 変換処理コンポーネント > データマッピング
データガバナンス > サードパーティーシステム > 変換処理コンポーネント > データマッピング
データクオリティとプレパレーション > サードパーティーシステム > 変換処理コンポーネント > データマッピング
Last publication date

These properties are used to configure tHMapRecord running in the Spark Streaming Job framework.

The Spark Streaming tHMapRecord component belongs to the 変換処理 family.

The component in this framework is available in Talend Real Time Big Data Platform and in Talend Data Fabric.

Basic settings


To connect to an HDFS installation, select the Define a storage configuration component check box and then select the name of the component to use from those available in the drop-down list.

This option requires you to have previously configured the connection to the HDFS installation to be used, as described in the documentation for the tHDFSConfiguration component.

If you leave the Define a storage configuration component check box unselected, you can only convert files locally.

Open Map Editor

Click the [...] button to open the tHMapRecord Structure Generate/Select wizard where you can either have the hierarchical mapper structure generated automatically based on the schema, or select an existing hierarchical mapper structure. You must do this for both the input and output sides of your Map.

When you connect multiple output connections to the tHMapRecord, the page displays a confirmation message that informs you that the mapper structures are generated based on the output connections.

Synchronize map with schema connections

Select this check box if you want to automatically regenerate your map's input and output structures after one of the following changes:
  • Connection metadata change
  • Input or output connection added
  • Input or output connection removed
No changes are detected when a connection is activated or deactivated.
If this check box is selected, the map is automatically synchronized when opened from the component after a change. If not, a dialog appears to ask whether you want to synchronize.
Note: For structures with multiple connections, the map can only be synchronized if the structures have the same form as the ones generated by the component configuration wizard. For example, flattening maps with multiple outputs cannot be synchronized automatically.
Map Path

Click [...] to select an existing map. The window displays a wizard that allows you to select a map from the Hierarchical Mapper view of Talend Data Mapper.

Die on error

Select the check box to stop the execution of the Job when an error occurs.

Clear the check box to skip any error and continue the Job execution process.


Usage rule This component is used with a tHDFSConfiguration component which defines the connection to the HDFS storage, or as a standalone component for mapping local files only.
Drag-and-drop feature If you have an existing tHMapRecord map in the Data Mapping view, you can easily drag-and-drop the map:
  • When you drag-and-drop the tHMapRecord map into the design workspace, the tHMapRecord component is automatically created
  • When you drag-and-drop the tHMapRecord map into an existing tHMapRecord component, the label and the map reference of the component are automatically updated
Usage with Talend Runtime If you want to deploy a Job or Route containing a data mapping component with Talend Runtime, you first need to install the Talend Data Mapper feature. For more information, see Using Talend Data Mapper with Talend Runtime.