Launching parallel iterations to read data - Cloud - 7.3

Talend Studio User Guide

Version
Cloud
7.3
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Cloud
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Design and Development
Last publication date
2024-02-13

A parallelization-enabled Iterate connection allows the component that receives threads from the connection to read those threads in parallel.

Warning: Note that the globalMap is error-prone in parallel execution. Be cautious when using globalMap.put("key","value") and globalMap.get("key") to create your own global variables and then retrieve their values in your Jobs, especially after an Iterate connection with the parallel execution option enabled.

About this task

You need to proceed as follows to set the parallel iterations:

Procedure

  1. Simply select the Iterate link of your subJob to display the related Basic settings view of the Components tab.
  2. Select the Enable parallel execution check box and set the number of executions to be carried out in parallel.
    When executing your Job, the number of parallel iterations will be distributed onto the available processors.
  3. Select the Statistics check box of the Run view to show the real time parallel executions on the design workspace.