When running Jobs which contain maps created using Talend Data Mapper and which stream data, it is possible to specify the number of MB used in each streaming chunk. The default is 10MB, but you can increase this amount if you have more memory to devote to the transformation.
To specify the number of MB used in each streaming chunk:
- In the Run view, in the Advanced settings tab, select the Use specific JVM arguments checkbox.
Click the New button and then, in the
Set the VM Argument dialog box that
opens, enter the argument to use.
For example, use
-DTDM_STREAM_MEMORY_LIMIT=20to stream in chunks of 20MB.
- Click OK to add the argument.