Skip to main content Skip to complementary content
Announcements

Specifying the number of MB used in each streaming chunk by Talend Data Mapper

When running Jobs which contain maps created using Talend Data Mapper and which stream data, it is possible to specify the number of MB used in each streaming chunk. The default is 10 MB, but you can increase this amount if you have more memory to devote to the transformation.

Procedure

  1. In the Run view, in the Advanced settings tab, select the Use specific JVM arguments checkbox.
  2. Click the New button and then, in the Set the VM Argument dialog box that opens, enter the argument to use.
    For example, use -DTDM_STREAM_MEMORY_LIMIT=20 to stream in chunks of 20 MB.
  3. Click OK to add the argument.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!

Leave your feedback here