Enabling input streaming for a DSQL map
Use input streaming to avoid memory issues when working with large input data.
In a regular DSQL map execution, the input is first loaded into memory before the DSQL script is executed. While this provides the best performances, it may cause memory issues when the input data is large. With input streaming, the records are processed in blocks of 1000 records and the memory is freed after each block.
Before you begin
Procedure
- Close your DSQL map if it is open.
- Right-click your DSQL map and click Properties.
- Click DSQL Map Settings and select the Enable input streaming check box.
- Click Apply and Close.
Did this page help you?
If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!