Properties to configure to map fields between a source and a destination schema.
The Data mapping processor allows you to map fields before writing to a defined destination. Therefore, the processor can only be added right before the destination. No processors can be added after a mapping in your pipeline.
Click Open mapping on the right panel of the pipeline to start mapping fields.
Property | Configuration |
---|---|
Inputs1 | List of the fields available in the input schema to be mapped with the output fields. |
Mapping2 | Relationship represented by lines between the selected input and output
fields. To start mapping, you can either:
|
Input selection3 | Selected input field to be mapped with an output field, either by browsing from the drop-down list, or by typing a field name. |
Expression builder4 | An output field marked with the icon indicates that an expression has been written while mapping
several fields together. If an expression is used, the fields displayed in the Input selection column are the input schema fields used in the expression. The language used in this code editor is the Data Shaping Expression Language. For more information, read Additional information about the Expression builder. |
Outputs5 |
List of the fields available in the output schema to be mapped with the
input fields. An output field marked with the icon indicates that mapping this field with an input field is mandatory. Even though ignoring the warnings will not necessarily prevent you from running your pipeline, the best practice remains mapping all the mandatory fields. |
Limitations
The Data mapping processor is only available for flat/non-hierarchical source datasets for now.