The Job in this scenario uses the tDataQualityRules component to validate data using a data quality rule from Talend Cloud Data Stewardship.
The Job uses a data quality rule in advanced
mode:
if (purchase_price >= 2999) {discount_percentage == 0.2}
elseif (purchase_price >= 1999 && purchase_price < 2999) {discount_percentage == 0.15}
elseif (purchase_price >= 999 && purchase_price < 1999) {discount_percentage == 0.10}
elseif (purchase_price >= 599 && purchase_price < 999) {discount_percentage == 0.07}
else {discount_percentage == 0}
For more technologies supported by Talend, see Talend components.
Important: You can use a dynamic schema in the Standard
component. Apache Spark components do not support it.