Validating data using data quality rules and dynamic schema - Cloud - 8.0

Validation (Integration)

Version
Cloud
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Open Studio for ESB
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Data Quality components > Validation components (Integration)
Data Quality and Preparation > Third-party systems > Data Quality components > Validation components (Integration)
Design and Development > Third-party systems > Data Quality components > Validation components (Integration)

The Job in this scenario uses the tDataQualityRules component to validate data using a data quality rule from Talend Cloud Data Stewardship.

The Job uses a data quality rule in advanced mode:
if (purchase_price >= 2999) {discount_percentage == 0.2}
elseif (purchase_price >= 1999 && purchase_price < 2999) {discount_percentage == 0.15}
elseif (purchase_price >= 999 && purchase_price < 1999) {discount_percentage == 0.10}
elseif (purchase_price >= 599 && purchase_price < 999) {discount_percentage == 0.07}
else {discount_percentage == 0}

For more technologies supported by Talend, see Talend components.

Important: You can use a dynamic schema in the Standard component. Apache Spark components do not support it.