Applying a data quality rule to a field - Cloud

Talend Cloud Data Inventory User Guide

Version
Cloud
Language
English
Product
Talend Cloud
Module
Talend Data Inventory
Content
Administration and Monitoring > Managing connections
Data Governance
Data Quality and Preparation > Enriching data
Data Quality and Preparation > Identifying data
Data Quality and Preparation > Managing datasets
Last publication date
2024-01-25

Before you begin

You created at least one dataset and one data quality rule.

About this task

In this example, you are using the previously created data quality rules.

Procedure

  1. Log in as a dataset manager or administrator with the Rules - View permission.
    To have the Rules - View permission, the roles Rule - Manager or Rule - Viewer must be assigned to you.
  2. Go to the Datasets tab and open a dataset.
  3. Go to the Sample view and select a field.
    In this example, select delivery_country.
  4. In the right panel, click Add a rule.
    Add a rule icon from the Quality tab.
  5. Select the rule Country value check and click Next.
  6. Associate the variables with the fields:
    • order_status with order_status
    • country with delivery_country
    Association of the variables with the fields.

    When the variable and field names are similar or identical, the variables are automatically associated to the fields. If you want to change the field, click it and select another one from the drop-down list.

  7. Click Validate. You are back to the Sample view.
    The rule is grayed out in the right panel because it is not applied yet.
  8. As you must apply another rule to another field, you have two choices:
    • You can apply the rule right now by clicking Apply 1 change above the right panel.
      Apply 1 change button
    • You can configure the second rule and apply both rules at the same time.
    Important: When you make several changes, they will be all applied at the same time. You cannot choose the changes you want to apply. Clicking Reset cancels all changes you have not applied yet.

    In this example, the rules will be applied at the same time.

  9. Select the field customer_tin and, in the right panel, click Add a rule.
  10. Select the rule Customer Tax ID check and click Next.
  11. Associate the variables with the fields:
    • customer_segment with customer_segment
    • customer_tin with customer_tin
      Association of the variables to the fields.
  12. Click Validate. You are back to the Sample view.
    The rule is grayed out in the right panel because it is not applied yet.
  13. Click Apply 2 changes above the right panel.

    Applying the changes can take a few minutes depending on the dataset.

    The rules are applied to the fields and you can see the invalid, non-applicable, and valid values.
    New rule is added to the Quality tab of the rule. New rule is added to the Quality tab of the rule.
    The other quality bars above the dataset are also updated:
    • Above the dataset
    Quality bars from the dataset header.