Importing metadata - 8.0

Talend Data Catalog User Guide

Version
8.0
Language
English
Product
Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Data Catalog
Content
Data Governance
Last publication date
2023-09-26

You have been assigned an object role with the Metadata Management capability.

Creating a new model

  1. Go to Manage > Repository or Manage > Configuration.
  2. Right-click the repository icon from the repository manager or click the Add button from the configuration manager.
  3. Click New > Model or Model.
  4. Fill in the following fields:
    Field Description
    Name Type in the name of the model.
    Import server Select the import server.

    For example, you can use the default server or a remote harvesting server.

    Import bridge Select the source technology tool or format from the drop-down list.

    You can filter the bridge list by using the search box.

    You can sort the bridges by clicking Vendor or Category in Group by.

  5. Click OK.
  6. In the Overview tab, you can add a description and labels.
  7. In Options, you can enable or disable the Propagate documentation option. By default, this option is disabled.
    The Propagate documentation option allows you to control the propagation of data documentation. It only applies to diagrams, join relationships, business names and descriptions and custom attributes.
    • If you leave the check box clear, the propagation of documentation occurs from the latest model version only.
    • If you select the check box, the propagation of documentation occurs from an old model version.

      It is recommended to enable this option only when you need to change a piece of documentation and propagate this change from an old version to the newer versions. Once done, disable the option to avoid conflicts or the propagation of unexpected changes in the newer versions.

  8. Save your changes.

Configuring the import parameters

  1. Click the Import Setup tab to set up the import parameters.
  2. Optional: Select a cloud identity.

    For more information, see Creating a cloud identity.

  3. Click the row of each parameter and fill in the information according to the documentation displayed in the Help panel.

    The fields of the parameters vary depending on the selected import bridge.

    You do not need to fill in the information stored in a selected cloud identity.

  4. Click Test to test the connection.
  5. Save your changes.

Configuring the import options

  1. Click the Import Options tab to configure the import options.
  2. In Data, set up the following options to generate data profiling and sampling:
    • Data Sampling: Select the check box to enable the data sampling during the import and define the number of rows for preview.
    • Data Profiling: Select the check box to enable the data profiling during the import and define the number of rows to profile.
    • Profile only objects that are not profiled yet: Select the check box to enable data profiling only on imported objects which have not been profiled.

      If the check box is cleared, Talend Data Catalog re-profiles imported objects based on their last modification time.

    • Data Classification: Select the check box to run automatically the data classification on the newly profiled objects.
    • Hide data using Sensitivity Label: Select the check box then select a sensitivity label from the list to hide the profile and sample data by default.

    You can verify in the bridge specifications if data profiling is supported.

  3. In Import options, enable the following options if necessary:
    • Set new versions as default: Select the check box to automatically set any new imported version as the default version.
    • Create new versions only when new import has changes: Select the check box to create a new version only when changes are detected.

      This option can apply to all bridges independently of the incremental harvesting capability of some bridges.

    • Copy model description to content: Select the check box to apply the description of the model from the source metadata to the content version itself.
  4. Save your changes.

Running the import

  1. Click the Import button.
  2. Optionally, enable additional options in the Import Model dialog box:
    • Full source import instead of incremental: Select Yes to force a full harvesting by clearing the incremental harvesting cache. You can select this option after applying a patch that updates the bridge or after changing the bridge parameters. Because of this option, the Incremental import parameter of any import bridge is hidden.
    • Save import troubleshooting details: Select Yes to save the import log with detailed information for support purposes.
    • Save the imported model to the database: Select Yes to skip loading the imported metadata into the database.
    • Notify on failure: Select Yes to notify the manager of this model if the import fails.
  3. Click Import to run the import.
  4. To monitor the operation, click the spinning gear icon on the header or go to Manage > Operations.
  5. To open the log, right-click the operation then click Show log.
    The Log Messages dialog appears.
    • If you receive the Operation succeeded result, you can open the model.
    • If you receive the Operation failed result, inspect the log messages and correct the source model file accordingly.

Configuring naming standards

  1. Click the Naming Standards tab to define naming standards.
  2. Select the Enable Naming Standards check box.
  3. Select the Naming Standard object to use.
  4. Fill in the following parameters.
    • Allow Supervised Learning: Click Yes to enable the option.

      When enabled, every time you edit the (logical) Name property for columns and tables, the associated naming standard will be updated to reflect the new naming.

    • Ignore Common Prefix in Table Columns: Click Yes to ignore prefixes for physical names in table columns when applying a naming standard.

      Specify the list of prefixes and suffixes in Prefixes to ignore and Suffixes to ignore.

    • Capitalize First Letter of Each Word: Click Yes to capitalize the first letter of each word.
  5. Save your changes.

Assigning responsibilities on the model

You have been assigned a global role with the Security Administration capability.

  1. Click the Responsibilities tab to assign object roles to users or groups.
  2. Click Add role.
  3. Select an object role from the list.
  4. Select one or more users or groups.
  5. Click OK.
  6. Save your changes.