Crawling datasets using the manual selection - Cloud

Talend Cloud Data Inventory User Guide
Version
Cloud
Language
English
Product
Talend Cloud
Module
Talend Data Inventory
Content
Administration and Monitoring > Managing connections
Data Governance
Data Quality and Preparation > Enriching data
Data Quality and Preparation > Identifying data
Data Quality and Preparation > Managing datasets
Last publication date
2023-11-08

The manual crawler mode allows you to directly select which tables you want to import as datasets.

This mode is adapted for a straightforward usage, where you want to retrieve or updates specific tables. However, this means that if changes occur in the database between two runs, you will potentially need to manually remake your selection each time.

Before you begin

You have opened the crawler configuration window, as described in Crawling for multiple datasets.

Procedure

  1. Select the Manual selection mode.
    All the content of your connection is detected and listed.
  2. Choose between importing all the available tables from the database, or just specific ones.
    • Import all available tables

      To select all the tables contained in your database, select Tables in the Type drop-down list, select the check box in the Name column header, and click Next.

    • Import specific tables

      If you want to import only specific tables or views, you can use the search field and the Type drop-down list to explore the content of the connection and select the corresponding check boxes.

  3. Click Next and set the sharing configuration.
  4. Click Next and enter a Name for your crawler, Snowflake manual for example, and optionally a Description to describe the use case and scope of the crawler.
  5. Click Run.

Results

The crawling process starts and the selected tables are progressively added as datasets in your inventory. After the sample for a given dataset is available, you can start using it.