Centralizing File LDIF metadata - 6.1

Talend Open Studio for Big Data User Guide

Talend Open Studio for Big Data
Design and Development
Talend Studio

LDIF files are directory files described by attributes. If you often need to read certain LDIF files, you may want to centralize the connections to these LDIF-type files and their attribute descriptions in the Repository for easy reuse. This way you will not have to define the metadata details manually in the relevant components each time you use the files.

You can centralize an LDIF file connection either from an existing LDIF file, or from the LDIF file property settings defined in a Job.

To centralize an LDIF connection and its schema from an LDIF file, expand Metadata in the Repository tree view, right-click File ldif and select Create file ldif from the contextual menu to open the file metadata setup wizard.

To centralize a file connection and its schema you have already defined in a Job, click the icon in the Basic settings view of the relevant component, with its Property Type set to Built-in, to open the file metadata setup wizard.

Then complete these steps following the wizard:


Make sure that you have installed the required third-party module as described in the Talend Installation and Upgrade Guide.

  1. Fill in the general information in the relevant fields to identify the LDIF file metadata, including Name, Purpose and Description.

    The Name field is required, and the information you provide in the Description field will appear as a tooltip when you move your mouse pointer over the file connection.

  2. If needed, set the version and status in the Version and Status fields respectively. You can also manage the version and status of a repository item in the [Project Settings] dialog box. For more information, see Version management and Status management respectively.

  3. If needed, click the Select button next to the Path field to select a folder under the File ldif node to hold your newly created file connection.

    Click Next to proceed with file settings.

  4. Click the Browse... button to browse to the file and fill out the File field.

    Skip this step if you are saving an LDIF file connection defined in a component because the file path is already filled in the File field.

  5. Check the first 50 rows of the file in the File Viewer area and click Next to continue.

  6. From the list of attributes of the loaded file, select the attributes you want to include the file schema, and click Refresh Preview to preview the selected attributes.

    Then click Next to proceed with schema finalization.

  7. If needed, customize the generated schema:

    • Rename the schema (by default, metadata) and leave a comment.

    • Add, remove or move schema columns, export the schema to an XML file, or replace the schema by importing an schema definition XML file using the tool bar.

  8. If the LDIF file on which the schema is based has been changed, click the Guess button to generate the schema again. Note that if you have customized the schema, the Guess feature does not retain these changes.

  9. Click Finish. The new schema is displayed under the relevant Ldif file connection node in the Repository tree view.

Now you can drag and drop the file connection or the schema of it from the Repository tree view onto the design workspace as a new component or onto an existing component to reuse the metadata. For further information about how to use the centralized metadata in a Job, see How to use centralized metadata in a Joband How to set a repository schema.

To modify an existing file connection, right-click it from the Repository tree view, and select Edit file ldif to open the file metadata setup wizard.

To add a new schema to an existing file connection, right-click the connection from the Repository tree view and select Retrieve Schema from the contextual menu.

To edit an existing file schema, right-click the schema from the Repository tree view and select Edit Schema from the contextual menu.