tSetDynamicSchema Standard properties - 6.5

Dynamic Schema

author
Talend Documentation Team
EnrichVersion
6.5
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
task
Data Governance > Third-party systems > Custom code components (Integration) > Dynamic Schema components
Data Quality and Preparation > Third-party systems > Custom code components (Integration) > Dynamic Schema components
Design and Development > Third-party systems > Custom code components (Integration) > Dynamic Schema components
EnrichPlatform
Talend Studio

These properties are used to configure tSetDynamicSchema running in the Standard Job framework.

The Standard tSetDynamicSchema component belongs to the Custom Code family.

The component in this framework is available in all Talend subscription-based products.

Basic settings

Schema and Edit schema

A schema is a row description. It defines the number of fields (columns) to Repository. When you create a Spark Job, avoid the reserved word line when naming the fields.

 

Built-In: You create and store the schema locally for this component only.

 

Repository: You have already created the schema and stored it in the Repository. You can reuse it in various projects and Job designs.

 

Click Edit schema to make changes to the schema. If the current schema is of the Repository type, three options are available:

  • View schema: choose this option to view the schema only.

  • Change to built-in property: choose this option to change the schema to Built-in for local changes.

  • Update repository connection: choose this option to change the schema stored in the repository and decide whether to propagate the changes to all the Jobs upon completion. If you just want to propagate the changes to the current Job, you can select No upon completion and choose this schema metadata again in the [Repository Content] window.

Sync columns Click to synchronize the output file schema with the input file schema. The Sync function is available only when the component is linked with an input component using a Row connection.
Parameters

This table contains two columns.

Property: Property of the schema entry: ColumnName, DBName, Type, DBType, Length, Precision, Nullable, or Key.

Value: Value assigned to this property.

Advanced settings

tStatCatcher Statistics

Select this check box to gather the Job processing metadata at a Job level as well as at each component level.

Global Variables

Global Variables

DYNAMIC: the last row of the data retrieved using the defined dynamic schema. This is an After variable and it returns a dynamic.

ERROR_MESSAGE: the error message generated by the component when an error occurs. This is an After variable and it returns a string. This variable functions only if the Die on error check box is cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl + Space to access the variable list and choose the variable to use from it.

For further information about variables, see Talend Studio User Guide.

Usage

Usage rule

This component is generally used as the end component in a subjob.

Limitation

This component always requires an input component to defines the data structure to set into a dynamic schema.

Note:

To work with tSetDynamicSchema, components should have the option of Use existing dynamic, which allows you to select the tSetDynamicSchema component from the list.