Creating a Job for aggregating Snowflake data

ELT Teradata

author
Talend Documentation Team
EnrichVersion
6.5
EnrichProdName
Talend Open Studio for ESB
Talend Data Fabric
Talend Big Data
Talend Open Studio for MDM
Talend ESB
Talend Big Data Platform
Talend Open Studio for Data Integration
Talend Real-Time Big Data Platform
Talend Data Integration
Talend MDM Platform
Talend Open Studio for Big Data
Talend Data Services Platform
Talend Data Management Platform
task
Data Governance > Third-party systems > ELT components > ELT Teradata components
Design and Development > Third-party systems > ELT components > ELT Teradata components
Data Quality and Preparation > Third-party systems > ELT components > ELT Teradata components
EnrichPlatform
Talend Studio

  • A new Job has been created and the context variables SourceTableS with the value STUDENT, SourceTableT with the value TEACHER, and TargetTable with the value FULLINFO have been added to the Job. For more information about how to use context variables, see the related documentation about using contexts and variables.

  • The source table STUDENT with three columns, SID and TID of NUMBER(38,0) type and SNAME of VARCHAR(50) type, has been created in Snowflake, and the following data has been written into the table.

    #SID;SNAME;TID
    11;Alex;22
    12;Mark;23
    13;Stephane;21
    14;Cedric;22
    15;Bill;21
    16;Jack;23
    17;John;22
    18;Andrew;23
    
  • The source table TEACHER with three columns, TID of NUMBER(38,0) type and TNAME and TPHONE of VARCHAR(50) type, has been created in Snowflake, and the following data has been written into the table.

    #TID;TNAME;TPHONE
    21;Peter;+86 15812343456
    22;Michael;+86 13178964532
    23;Candice;+86 13923187456
    
  1. Add a tSnowflakeConnection component, a tSnowflakeClose component, two tELTJDBCInput components, a tELTJDBCMap component, and a tELTJDBCOutput component to your Job.
  2. On the Basic setting view of the first tELTJDBCInput component, enter the name of the first source table in the Default Table Name field. In this example, it is the context variable context.SourceTableS.
  3. Do the same to set the value of the default table name for the second tELTJDBCInput component and the tELTJDBCOutput component to context.SourceTableT and context.TargetTable respectively.
  4. Link the first tELTJDBCInput component to the tELTJDBCMap component using the Link > context.SourceTableS (Table) connection.
  5. Link the second tELTJDBCInput component to the tELTJDBCMap component using the Link > context.SourceTableT (Table) connection.
  6. Link the tELTJDBCMap component to the tELTJDBCOutput component using the Link > *New Output* (Table) connection. The link will be renamed automatically to context.TargetTable (Table).
  7. Link the tSnowflakeConnection component to the tELTJDBCMap component using a Trigger > On Subjob Ok connection.
  8. Do the same to link the tELTJDBCMap component to the tSnowflakeClose component.