Using Dynamic Schema to load data dynamically to database tables - 8.0

Data Integration Job Examples

Version
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Open Studio for ESB
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Design and Development > Designing Jobs
Last publication date
2024-02-06
This example describes how to leverage the Dynamic Schema feature to load data dynamically.
Warning: This documentation is relevant only if you are using a subscription-based Talend Studio.

The content of the following three flat files will be loaded to MySQL database tables named customer, employee and delivery respectively:

  • customer_detaials.csv:
    first_name;last_name;order_date
    Reita;Leto;2012-05-15
    Larae;Gudroe;2011-08-07
    Clay;Hoa;2014-04-16
    Irma;Wolfgramm;2012-09-10
    Sylvia;Cousey;2013-02-25
  • employee_details.csv:
    id;name;gender;email;department;order_date
    1;Sage;Male;sage_wieser@cox.net;R&D;2012-05-15
    2;Kris;Female;kris@gmail.com;Test;2011-08-07
    3;Abel;Male;amaclead@gmail.com;HR;2014-04-16
    4;Mattie;Female;mattie@aol.com;Test;2012-09-10
    5;Bernardo;Female;bfigeroa@aol.com;Marketing;2013-02-25
  • delivery_details.csv:
    Name;Datetime
    Reita;2012-02-11 15:30:32
    Larae;2015-08-28 09:30:32

The example involves two Jobs one calling the other: the parent Job maps the file names to table names in the database, and the child Job reads data from the files and writes the data to the corresponding database tables.