Step 1: Loading the database table data into the Hive internal table - 7.3

Change Data Capture
Version
7.3
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Database components (Integration) > Change Data Capture
Data Quality and Preparation > Third-party systems > Database components (Integration) > Change Data Capture
Design and Development > Third-party systems > Database components (Integration) > Change Data Capture

Procedure

  1. Create a standard Job to load the database table data into the Hive internal table employee.
  2. Use the tHiveCreateTable and tHiveLoad components to load the data into the Hive table.
  3. The Talend Big Data Batch Job is as follow:
    • The data are moved from the MySQL source table employee_table to the employee table in Hive.
    • The tHiveConfiguration_1 and tHDFSConfiguration_1 components set the Hive and HDFS configuration.
    • The tMysqlInput component reads the data from the MySQL database.
    • The tHiveOutput component loads the data into the Hive table.
  4. Run the Job.
    The following shows the data in the employee Hive table after this Job is run: