Best Practice: Change Data Capture with Spark in Big Data

Change Data Capture

author
Talend Documentation Team
EnrichVersion
6.4
EnrichProdName
Talend Data Services Platform
Talend Data Integration
Talend Data Fabric
Talend Big Data
Talend Big Data Platform
Talend Data Management Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
task
Data Quality and Preparation > Third-party systems > Database components > Change Data Capture
Data Governance > Third-party systems > Database components > Change Data Capture
Design and Development > Third-party systems > Database components > Change Data Capture
EnrichPlatform
Talend Studio

In the Data driven world, companies who have access to data real time have a significant advantage on their competitors who do not. One of the things that prevents IT to provide real time data is the time it takes to extract data from legacy systems and load into the Analytical systems.

For more technologies supported by Talend, see Talend components.

As such, loading all the data into these systems every time is not efficient use of the computing resources and it also takes longer to get the data to the users. This is where Change Data Capture (CDC) plays a significant role in integrating data faster into target systems.