Functional architecture of Talend Big Data solutions - 7.1

Talend Real-time Big Data Platform Studio User Guide

author
Talend Documentation Team
EnrichVersion
7.1
EnrichProdName
Talend Real-Time Big Data Platform
task
Design and Development
EnrichPlatform
Talend Studio

The functional architecture of Talend Big Data solutions is an architectural model that identifies the functions, interactions and corresponding IT needs of Talend Big Data solutions.

The overall architecture has been described by isolating specific functionalities in functional blocks.

The following chart illustrates the main architectural functional blocks relevant to big data handling in the studio.

Three different types of functional blocks are defined:
  • at least one Studio where you can design big data Jobs that leverage the Apache Hadoop platform to handle large data sets. These Jobs can be either executed locally or deployed, scheduled and executed on a Hadoop grid via the Oozie workflow scheduler system integrated within the studio.

  • a workflow scheduler system integrated within the studio through which you can deploy, schedule, and execute big data Jobs on a Hadoop grid and monitor the execution status and results of the Jobs.

  • a Hadoop grid independent of the Talend system to handle large data sets.