Talend Data Integration functional architecture - 6.5

Talend Data Integration Studio User Guide

EnrichVersion
6.5
EnrichProdName
Talend Data Integration
task
Design and Development
EnrichPlatform
Talend Studio

Talend Studio functional architecture is an architectural model that identifies Talend Studio functions, interactions and corresponding IT needs. The overall architecture has been described by isolating specific functionalities in functional blocks.

The following chart illustrates the main architectural functional blocks used to handled your data integration tasks.

Note

The building blocks you have available for use depend on your license.

Several functional blocks are defined:

  • The Clients block includes one or more Talend Studio(s) and Web browsers that could be on the same or on different machines.

    From the Studio, you can carry out data integration processes regardless of the level of data volumes and process complexity. Talend Studio allows you to work on any project for which you have authorization. .

    From the Web browser, you connect to the remotely based Talend Administration Center through a secured HTTP protocol.

  • The Talend Servers block includes a web-based Administration Center (application server) connected to:

    • two shared repositories: one based on an SVN or Git server and one based on a Nexus repository,

    • databases: one for administration metadata, one for audit information, and one for Activity monitoring,

    • Talend execution server(s).

    Talend Administration Center enables the management and administration of all projects. Administration metadata (user accounts, access rights and project authorization for example) is stored in the Administration database. Project metadata (Jobs, Business Models and Routines for example) is stored in the SVN or Git server.

    For detailed information about the Administration Center, see Talend Administration Center User Guide.

  • The Repositories block includes the SVN or Git server and the Nexus repository. The SVN or Git server is used to centralize all project metadata like Jobs and Business Models shared between different end-users, and accessible from the Talend Studio to develop them and from Talend Administration Center to publish, deploy and monitor them.

    The Nexus repository is used to store:

    • Software Updates available for download,

    • Jobs that are published from the Talend Studio and are ready to be deployed and executed.

  • The Talend Execution Servers block includes one or more execution servers, deployed inside your information system. Talend Jobs are deployed to the Job servers through the Administration Center's Job Conductor to be executed on scheduled time, date, or event.

    For detailed information about execution servers, see Talend Administration Center User Guide.

  • The Databases block includes the Administration, the Audit and the Monitoring databases. The Administration database is used to manage user accounts, access rights and project authorization, and so on. The Audit database is used to evaluate different aspects of the Jobs implemented in projects realized in Talend Studio with the aim of providing solid quantitative and qualitative factors for process-oriented decision support. The Monitoring databases include the Talend Activity Monitoring Console database and the Service Activity Monitoring database.

    The Talend Activity Monitoring Console allows you to monitor the execution of technical processes. It provides detailed monitoring capabilities that can be used to consolidate collected log information, understand the underlying data flows interaction, prevent faults that could be unexpectedly generated and support the system management decisions.

    The Service Activity Monitoring allows you to monitor service calls. It provides monitoring and consolidated event information that the end-user can use to understand the underlying requests and replies that compose the event, monitor faults and support the system management decisions.