Building high availability for Talend Data Integration with Microsoft Azure - 8.0

Building high availability for Talend Data Integration with Microsoft Azure

Version
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Administration Center
Talend JobServer
Content
Design and Development
Last publication date
2024-02-06
This article shows how to provide high availability for Talend Data Integration with Azure Production Environment.

Overview

This article explains how to use:

  • Azure Virtual Machine to create four virtual machines.
  • Azure Storage to share files between the two Talend Administration Center instances.
  • Azure Database for MySQL for the Talend Administration Center database.
  • Azure Load Balancer to ensure the failover.

As a reminder, the high availability of Talend Administration Center is only based on the scheduling of task executions.

You will build an architecture with:

  • Two Talend Administration Center instances
  • Two Talend JobServer instances
  • One Azure Storage
  • One Azure MySQL database
  • One Azure Load Balancer

Architecture

Prerequisites

Microsoft Azure

  • You have access to Microsoft Azure with a valid account (https://portal.azure.com).
  • You have full access to the Azure services described in the overview section above.

Talend

  • You are familiar with the installation and the management of Talend Data Integration.

Environment

In this example, you use a Redhat 7.3 Linux environment to implement the architecture. Redhat 7.3 Linux is a standard image available on Microsoft Azure.

But you can use another Linux system or Windows server system to implement it.