Building high availability for Talend Data Integration with Microsoft Azure

Overview

This article explains how to use:

• Azure Virtual Machine to create four virtual machines.
• Azure Storage to share files between the two Talend Administration Center instances.
• Azure Database for MySQL for the Talend Administration Center database.
• Azure Load Balancer to ensure the failover.

As a reminder, the high availability of Talend Administration Center is only based on the scheduling of task executions.

You will build an architecture with:

• Two Talend Administration Center instances
• Two Talend JobServer instances
• One Azure Storage
• One Azure MySQL database
• One Azure Load Balancer

Architecture

Prerequisites

Microsoft Azure

• You have access to Microsoft Azure with a valid account (https://portal.azure.com).
• You have full access to the Azure services described in the overview section above.

Talend

• You are familiar with the installation and the management of Talend Data Integration.

Environment

In this example, you use a Redhat 7.3 Linux environment to implement the architecture. Redhat 7.3 Linux is a standard image available on Microsoft Azure.

But you can use another Linux system or Windows server system to implement it.