Amazon Web Services (AWS) - How to deploy a highly-available and scalable Architecture with Talend ESB and AWS Auto Scaling
We will be using an interesting feature of AWS named AWS Auto Scaling. This will be a step-by-step guide to build this scalable architectucre based on Auto Scaling Group and Talend ESB.
Introduction
Elasticity is one of the major benefits customers are looking for when moving their architecture into the cloud.In cloud computing, Elasticity can be defined as the ability of an architecture to automatically adapt its resources or computing capability to the workload or traffic variations.
Talend can be deployed in Amazon Web Services to support an elastic and scalable architecture which can grow and shrink automatically as required while making optimal use of the AWS resources and minimizing cost.
Architecture
Assumptions
- Amazon Web Services (AWS):
- You should be familiar with AWS platform since this article does not take a deep
dive into details regarding Administration and Management of AWS services.
For more information about all the AWS functionalities that Talend provides, see the article Amazon Web Services (AWS) - Getting Started.
- You should also have full access to the main AWS services described in the Prerequisites section below.
- You should be familiar with AWS platform since this article does not take a deep
dive into details regarding Administration and Management of AWS services.
- Talend:
- You should be familiar with Installation and Management of Talend ESB since this article does not take a deep dive into details regarding these points.
Environment
This demonstration is based on AWS Cloud Platform and Talend ESB 6.2.
Prerequisites
- A valid AWS account with full access to following services:
- Amazon Elastic Compute Cloud - https://aws.amazon.com/ec2.
- AWS Elastic Load Balancing - https://aws.amazon.com/elasticloadbalancing.
- Auto Scaling - https://aws.amazon.com/autoscaling.
- Amazon Simple Notification Service - https://aws.amazon.com/sns.
- Amazon Simple Queue Service - https://aws.amazon.com/sqs.
- Amazon Cloudwatch - https://aws.amazon.com/cloudwatch.
- Talend ESB (Commercial Edition) - https://fr.talend.com/products/application-integration.
Amazon Web Services (AWS) - How to deploy a highly-available and scalable Architecture with Talend ESB and AWS Auto Scaling
Choose an AWS Region
Procedure
Create a Virtual Private Cloud (VPC)
Let's create a VPC to host our application. As per AWS documentation, VPC will help us provision a logically isolated section of the Amazon Web Services (AWS) cloud where AWS resources can be launched. It also gives a full control of network configuration.
As described in the Architecture diagram, our bespoke VPC spans across two Availability Zones within the region to add more high-availability.
Create then Setup a VPC with two public subnets.