Talend ESB auto-scaling on AWS platform overview - 6.3

Talend ESB runtime auto-scaling on AWS platform

author
Xin Liu
EnrichVersion
6.4
6.3
task
Administration and Monitoring
Deployment
EnrichPlatform
Talend ESB

Online shopping companies always need to design a stable and scalable environment for their web services applications – specially need to be 100% available during sales event (Christmas sales, Black-Friday sales, etc). It’s becoming very challenging for them if they need to have heavy capacity preparation activities before each event, such as bringing extra server infrastructures, web service code deployment activities, manual configurations...

In this article, you will see how one of online shopping companies using a modern auto-scaling design solution with Talend and AWS platform to fit with their stable demand patterns or usage variabilities.

AWS Auto Scaling helps to maintain application availability and allows to scale your Amazon EC2 capacity up or down automatically according to conditions defined. You can use Auto Scaling to help ensure that you are running your desired number of Amazon EC2 instances. Auto Scaling can also automatically increase the number of Amazon EC2 instances during demand spikes to maintain performance and decrease capacity during lulls to reduce costs.

Talend ESB Runtime provides an Apache Karaf-based ESB container pre-configured to support Talend Mediation route (Apache Camel routing) and Talend Web Services Jobs (Apache CXF-based services - both REST and SOAP-based).

In this architecture, you will build a Talend Data Services platform hosted on Amazon EC2 instances, and setup AWS Auto Scaling capacities to increase/decrease Talend ESB Runtime servers based on demand.

When you will have completed this the entire Talend Runtime Auto-Scaling demo, you will be able to build a 100% scalable environment for your Web Service applications by using Talend and AWS technologies.

You may implement the similar solution based on your need, and bring more AWS services to your designs such as: OpsWorks, CloudFormation, Elastic Beanstalk, Lambda function, etc. Also, the AWS Auto-Scaling feature is not limited to server Talend Runtime applications, other Talend server components could equally benefit from this (such as Talend Jobserver for ETL Job processing), so you will share more use cases with technologies mentioned here. Please find more Talend + AWS use cases on https://www.talend.com.