Analytics

Amazon Elastic MapReduce (EMR) is a managed Hadoop framework provided as a service. It runs across multiple EC2 instances and can run distributed frameworks such as Apache Spark.

Talend Usage:

• Provides connectivity and components to manage and leverage EMR as a hadoop platform.

  For more information about how to use Talend with EMR, see Amazon EMR - Getting Started.

Amazon Kinesis is a platform for streaming data on AWS. It is basically a Saas technology that behaves very similarly to Apache Kafka with a high-throughput, distributed message queue, publish-subscribe system. Generally, applications connecting to Amazon Kinesis will be leveraging Spark Streaming.

Talend Usage:

• Kinesis components in Spark Streaming use-cases.

Amazon Elasticsearch is a managed service for the Elastic Search engine. Elastic Search is a popular open-source analytics engine which is used very frequently with Logstash and Kibana for log analytics and real-time monitoring.

Talend Usage:

• Talend provides elastic search components for use in big data use cases.
• Talend can use elastic search as part of its infrastructure for storing logs from Talend Administration Center, Job Server, Runtime, etc.