Setting up Hortonworks High Availability in Talend Studio - 7.3

EnrichVersion
7.3
EnrichProdName
Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
EnrichPlatform
Talend Studio
task
Design and Development > Designing Jobs > Hadoop distributions

Setting up Hortonworks High Availability in Talend Studio

Subscription
This article describes how to enable High Availability (HA) for a specific Hortonworks connection defined in the Studio.
Prerequisites
  • You are using a Talend solution with Big Data
  • You have High Availability properly configured in your Hortonworks cluster
Resolution

The easiest way to enable High Availability is to import the HA configuration from the following Hadoop configuration files into the metadata of the Hortonworks connection:

  • core-site.xml
  • hdfs-site.xml
  • hive-site.xml
  • mapred-site.xml
  • yarn-site.xml

You can ask the administrator of your cluster for these files and store them in a folder.

Proceed as follows:

  1. In the Repository , from the Hortonworks connection metadata you have created under the Hadoop cluster node, open the [Hadoop Cluster Connection] wizard.
  2. Select the Use custom Hadoop configurations check box and click the [...] button next to it to open the [Hadoop Configuration Import Wizard].

    Note: The above image is only an example.

  3. Follow the instructions in this wizard to import the *-site.xml files. If you need help using this wizard, see Import Hadoop configuration.