Setting up a new Elasticsearch cluster alongside your Elasticsearch cluster used in 6.5.x - 7.1

Talend Real-Time Big Data Platform Migration and Upgrade Guide

EnrichVersion
7.1
EnrichProdName
Talend Real-Time Big Data Platform
EnrichPlatform
Talend Activity Monitoring Console
Talend Administration Center
Talend Artifact Repository
Talend CommandLine
Talend Data Preparation
Talend Data Stewardship
Talend DQ Portal
Talend ESB
Talend Identity and Access Management
Talend JobServer
Talend Log Server
Talend Repository Manager
Talend Runtime
Talend SAP RFC Server
Talend Studio
task
Installation and Upgrade

You can use the Reindex API to migrate indices from the old 2.x Elasticsearch cluster to a new 6.x Elasticsearch cluster.

For more information, see https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-reindex.html#reindex-from-remote.

Procedure

  1. Add the following configuration parameter to the elasticsearch.yml file of your new 6.x Elasticsearch cluster to enable it to access your old Elasticsearch cluster:
    reindex.remote.whitelist: oldhost:*
  2. Replace oldhost with the Elasticsearch host.
    Do not specify the Elasticsearch port but set value to * or you may get the following error message: "[oldhost:9200] not whitelisted in reindex.remote.whitelist"
  3. Restart the Elasticsearch cluster.