Setting up a new Elasticsearch cluster alongside your Elasticsearch cluster used in 6.5.x - 7.1

Talend Data Services Platform Migration Guide

EnrichVersion
7.1
EnrichProdName
Talend Data Services Platform
task
Installation and Upgrade
EnrichPlatform
Talend Activity Monitoring Console
Talend Administration Center
Talend Artifact Repository
Talend CommandLine
Talend Data Preparation
Talend Data Stewardship
Talend DQ Portal
Talend ESB
Talend Identity and Access Management
Talend JobServer
Talend Log Server
Talend Repository Manager
Talend Runtime
Talend SAP RFC Server
Talend Studio

You can use the Reindex API to migrate indices from the old 2.x Elasticsearch cluster to a new 6.x Elasticsearch cluster.

For more information, see https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-reindex.html#reindex-from-remote.

Procedure

  1. Add the following configuration parameter to the elasticsearch.yml file of your new 6.x Elasticsearch cluster to enable it to access your old Elasticsearch cluster:
    reindex.remote.whitelist: oldhost:*
  2. Replace oldhost with the Elasticsearch host.
    Do not specify the Elasticsearch port but set value to * or you may get the following error message: "[oldhost:9200] not whitelisted in reindex.remote.whitelist"
  3. Restart the Elasticsearch cluster.