Migrating to Talend Data Stewardship 8.0.x with an embedded MongoDB - 8.0

Talend Big Data Platform Migration and Upgrade Guide

Version
8.0
Language
English (United States)
EnrichDitaval
Big Data Platform
Product
Talend Big Data Platform
Module
Talend Activity Monitoring Console
Talend Administration Center
Talend Artifact Repository
Talend CommandLine
Talend Data Preparation
Talend Data Stewardship
Talend DQ Portal
Talend Identity and Access Management
Talend JobServer
Talend Log Server
Talend Repository Manager
Talend Runtime
Talend SAP RFC Server
Talend Studio
Content
Installation and Upgrade

Before you begin

If you have installed and used Talend Dictionary Service to create custom semantic types or update the predefined ones, you must migrate Talend Dictionary Service before migrating Talend Data Stewardship. See Migrating to Talend Dictionary Service 8.0.x.

Procedure

  1. Stop your current Talend Data Stewardship instance but keep MongoDB running.
  2. Back up the MongoDB instance used for the previous version of Talend Data Stewardship using the following command.
    For Linux:
    <mongo_path>/bin
    ./mongodump -h <source_mongodb_host>:<source_mongo_port> -u <mongo_tds_username> -p <mongo_tds_password> -d <mongo_tds_database> -o <backup_location>
    For Windows:
    <mongo_path>/bin>mongodump -h <source_mongodb_host>:<source_mongo_port> -u <mongo_tds_username> -p <mongo_tds_password> -d <mongo_tds_database> -o <backup_location>
    The default value for the embedded MongoDB properties are the following:
    Property Value
    mongodb.host localhost
    mongodb.port 27017
    mongodb.database tds
    mongodb.user tds-user
    mongodb.password duser
  3. Stop the MongoDB instance from the previous version of Talend Data Stewardship.
    Note: For Windows users, you must uninstall the current MongoDB before you install Talend Data Stewardship 8.0.x.
  4. Install Talend Data Stewardship 8.0.x and select the embedded MongoDB option. Do not start Talend Data Stewardship, but start MongoDB.
  5. Delete the database
    1. Open a mongo shell as a Talend Data Stewardship database user and execute the following commands.
      For Linux:
      cd <install_dir>/mongodb/bin
      ./mongo tds -u tds-user -p duser --port 27017
      For Windows:
      <install_dir>\mongodb\bin>mongo tds -u tds-user -p duser --port 27017
    2. Switch to the Talend Data Stewardship database: use tds
    3. Drop the database: db.runCommand( { dropDatabase: 1 } )
    4. Exit mongo shell: exit
  6. Restore the MongoDB backup on the new 8.0.x MongoDB instance by using the following command.
    For Linux:
    <mongo_path>/bin
    ./mongorestore -h <mongo_host>:<mongo_port> -u <mongo_tds_username> -p <mongo_tds_password> -d <mongo_tds_database> <backup_location>
    For Windows:
    <mongo_path>/bin>mongorestore -h <mongo_host>:<mongo_port> -u <mongo_tds_username> -p <mongo_tds_password> -d <mongo_tds_database> <backup_location>
  7. If you have customized the <Data_Stewardship_Path>/conf/data-stewardship.properties file in the previous version, you can copy the values from the old configuration file and add them to the new version.
  8. Delete the <install_dir>/tds/apache-tomcat/data folder from your Talend Data Stewardship 8.0.x installation.
  9. Start Talend Data Stewardship 8.0.x.
  10. Republish semantic types using Talend Dictionary Service API to migrate indexes to Lucene 8.

Results

You are now ready to use Talend Data Stewardship 8.0.x.