Migrating from Talend Dictionary Service 6.x or 7.0.x installed with an embedded MongoDB - 7.1

Talend Data Services Platform Migration Guide

EnrichVersion
7.1
EnrichProdName
Talend Data Services Platform
task
Installation and Upgrade
EnrichPlatform
Talend Activity Monitoring Console
Talend Administration Center
Talend Artifact Repository
Talend CommandLine
Talend Data Preparation
Talend Data Stewardship
Talend DQ Portal
Talend ESB
Talend Identity and Access Management
Talend JobServer
Talend Log Server
Talend Repository Manager
Talend Runtime
Talend SAP RFC Server
Talend Studio

Before you begin

You have downloaded Talend Dictionary Service 7.1.x.

Procedure

  1. Install Talend Dictionary Service 7.1.x with the embedded MongoDB, and do not start the instance.
    For more information about the Talend Dictionary Service installation and configuration procedures, see Installing and configuring Talend Dictionary Service.
  2. If you have installed Talend Dictionary Service 7.1.x in service mode, stop the instance, delete the database and stop MongoDB:
    1. Open a mongo shell as Talend Dictionary Service database user and execute the following commands:
      cd <install_dir>/mongodb/bin
      ./mongo dqdict -u dqdict-user -p duser --port 27017
    2. Switch to Talend Dictionary Service database: use dqdict
    3. Drop the database: db.runCommand( { dropDatabase: 1 } )
    4. Exit mongo shell: exit
    5. Stop MongoDB.
  3. If you have performed any custom configuration to the previous version of the <Tomcat>/conf/data-quality.properties file, update the 7.1.x version of the file by coping the values from the old configuration file.
  4. Stop your instance of the previous version of Talend Dictionary Service but keep MongoDB running.
  5. Back up the MongoDB instance used for the previous version of Talend Dictionary Service using the following command: mongodump -h <source_mongodb_host>:<source_mongo_port> -d <source_database> -u <source_mongodb_user> -p <source_mongodb_password> -o <dump_output>
    The default value for the embedded MongoDB properties are the following:
    Property Value
    mongodb.host localhost
    mongodb.port 27017
    mongodb.database dqdict
    mongodb.user dqdict-user
    mongodb.password duser
    mongodump -h localhost:27017 -d dqdict -u dqdict-user -p duser -o dump\
  6. Stop MongoDB of the previous version of Talend Dictionary Service and start MongoDB of the 7.1.x version.
  7. Restore the backup performed on the MongoDB of the previous version of Talend Dictionary Service, on the 7.1.x MongoDB instance using the following command: mongorestore -h <source_mongodb_host>:<source_mongo_port> -d <source_database> -u <source_mongodb_user> -p <source_mongodb_password> dump\
    mongorestore -h localhost:27017 -d dqdict -u dqdict-user -p duser dump\
  8. Start Talend Dictionary Service 7.1.x by launching, in order:
    • Apache Zookeeper
    • Apache Kafka
    • Apache Tomcat (Talend Administration Center server and Talend Identity and Access Management server)
    • MongoDB
  9. Optional: Import the following files into Talend Data Preparation or Talend Cloud Data Stewardship to perform the functional migration from a previous version of Talend Dictionary Service:
    Previous Talend Dictionary Service version File Description
    6.3.x <install_dir>/database/functionalMigration/6.3/Phone_number.json Create the PHONE compound semantic type, which groups FR_PHONE, US_PHONE, UK_PHONE and DE_PHONE semantic types
    <install_dir>/database/functionalMigration/6.3/North_American_state.json Create the NA_STATE compound semantic type, which groups US_STATE and CA_PROVINCE_TERRITORY semantic types
    <install_dir>/database/functionalMigration/6.3/North_American_state_code.json Create the NA_STATE_CODE compound semantic type, which groups the US_STATE_CODE and CA_PROVINCE_TERRITORY_CODE semantic types
    <install_dir>/database/functionalMigration/6.3/UK_Phone.json Update the UK_PHONE semantic type
    6.4.x <install_dir>/database/functionalMigration/6.4/UK_Phone.json Update the UK_PHONE semantic type

    There are no functional migration steps for 6.5.x and 7.0.x.

Results

You are now ready to use Talend Dictionary Service 7.1.x.