Migrating from Talend Dictionary Service 7.x installed with an external MongoDB - Cloud

Talend Cloud Hybrid Installation Guide for Linux

Version
Cloud
Language
English (United States)
EnrichDitaval
linux
Product
Talend Cloud
Module
Talend Data Preparation
Talend Data Stewardship
Talend Management Console
Content
Installation and Upgrade

Before you begin

You have downloaded the hybrid Talend Dictionary Service 8.0 archive from Talend Cloud's Downloads page.

Procedure

  1. Stop your instance of the previous version of Talend Dictionary Service but keep MongoDB running.
  2. Backup your MongoDB, while it is still running, using the following command: mongodump -h <source_mongodb_host>:<source_mongo_port> -d <source_database> -u <source_mongodb_user> -p <source_mongodb_password> -o <dump_output>

    Example

    mongodump -h localhost:27017 -d dqdict -u dqdict-user -p duser -o dump\
  3. Stop your MongoDB instance.
  4. Install MongoDB 4.4 and start it.
    Talend Dictionary Service 8.0 uses the 4.4 version of MongoDB.
  5. Restore MongoDB, open a command prompt window and execute the following command: <mongo_path>/bin/mongorestore -h <mongo_host>:<mongo_port> -u <mongo_dq_username> -p <mongo_dq_password> -d <mongo_dq_database> <backup_location>

    Example

    mongorestore -h localhost:27017 -d dqdict -u dqdict-user -p duser dump\         
  6. Install Talend Dictionary Service 8.0 with the external MongoDB, and configure it with the same settings as your instance of the previous version of Talend Dictionary Service, especially the links to your Talend Administration Center and point to MongoDB 4.4.
    For more information about the Talend Dictionary Service installation and configuration procedures, see the Talend Installation Guide.
  7. If you have performed any custom configuration to the previous version of the <Tomcat>/conf/data-quality.properties file, update the 8.0 version of the file by coping the values from the old configuration file. You can then change parameters needed for Talend Cloud and Talend Cloud Management Console, as explained in Configuring and starting Talend Dictionary Service.
  8. In the new version of the data-quality.properties file, replace the following parameter names with the new names:
    Previous parameter name New parameter name
    dq.mongo.host spring.data.mongodb.host
    dq.mongo.port spring.data.mongodb.port
    dq.mongo.username spring.data.mongodb.username
    dq.mongo.password spring.data.mongodb.password
    dq.mongo.database.name spring.data.mongodb.database
    dq.mongo.ssl.enabled spring.data.mongodb.ssl
    dq.mongo.ssl.trust-store spring.data.mongodb.ssl.trust-store
    dq.mongo.ssl.trust-store-password spring.data.mongodb.ssl.trust-store-password
  9. If you have performed any custom configuration to the previous version of the data-quality.properties file, update the 8.0 version of the file by coping the values from the old configuration file. You can then change parameters needed for Talend Cloud and Talend Cloud Management Console.
  10. Start Talend Dictionary Service 8.0 by launching, in order:
    • Apache Zookeeper
    • Apache Kafka
    • Apache Tomcat (Talend Administration Center server and Talend Identity and Access Management server)
    • MongoDB
    • MinIO
  11. Optional: Import the following files into Talend Data Preparation or Talend Data Stewardship to perform the functional migration from a previous version of Talend Dictionary Service:
    Previous Talend Dictionary Service version File Description
    6.3.x <install_dir>/database/functionalMigration/6.3/Phone_number.json Create the PHONE compound semantic type, which groups FR_PHONE, US_PHONE, UK_PHONE and DE_PHONE semantic types
    <install_dir>/database/functionalMigration/6.3/North_American_state.json Create the NA_STATE compound semantic type, which groups US_STATE and CA_PROVINCE_TERRITORY semantic types
    <install_dir>/database/functionalMigration/6.3/North_American_state_code.json Create the NA_STATE_CODE compound semantic type, which groups the US_STATE_CODE and CA_PROVINCE_TERRITORY_CODE semantic types
    <install_dir>/database/functionalMigration/6.3/UK_Phone.json Update the UK_PHONE semantic type
    6.4.x <install_dir>/database/functionalMigration/6.4/UK_Phone.json Update the UK_PHONE semantic type

    There are no functional migration steps for 6.5.x and 7.0.x. The migration is automated for these versions.

Results

You are now ready to use Talend Dictionary Service 8.0.