Migrating to Talend Data Preparation 7.3.x with an external MongoDB

Migrating to Talend Data Preparation 7.3.x with an external MongoDB - 7.3

Talend Data Management Platform Migration and Upgrade Guide

Version

7.3

Language

English (United States)

EnrichDitaval

Data Management Platform

Product

Talend Data Management Platform

Module

Talend Activity Monitoring Console

Talend Administration Center

Talend Artifact Repository

Talend CommandLine

Talend Data Preparation

Talend Data Stewardship

Talend DQ Portal

Talend Identity and Access Management

Talend JobServer

Talend Log Server

Talend Repository Manager

Talend Runtime

Talend SAP RFC Server

Talend Studio

Content

Installation and Upgrade

Before you begin

If you have installed and used Talend Dictionary Service to create custom semantic types or update the predefined ones, you must migrate Talend Dictionary Service before migrating Talend Data Preparation. See Migrating to Talend Dictionary Service 7.3.x.

Procedure

Stop your current Talend Data Preparation instance but keep the MongoDB instance running.

Back up your MongoDB by running the following command.

For Linux:

<mongo_path>/bin
./mongodump -h <source_mongodb_host>:<source_mongo_port> -d <source_database> -u <source_mongodb_user> -p <source_mongodb_password> -o <dump_output>

For Windows:

<mongo_path>\bin>mongodump -h <source_mongodb_host>:<source_mongo_port> -d <source_database> -u <source_mongodb_user> -p <source_mongodb_password> -o <dump_output>

For more information, see the MongoDB documentation.

After backing up MongoDB, stop the instance.

Install and start MongoDB 4.x.
Talend Data Preparation 7.3 supports MongoDB version 4.x and 3.6.
Delete the database:
1. Open a mongo shell as a Talend Data Preparation database user and execute the following commands.
  For Linux:
```
cd <install_dir>/mongodb/bin
./mongo dataprep -u dataprep-user -p dprep --port 27017
```
  For Windows:
```
<install_dir>\mongodb\bin>mongo dataprep -u dataprep-user -p dprep --port 27017
```
2. Switch to the Talend Data Preparation database: use dataprep
3. Drop the database: db.runCommand( { dropDatabase: 1 } )
4. Exit mongo shell: exit
Restore the MongoDB backup by running the following command.
For Linux:
```
<mongo_path>/bin
./mongorestore -h <mongo_host>:<mongo_port> -u <mongo_tdp_username> -p <mongo_tdp_password> -d <mongo_tdp_database> <backup_location>
```
For Windows:
```
<mongo_path>\bin>mongorestore -h <mongo_host>:<mongo_port> -u <mongo_tdp_username> -p <mongo_tdp_password> -d <mongo_tdp_database> <backup_location>
```
For the previous version of Talend Data Preparation, if you have customized the <Data_Preparation_Path>/conf/data-preparation.properties file, you can copy the values from the old configuration file to the new file.
Install Talend Data Preparation and select the external MongoDB option. Do not start the instance. Make sure to configure it with the same settings as the previous instance and link it to your Talend Administration Center.
If you have installed Talend Data Preparation in service mode, stop the instance and MongoDB.
To retrieve the content of the data-set storage folder used for Talend Data Preparation 1.x/2.x, and to migrate to version 7.3, complete the next step according to your situation:
- If you have set a custom value for the dataset.content.store.file.location property, verify that you set the same value in the application.properties file for the 7.3 version.
- If you have not modified the value of the dataset.content.store.file.location property, copy the content of the <Data_Preparation_Path>/data folder used in 1.x/2.x, and paste it in the 7.3 installation folder, following the same path.
Start Talend Data Preparation.
Republish semantic types using Talend Dictionary Service API to migrate indexes to Lucene 8.
For more information, see Talend Dictionary Service Administration Guide.

Results

You are now ready to use Talend Data Preparation.