Installing Talend Dictionary Service manually

Talend Data Integration Installation Guide for Linux

EnrichVersion
6.3
EnrichProdName
Talend Data Integration
task
Installation and Upgrade
EnrichPlatform
Talend Administration Center
Talend Activity Monitoring Console
Talend Data Stewardship
Talend JobServer
Talend Artifact Repository
Talend Data Preparation
Talend Installer
Talend Project Audit
Talend Studio
Talend CommandLine
Talend Log Server
Talend Runtime

This procedure contains the steps to manually install Talend Dictionary Service on your machine. For the automatic installation procedure using Talend Installer, see Using Talend Installer graphical installation mode.

Prerequisites:

  1. Download Apache Kafka from https://kafka.apache.org/downloads and install it. For more information on how to install it, see Apache Kafka documentation.

  2. Download a MongoDB instance from https://www.mongodb.com/download-center and install it. For more information on how to install it, see MongoDB documentation.

    If you want to secure connections with MongoDB using SSL, MongoDB Enterprise Server has to be manually installed on your machine. For more information, see https://docs.mongodb.com/v3.2/security/.

  3. Download Apache Tomcat from http://tomcat.apache.org/download-80.cgi and install it. For more information on how to install it, see Apache Tomcat documentation.

    For production environments, it is recommended to use a separate Tomcat instance for Talend Dictionary Service.

To manually install and configure Talend Dictionary Service, follow this procedure:

Install and Configure Talend Dictionary Service

  1. Add mongo to the PATH environment variable.

  2. Create the dqdict database in MongoDB.

  3. Create the following user for the dqdict database in MongoDB:

    • Username: dqdict-user

    • Password: duser

  4. Download Apache Tomcat from http://tomcat.apache.org/download-80.cgi and install it. For more information on how to install it, see Apache Tomcat documentation.

    For production environments, it is recommended to use a separate Tomcat instance for Talend Dictionary Service.

  5. Stop your Tomcat instance if it was automatically started.

  6. Unzip the DQDictServer-A.B.C.zip to a dq_dict folder.

  7. Remove the contents of the <Tomcat>/webapps folder.

  8. Create a <Tomcat>/app folder and copy the dataquality-semantic-producer-A.B.C.war file from dq_dict.

  9. Copy the file contained in dq_dict/context to <Tomcat>/conf/Catalina/localhost.

  10. Copy the configuration file contained in dq_dict/config to <Tomcat>/conf.

  11. Open the <Tomcat>/conf/data-quality.properties file and edit the following Talend Dictionary Service properties:

    Note

    All the passwords entered in the properties file are encrypted when you start your Talend Dictionary Service instance.

    Field

    Action

    tac.url

    Enter the URL to your Talend Administration Center followed by a /.

    tac.user-name

    Enter the username of your Data Stewardship user in Talend Administration Center.

    tac.password

    Enter the password of your Data Stewardship user in Talend Administration Center.

    security.token.secret

    Enter the security token used by Talend Administration Center.

    spring.cloud.stream.kafka.binder.brokers

    Enter the host corresponding to your Kafka broker.

    spring.cloud.stream.kafka.binder.defaultBrokerPort

    Enter the port corresponding to your Kafka broker.

    spring.cloud.stream.kafka.binder.zkNodes

    Enter the host corresponding to your Zookeeper node.

    spring.cloud.stream.kafka.binder.defaultZkPort

    Enter the port corresponding to your Zookeeper node.

  12. Update the following fields with your MongoDB settings:

    Field

    Description

    dq.mongo.host

    Host name of your MongoDB instance.

    dq.mongo.port

    Port number of your MongoDB instance.

    dq.mongo.username

    Username used to connect to the database.

    dq.mongo.password

    Password used to connect to the database.

    dq.mongo.database.name

    Name of the database on which Talend Dictionary Service is connected, dqdict by default.

  13. Launch MongoDB.

  14. Go to the dq_dict/database folder and execute the semantic-dictionary-import.sh script.

  15. Start Talend Dictionary Service by launching, in order:

    1. Apache Zookeeper

    2. Apache Kafka

    3. Apache Tomcat