Configuring and starting Talend Dictionary Service - Cloud

Talend Cloud Hybrid Installation Guide for Linux

Version
Cloud
Language
English (United States)
EnrichDitaval
linux
Product
Talend Cloud
Module
Talend Data Preparation
Talend Data Stewardship
Talend Management Console
Content
Installation and Upgrade

Procedure

  1. Open the <Tomcat>/conf/data-quality.properties file and edit the following Talend Dictionary Service properties:

    Field

    Action

    oidc.url

    Enter the URL to Talend Identity and Access Management , https://iam.<region>.cloud.talend.com/oidc. Replace <region> with your account location. You'll find a list of the URLs to use for each data center in Talend Cloud regions and URLs .

    scim.url

    Enter the URL to Talend Identity and Access Management SCIM , https://api.<region>.cloud.talend.com/v1/scim . Replace <region> with your account location. You'll find a list of the URLs to use for each data center in Talend Cloud regions and URLs .

    oidc.semanticservice.id

    Enter the client ID of the associated application (Talend Data Preparation or Talend Data Stewardship), retrieved from Talend Cloud Management Console. See Configuring hybrid in Talend Cloud Management Console.

    oidc.semanticservice.secret

    Enter the client secret of the associated application (Talend Data Preparation or Talend Data Stewardship), retrieved from Talend Cloud Management Console. See Configuring hybrid in Talend Cloud Management Console.

    spring.cloud.stream.kafka.binder.brokers

    Enter the host corresponding to your Kafka broker.

    spring.cloud.stream.kafka.binder.defaultBrokerPort

    Enter the port corresponding to your Kafka broker.

    spring.cloud.stream.kafka.binder.zkNodes

    Enter the host corresponding to your Zookeeper node.

    spring.cloud.stream.kafka.binder.defaultZkPort

    Enter the port corresponding to your Zookeeper node.

    tsd.maven.connector.s3Repository.base-path

    Enter the base path of your MinIO or S3 repository.

    tsd.maven.connector.s3Repository.username

    Enter the username of your MinIO or S3 repository.

    tsd.maven.connector.s3Repository.password

    Enter the password of your MinIO or S3 repository.

    tsd.maven.connector.s3Repository.s3.region

    Enter the region of your MinIO or S3 repository.

    tsd.maven.connector.s3Repository.s3.endpoint

    Enter the URL of your MinIO or S3 repository server.

    tsd.maven.connector.s3Repository.bucket-url

    Enter the URL of your MinIO or S3 repository bucket.

    All the passwords entered in the properties file are encrypted when you start your Talend Dictionary Service instance.

  2. Add the following hybrid-specific properties:
    Field Action
    security.oauth2.resource.jwt.key-uri=${security.oidc.client.keyUri} Enables hybrid mode.
    spring.profiles.active=hybrid Enables hybrid mode.
  3. Disable the log auditing option:
    Field Action
    audit.log.enabled Set this property to false for hybrid configuration. Setting this property to true while using Talend Dictionary Service in hybrid mode can prevent it from starting properly.
  4. Update the following fields with your MongoDB settings:

    Field

    Description

    spring.data.mongodb.host

    Host name of your MongoDB instance.

    spring.data.mongodb.port

    Port number of your MongoDB instance.

    spring.data.mongodb.username

    Username used to connect to the database.

    spring.data.mongodb.password

    Password used to connect to the database.

    spring.data.mongodb.database

    Name of the database on which Talend Dictionary Service is connected, dqdict by default.

    spring.data.mongodb.uri URI of the MongoDB instance to connect to

    If you connect to the MongoDB instance via a URI, the following parameters must be commented out: dq.mongo.host, dq.mongo.port, dq.mongo.username, dq.mongo.password, dq.mongo.database.name

    Note: This configuration parameter is available only if you have installed the TPS-4354 patch delivered by Talend. For more information, check with your administrator.
  5. Launch MongoDB.
  6. Go to the dq_dict/database folder and edit the semantic-dictionary-import.sh script.
  7. Replace the variable with your MongoDB credentials.
  8. Execute the script.
  9. Start Talend Dictionary Service by launching, in order:
    • Apache Zookeeper
    • Apache Kafka
    • Apache Tomcat (Talend Administration Center server and Talend Identity and Access Management server)
    • MongoDB
    • MinIO