Configuring and starting Talend Dictionary Service - Cloud

Talend Cloud Hybrid Installation Guide

Version
Cloud
Language
English
Operating system
Linux
Product
Talend Cloud
Module
Talend Data Preparation
Talend Data Stewardship
Talend Management Console
Content
Installation and Upgrade
Last publication date
2024-02-19

Procedure

  1. Open the <Tomcat>/conf/data-quality.properties file and edit the following Talend Dictionary Service properties:

    Field

    Action

    oidc.url
    Enter the URL to Talend Identity and Access Management , https://iam.<region>.cloud.talend.com/oidc. Replace <region> with your account location. You'll find a list of the URLs to use for each data center in Talend Cloud regions and URLs .
    Note: This property no longer exists from version 8.0 R2022-07 or later because user access is managed with Personal Access Tokens.
    scim.url

    Enter the URL to Talend Identity and Access Management SCIM , https://api.<region>.cloud.talend.com/v1/scim . Replace <region> with your account location. You'll find a list of the URLs to use for each data center in Talend Cloud regions and URLs .

    Note: This property no longer exists from version 8.0 R2022-07 or later because user access is managed with Personal Access Tokens.
    oidc.semanticservice.id

    Enter the client ID of the associated application (Talend Data Preparation or Talend Data Stewardship), retrieved from Talend Management Console. See Configuring hybrid in Talend Management Console.

    Note: This property no longer exists from version 8.0 R2022-07 or later because user access is managed with Personal Access Tokens.
    oidc.semanticservice.secret

    Enter the client secret of the associated application (Talend Data Preparation or Talend Data Stewardship), retrieved from Talend Management Console. See Configuring hybrid in Talend Management Console.

    Note: This property no longer exists from version 8.0 R2022-07 or later because user access is managed with Personal Access Tokens.
    spring.cloud.stream.kafka.binder.brokers

    Enter the host corresponding to your Kafka broker.

    spring.cloud.stream.kafka.binder.defaultBrokerPort

    Enter the port corresponding to your Kafka broker.

    spring.cloud.stream.kafka.binder.zkNodes

    Enter the host corresponding to your ZooKeeper node.

    spring.cloud.stream.kafka.binder.defaultZkPort

    Enter the port corresponding to your ZooKeeper node.

    tsd.maven.connector.s3Repository.base-path Enter the URL of your MinIO or S3 repository bucket.

    For example: s3://talend-app-shared.

    tsd.maven.connector.s3Repository.username Enter the base path of your MinIO or S3 repository. This property is optional and can be left empty.

    For example: semantic-types-repository.

    tsd.maven.connector.s3Repository.password Enter the username of your MinIO or S3 repository.

    For example: USERNAME123.

    tsd.maven.connector.s3Repository.s3.region Enter the password of your MinIO or S3 repository.

    For example: PASSWORD123.

    tsd.maven.connector.s3Repository.s3.endpoint Enter the region of your MinIO or S3 repository.

    For example: us-east-1.

    tsd.maven.connector.s3Repository.bucket-url Enter the URL of your MinIO or S3 repository server.

    For example: https://minio-company.com.

    tsd.resttemplate.connector.pat Enter the Personal Access Token previously generated from the Profile preferences section of Talend Cloud portal. It will be used to communicate between Talend Dictionary Service in your on-premises installation and Talend Cloud. For more information, see Generating a Personal Access Token.
    Note: This property exists only in version 8.0 R2022-07 or later.
    tsd.resttemplate.connector.producer-url Enter the URL to access Talend Dictionary Service.
    Note: This property exists only in version 8.0 R2022-07 or later.
    tsd.resttemplate.connector.dqRulesUrl Enter the URL to access Talend Cloud Data Quality Rules.
    Note: This property exists only in version 8.0 R2022-07 or later.
    hybrid-link.scheduleInMs Enter the delay between each synchronization call with Talend Cloud (by default 5000 ms).
    Note: This property exists only in version 8.0 R2022-07 or later.

    All the passwords entered in the properties file are encrypted when you start your Talend Dictionary Service instance.

  2. Update the following fields with your MongoDB settings:

    Field

    Description

    spring.data.mongodb.host

    Host name of your MongoDB instance.

    spring.data.mongodb.port

    Port number of your MongoDB instance.

    spring.data.mongodb.username

    Username used to connect to the database.

    spring.data.mongodb.password

    Password used to connect to the database.

    spring.data.mongodb.database

    Name of the database on which Talend Dictionary Service is connected, dqdict by default.

    spring.data.mongodb.uri URI of the MongoDB instance to connect to

    If you connect to the MongoDB instance via a URI, the following parameters must be commented out: dq.mongo.host, dq.mongo.port, dq.mongo.username, dq.mongo.password, dq.mongo.database.name

    Note: This configuration parameter is available only if you have installed the TPS-4354 patch delivered by Talend. For more information, check with your administrator.
  3. Launch MongoDB.
  4. Start Talend Dictionary Service by launching, in this order:
    • Apache ZooKeeper
    • Apache Kafka
    • Apache Tomcat (Talend Administration Center server and Talend Identity and Access Management server)
    • MongoDB
    • MinIO