Installing Talend Data Stewardship manually

Talend Real-time Big Data Platform Installation Guide for Linux

EnrichVersion
6.4
EnrichProdName
Talend Real-Time Big Data Platform
task
Installation and Upgrade

This procedure contains the steps to manually install Talend Data Stewardship on your machine. For the automatic installation procedure using Talend Installer, see Using Talend Installer graphical installation mode.

Prerequisites:

To manually install and configure Talend Data Stewardship, follow this procedure:

  1. Download Apache Kafka from https://kafka.apache.org/downloads and install it.

    For more information on the supported Apache Kafka version, see Compatible Messaging Systems.

    For more information on how to install it, see Apache Kafka documentation.

  2. Download a MongoDB instance from https://www.mongodb.com/download-center and install it.

    For more information on the supported MongoDB databases, see Compatible Databases.

    For more information on how to install it, see MongoDB documentation.

    If you want to secure connections with MongoDB using SSL, MongoDB Enterprise Server has to be manually installed on your machine. For more information, see https://docs.mongodb.com/v3.4/security/.

  3. Add mongo to the PATH environment variable.

  4. Create the tds database in MongoDB.

  5. Create the following user for the tds database in MongoDB:

    • Username: tds-user

    • Password: duser

    Download Apache Tomcat from http://tomcat.apache.org/download-80.cgi and install it. For more information on how to install it, see Apache Tomcat documentation.

    For production environments, it is recommended to use a separate Tomcat instance for Talend Data Stewardship.

  6. Stop your Tomcat instance if it was automatically started.

  7. Unzip the Talend-IAM-VA.B.C.zip to a TDS_files folder.

  8. Remove the <Tomcat>/webapps/ROOT.war file.

  9. Create a <Tomcat>/app folder and copy the .war files from TDS_files.

  10. Copy the files contained in TDS_files/context to <Tomcat>/conf/Catalina/localhost.

  11. Copy the configuration file contained in TDS_files/config to <Tomcat>/conf.

  12. Open the <Tomcat>/conf/data-stewardship.properties file and edit the following Talend Data Stewardship properties:

    Note

    All the passwords entered in the properties file are encrypted when you start your Talend Data Stewardship instance.

    Table 44. MongoDB parameters

    Property

    Description

    spring.data.mongodb.host

    Host name of your MongoDB instance.

    spring.data.mongodb.port

    Port number of your MongoDB instance.

    spring.data.mongodb.database

    Name of the database on which Talend Data Stewardship is connected, tds by default.

    spring.data.mongodb.user

    Username used to connect to the database.

    spring.data.mongodb.password

    Password used to connect to the database.


    Table 45. Gateway configuration

    Property

    Action

    frontend.url

    Replace ${tinstall.tds.tomcat.port.http} with Apache Tomcat HTTP port.

    backend.url

    Replace ${tinstall.tds.tomcat.port.http} with Apache Tomcat HTTP port.

    schemaservice.url

    Replace ${tinstall.tds.tomcat.port.http} with Apache Tomcat HTTP port.

    semanticservice.url

    Enter the URL to Talend Dictionary Service.

    If your licence does not include Talend Dictionary Service, delete this line.

    historyservice.url

    Replace ${tinstall.tds.tomcat.port.http} with Apache Tomcat HTTP port.


    Table 46. Kafka configuration

    Property

    Action

    kafka.broker

    Enter the host and the port corresponding to your Kafka broker.


    Table 47. Talend Identity and Access Management configuration

    Property

    Action

    oidc.url

    Enter the URL to Talend Identity and Access Management, http://localhost:9080/oidc for example.

    oidc.userauth.url

    Enter the URL to Talend Identity and Access Management User Authentication, http://localhost:9080/oidc for example.

    scim.url

    Enter the URL to Talend Identity and Access Management SCIM, http://localhost:9080/scim for example.

    oidc.gateway.id

    Enter the Talend Identity and Access Management OIDC client identifier.

    oidc.gateway.secret

    Enter the Talend Identity and Access Management OIDC password.

    oidc.tds.id

    Enter the Talend Identity and Access Management OIDC client identifier.

    oidc.tds.secret

    Enter the Talend Identity and Access Management OIDC password.

    oidc.history.id

    Enter the Talend Identity and Access Management OIDC client identifier you have generated for Talend Data Stewardship.

    oidc.history.id

    Enter the Talend Identity and Access Management OIDC password you have generated for Talend Data Stewardship.

    oidc.schema.id

    Enter the Talend Identity and Access Management OIDC client identifier you have generated for Talend Data Stewardship.

    oidc.schema.secret

    Enter the Talend Identity and Access Management OIDC password you have generated for Talend Data Stewardship.


  13. Start Talend Data Stewardship by launching, in order:

    1. Apache Kafka

    2. MongoDB

    3. Apache Tomcat