Installing the Talend logging modules - 7.3

Talend Data Management Platform Installation Guide for Linux
EnrichVersion
7.3
EnrichProdName
Talend Data Management Platform
EnrichPlatform
Talend Activity Monitoring Console
Talend Administration Center
Talend Artifact Repository
Talend CommandLine
Talend Data Preparation
Talend Data Stewardship
Talend DQ Portal
Talend Identity and Access Management
Talend Installer
Talend JobServer
Talend Log Server
Talend Repository Manager
Talend Runtime
Talend SAP RFC Server
Talend Studio
task
Installation and Upgrade
You need to manually install Talend Log Server which includes Kibana and Filebeat to collect logs.

Before you begin

The Elasticsearch container requires that the vm.max_map_count parameter to be set to at least 262144. Check this value on your machine and increase it if needed.
To check this value, run the following command:
sysctl vm.max_map_count
If you need to increase the value, run the following command:
sysctl -w vm.max_map_count=262144
To permanently write the value to the sysctl.conf file, run the following command:
vm.max_map_count = 262144

Procedure

  1. Copy and extract the Talend-LogServer-VA.B.C.zip archive file in the directory of your choice.
    Note: The directory name must not contain spaces or non-ASCII characters.
  2. To start Talend Log Server launch the start_logserver.sh executable file.
    You cannot run Elasticsearch as the root user. Elasticsearch is part of the Talend Log Server, therefore you cannot run the executable file as root user.
  3. Configure the values for LOG_PATH and APP_NAME for Filebeat:
    • Open the filebeat.yml file located in the Filebeat directory and set the LOG_PATH and APP_NAME values as follows:
        paths:
    - ${LOG_PATH:/home/Talend/7.2.1/tac/apache-tomcat/logs/*}
  fields:
    app_id: ${APP_NAME:TAC}
    • Or, set the LOG_PATH and APP_NAME environment variables:
      export  LOG_PATH="/home/Talend/7.2.1/tac/apache-tomcat/logs/*"
export  APP_NAME="TAC"
  4. Start Filebeat: 
    filebeat -e -c filebeat.yml

Results

You can now access Talend Log Server with the following URL: http://localhost:5601/app/kibana#/dashboard/Default-Dashboard.

Troubleshooting: When you start the Talend Log Server, if you do not see logstash-*, talendesb-*, and talendaudit-* indices, complete the following steps:
  1. Delete the .kibana index.
    curl -XDELETE 'http://localhost:9200/.kibana'
  2. Stop the Talend Log Server.
  3. Start the Talend Log Server.