Installing the Talend logging modules - 7.1

Talend Data Integration Installation Guide for Linux

EnrichVersion
7.1
EnrichProdName
Talend Data Integration
task
Installation and Upgrade
EnrichPlatform
Talend Activity Monitoring Console
Talend Administration Center
Talend Artifact Repository
Talend CommandLine
Talend Data Preparation
Talend Data Stewardship
Talend Identity and Access Management
Talend Installer
Talend JobServer
Talend Log Server
Talend Runtime
Talend Studio
You need to manually install Talend Log Server which includes Kibana and Filebeat to collect logs.

Before you begin

The Elasticsearch container requires that the vm.max_map_count parameter be set to at least 262144. Check this value on your machine and increase it if needed.
To check this value, run the following command:
sysctl vm.max_map_count
If you need to increase the value, run the following command:
sysctl -w vm.max_map_count=262144
To permanently write the value to the sysctl.conf file, run the following command:
vi /etc/sysctl.conf
vm.max_map_count = 262144

Procedure

  1. Copy and extract the Talend-LogServer-VA.B.C.zip archive file into the directory of your choice.
    Note: The directory name must not contain spaces or non-ASCII characters.
  2. To start Talend Log Server launch the start_logserver.sh executable file.
    You cannot run Elasticsearch as the root user. Elasticseach is part of the Talend Log Server, so you cannot run the executable file as root user.
  3. Configure the LOG_PATH and APP_NAME values for Filebeat in the filebeat.yml, located in the Filebeat directory.
    • Set LOG_PATH and APP_NAME to the following values:
        paths:
          - ${LOG_PATH:/home/Talend/7.1.1/tac/apache-tomcat/logs/*}
        fields:
          app_id: ${APP_NAME:TAC}
    • Or, set the LOG_PATH and APP_NAME environment variables:
      export  LOG_PATH="/home/Talend/7.1.1/tac/apache-tomcat/logs/*"
      export  APP_NAME="TAC"
  4. Start Filebeat:
    filebeat -e -c filebeat.yml

Results

You can now access Talend Log Server with the following URL: http://localhost:5601/app/kibana#/dashboard/Default-Dashboard.

Troubleshooting:

When you start the Talend Log Server, if you do not see logstash-*, talendesb-*, and talendaudit-* indices, complete the following steps:

  1. Delete the .kibana index.
    curl -XDELETE 'http://localhost:9200/.kibana'
  2. Stop the Talend Log Server.
  3. Start the Talend Log Server.