Configuring persistent logging in the Remote Engine Gen2 installed locally or on your private VPC - Cloud

Talend Remote Engine Gen2 Quick Start Guide
Version
Cloud
Language
English
Product
Talend Cloud
Module
Talend Management Console
Talend Pipeline Designer
Content
Deployment > Deploying > Executing Pipelines
Installation and Upgrade

About this task

By default, the logs of all your executions are persisted in Apache Livy but you have the possibility to disable or re-enable them manually in order to avoid the overhead of logging.

This configuration only applies for users who installed Remote Engine Gen2 on premises or on their private VPC (AWS or Azure).

Procedure

  1. Go to the Remote Engine Gen2 installation directory.
  2. Open the following file to edit it:

    <engine_directory>/default/.env if you are using the engine in the AWS USA, AWS Europe, AWS Asia-Pacific or Azure regions.

    <engine_directory>/eap/.env if you are using the engine as part of the Early Adopter Program.

  3. Edit the following line to disable or enable logs:
    • To disable logs: 
      LIVY_JOB_LOG_PERSISTENCE_ENABLE=false
    • To enable logs: 
      LIVY_JOB_LOG_PERSISTENCE_ENABLE=true
  4. Save the file.
  5. Restart your Remote Engine Gen2 to take your changes into account.