Cannot see the logs of my pipeline tasks in Talend Cloud Management Console - Cloud

Talend Remote Engine Gen2 Quick Start Guide
Version
Cloud
Language
English
Product
Talend Cloud
Module
Talend Management Console
Talend Pipeline Designer
Content
Deployment > Deploying > Executing Pipelines
Installation and Upgrade

When scheduling a pipeline task on the Remote Engine Gen2 in Talend Cloud Management Console, you might not see the corresponding logs.

Cause

The logs might not have been enabled.

Troubleshooting

Procedure

  1. Run the following command to stop the Remote Engine Gen2:
    remote-engine.bat stop if you are on a Windows system
    ./remote-engine.sh stop if you are on a Unix system
  2. Open the following file to edit it:

    <engine_directory>/default/.env if you are using the engine in the AWS USA, AWS Europe, AWS Asia-Pacific or Azure regions.

    <engine_directory>/eap/.env if you are using the engine as part of the Early Adopter Program.

  3. Set the LIVY_JOB_LOG_PERSISTENCE_ENABLE parameter to true.
  4. Save your changes and restart the Remote Engine Gen2.