Execution issues on the Remote Engine Gen2 - Cloud

Talend Remote Engine Gen2 Quick Start Guide

Version
Cloud
Language
English
Product
Talend Cloud
Module
Talend Management Console
Talend Pipeline Designer
Content
Deployment > Deploying > Executing Pipelines
Installation and Upgrade
Last publication date
2024-01-24

You are having issues executing pipelines on the Remote Engine Gen2 and would like to display the execution logs that are stored in Livy.

Troubleshooting

Procedure

  1. Run the following command to monitor the execution and display the corresponding Livy logs:
    docker-compose logs -f --tail 50 livy

    This command displays the last 50 lines of Livy logs.

  2. Optional: If you want to display and print all the logs of your Remote Engine Gen2, run the following command:
    docker-compose logs --tail 100000 > my-engine-all-logs.txt

    This command would transfer the last 10000 log rows in a .txt file.