Skip to main content Skip to complementary content

Execution issues on the Remote Engine Gen2

You are having issues executing pipelines on the Remote Engine Gen2 and would like to display the execution logs that are stored in Livy.

Troubleshooting

Procedure

  1. Run the following command to monitor the execution and display the corresponding Livy logs: 
    docker-compose logs -f --tail 50 livy

    This command displays the last 50 lines of Livy logs.

  2. Optional: If you want to display and print all the logs of your Remote Engine Gen2, run the following command: 
    docker-compose logs --tail 100000 > my-engine-all-logs.txt

    This command would transfer the last 10000 log rows in a .txt file.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!

Leave your feedback here