Which engine is used and is it healthy? - Cloud

Talend Remote Engine Gen2 Quick Start Guide

Version
Cloud
Language
English (United States)
Product
Talend Cloud
Module
Talend Management Console
Talend Pipeline Designer
Content
Deployment > Deploying > Executing Pipelines
Installation and Upgrade

Engines used to calculate data samples

  • How do I know which engine is used?

    The calculation of the sample is happening on the Talend Cloud Data Inventory side, and the engine that is used is the one you have selected when creating the connection of the source or destination dataset.

  • How do I know if the engine is healthy?

    You can check the status of the engine in Talend Cloud Management Console (or in your Docker logs if you can access them).

Engines used to display data preview

  • How do I know which engine is used?
    By default, the engine used is the one you have selected when creating the connection of the source dataset, which may be different from the one associated with the run profile. This engine is responsible for calculating the preview, displaying the list of available processors, editing their configuration, etc. If you want to change the engine used for the calculation of the preview, you have to replace the source with another dataset that uses a different engine, or to change the connection in the existing source to use another engine.
    Note: If you are using a Join processor in Talend Cloud Pipeline Designer and you join one source named dataset1 (from the main flow) with another source named dataset2 (by lookup, and it might use another engine), the engine that will be used to calculate the preview is the engine associated with dataset1).
  • How do I know if the engine is healthy?

    You can check the status of the engine in Talend Cloud Management Console (or in your Docker logs if you can access them). In Talend Cloud Pipeline Designer, you can also enable or disable semantic types in the preview panel.

Engines used to execute pipelines

  • How do I know which engine is used?
    The engine on which the pipeline will be executed when running the pipeline is always the engine associated with the selected run profile at run time. If your execution fails, make sure the engine associated with the source dataset contains all the connectors and processors used in the pipeline.
    Note: When publishing a pipeline to Talend Cloud Management Console, the engine used is the one you have selected when creating the connection of the source dataset.
  • How do I know if the engine is healthy?

    You can check the status of the engine as well as other information, such as the number of running and queued pipelines on the engine, next to the run profile name in Talend Cloud Pipeline Designer.

Engines associated with connections and datasets

  • How do I know which engine is used?

    Source datasets: the engine used is the one you have selected when creating the connection of the source dataset.

    Destination datasets: the engine used is the one you have selected when creating the connection of the destination dataset.

  • How do I know if the engine is healthy?

    You can check the status of the engine in Talend Cloud Management Console