Incompatible runtime found : Cluster runtime version =/= Engine runtime version
This error is due to the fact that Talend Cloud Pipeline Designer requires a Databricks cluster with compatible libraries in order to submit pipelines from a Remote Engine Gen2.
- In order to resolve this issue, log in to your Databricks account and go to the Clusters page.
Select your existing cluster and go to the
Libraries tab to uninstall the old
By removing these old dependencies the compatibility issue should be solved and you should be able to execute pipelines on your new engine with the same Databricks cluster.