Once your connector or processor is developed and the new Docker image is created, you can try it in the Talend Cloud Pipeline Designer app.
Make sure the engine containing your new Docker image has been restarted and is available.
Before you begin
To test your custom source or destination connector:
- In Talend Cloud Pipeline Designer, go to the CONNECTIONS page.
Click ADD CONNECTION and fill in the connection
properties parameters to access your data. Make sure the updated
Remote Engine Gen2 is selected.
ExampleAfter developing a new source connector based on the OpenWeather API and restarting the engine, it is displayed in the Connection type list:
Validate your connection and add a dataset.
ExampleOnce the OpenWeather connection is set up, the dataset properties can be configured. Here, the weather data about Paris, France is retrieved.
Validate your dataset.
The new dataset can now be used as a source connector in a pipeline.
To test your custom processor:
- In Talend Cloud Pipeline Designer, open an existing pipeline.
- In the Select a run profile list next to the button, make sure the run profile associated to your updated Remote Engine Gen2 is selected.
Click where you want to add your
processor. The new processor should be displayed in the Add a
processor window along with the other processors.
ExampleA new processor allowing you to change the case of your data has been added and is displayed in the list.
Select your processor to add it to your pipeline.
The new processor can now be configured and used directly in your pipeline.