Once your connector or processor is developed and the new Docker image is created, you
can try it in the Talend Cloud Pipeline Designer app.
Before you begin
Make sure the engine containing your new Docker image has been restarted and is
available.
Procedure
-
To test your custom source or destination connector:
-
In Talend Cloud Pipeline Designer, go to the
CONNECTIONS page.
-
Click ADD CONNECTION and fill in the connection
properties parameters to access your data. Make sure the updated
Remote Engine Gen2 is selected.
Example
After developing a new source connector based on the OpenWeather API
and restarting the engine, it is displayed in the
Connection type list:
-
Validate your connection and add a dataset.
Example
Once the OpenWeather connection is set up, the dataset properties
can be configured. Here, the weather data about Paris, France is retrieved.
-
Validate your dataset.
The new dataset can now be used as a source connector in a pipeline.
-
To test your custom processor:
-
In Talend Cloud Pipeline Designer, open an existing
pipeline.
-
In the Select a run profile list next to the
button, make sure the run profile
associated to your updated Remote Engine Gen2
is selected.
-
Click
where you want to add your
processor. The new processor should be displayed in the Add a
processor window along with the other processors.
Example
A new processor allowing you to change the case of your data has
been added and is displayed in the list.
-
Select your processor to add it to your pipeline.
The new processor can now be configured and used directly in your
pipeline.