This scenario aims at helping you set up and use connectors in a pipeline. You are
advised to adapt it to your environment and use case.
Procedure
-
Click .
-
In the panel that opens, select the type of connection you
want to create.
Example
workday
-
Select your engine
in the Engine list.
Note:
- It is recommended to use the Remote Engine Gen2 rather than
the Cloud Engine for Design for advanced
processing of data.
- If no Remote Engine Gen2 has been created from Talend Management Console or if it exists but appears as unavailable
which means it is not up and running, you will not be able to select
a Connection type in the list nor to
save the new connection.
- The list of available connection types depends on the engine you
have selected.
-
Select the type of connection you want to create.
Here, select Workday.
-
Fill in the connection properties to access your Workday
account as described in Workday properties, check the connection
and click ADD DATASET.
-
In the Add a new dataset
panel, name your dataset. In this example, a query is used to retrieve
information about currency from financial accounts.
Example
account
currency
-
Fill in the required properties to query the table located in
your Workday account and click VIEW
SAMPLE to see a preview of your dataset sample.
-
Click Validate to save your dataset.
-
Do the same to add the Oracle database and table that will be
used as destination in your pipeline. Fill in the connection properties as
described in Oracle properties.
In this example, an Oracle table named euro_accounts is used.
-
Click Add
pipeline on the Pipelines page. Your new pipeline opens.
-
Give the pipeline a meaningful name.
Example
From Workday to Oracle - isolate accounts
in €
-
Click ADD SOURCE and
select your source dataset, account
currency in the panel that opens. You can preview a sample of
your data that contains information about currency.
-
Click
and
add a Filter processor to the pipeline in
order to filter the bank accounts and keep only the ones that use euros as their
main currency. The configuration panel opens.
-
Give a meaningful name to the processor.
Example
filter on accounts with
€
-
In the Filter area:
-
Select .accountCurrency.descriptor in the Input list, as it is the field that
contains the currency information.
-
Select NONE in
the Optionally select a function to
apply list, as you do not want to apply a function while
filtering records.
-
Select == in
the Operator list and type in
EUR in the Value field as you want to filter on
bank accounts that use euros.
-
Click the ADD
DESTINATION item on the pipeline to open the panel allowing to
select the Oracle table in which your output data will be inserted.
-
Give a meaningful name to the destination; € account table for example.
-
In the Configuration
tab of the destination, click Main and
select INSERT in the Action list to insert the data into the table
when executing the pipeline.
-
Click Save to
save your configuration.
-
(Optional) Click the last processor to preview the processed
data.
-
On the top toolbar of Talend Cloud Pipeline Designer,
click the Run button to open the panel allowing you to select
your run profile.
-
Select your run profile in the list (for more information, see Run profiles), then click Run to
run your pipeline.
Results
Your pipeline is being executed, the account data that was stored on Workday
has been processed and the output flow is inserted into the Oracle target table you
have defined.
