This scenario aims at helping you set up and use connectors in a pipeline. You are
advised to adapt it to your environment and use case.
Procedure
-
Click .
-
In the panel that opens, select the type of connection you
want to create.
Example
MS Dynamics
CRM
-
Select your engine
in the Engine list.
Note:
- It is recommended to use the Remote Engine Gen2 rather than
the Cloud Engine for Design for advanced
processing of data.
- If no Remote Engine Gen2 has been created from Talend Management Console or if it exists but appears as unavailable
which means it is not up and running, you will not be able to select
a Connection type in the list nor to
save the new connection.
- The list of available connection types depends on the engine you
have selected.
-
Select the type of connection you want to create.
Here, select Azure Dynamics
365.
-
Fill in the connection properties to access your Microsoft CRM
account as described in Dynamics 365 properties, check the connection
and click ADD DATASET.
-
In the Add a new dataset
panel, name your dataset. In this example, the entity named
contacts is used.
Example
CRM
dataset
-
Fill in the required properties to retrieve the data of the entity set located in
your Microsoft CRM account and click View sample to see a
preview of your dataset sample.
-
Click Validate to save your dataset.
-
Do the same to add the Test connection and dataset that will
be used as source in your pipeline to populate the CRM.
In this example, a dataset with the following CSV schema is
used:
CSV Schema:
firstname;lastname;assistantname;business;callback;childrensnames;company;birthdate
Values:
n/a;n/a;E_VE;Energy;n/a;null;Axiom;30-07-2008
Miranda;Priestly;Emmy_Charlton;Fashion;null;n/a;Runway;26-05-1985
Miranda;Priestly;Andy_Sachs;Fashion;null;n/a;Runway;27-09-1995
Jay;Twistle;Chris_Gardner;Finance;null;n/a;Dean Witter Reynolds;25-12-1978
Don;Draper;Peggy_Olsen;Advertising;null;n/a;Sterling Cooper;19-07-1994
Bradford;Meade;Betty_Suarez;Fashion;null;n/a;Mode;28-09-1998
Franklin;Hart;Doralee_Rhodes;n/a;null;n/a;Consolidated Companies;12-12-1980
-
Click Add
pipeline on the Pipelines page. Your new pipeline opens.
-
Give the pipeline a meaningful name.
Example
Processing & inserting data into
Microsoft Dynamics CRM
-
Click ADD SOURCE and
select your source dataset, DRM data
input in the panel that opens.
-
Click
to
add processors to the pipeline, for example a Split processor to split the assistant full name records in two
parts.
-
Click to
add a Field selector processor to select
and rename the specific fields you want to insert in the CRM.
Here, only the firstname,
lastname,
company, birthdate, childrensnames and
assistant name records are kept (assistantname_split_2 being renamed to assistantname to match the CRM record
syntax):
-
Before sending the data to your CRM, add a Type converter processor to convert the
birthdate record to a Date type.
Here, the birthdate record that had a String type is
converted to a Date type using the format
dd-MM-yyyy:
-
Click the ADD
DESTINATION item on the pipeline to open the panel allowing to
select the CRM dataset in which your output data will be inserted.
-
In the Configuration
tab of the destination, click Main and
select Insert in the Action list to insert the data into the
existing dataset when executing the pipeline.
-
Click Save to
save your configuration.
-
On the top toolbar of Talend Cloud Pipeline Designer,
click the Run button to open the panel allowing you to select
your run profile.
-
Select your run profile in the list (for more information, see Run profiles), then click Run to
run your pipeline.
Results
Your pipeline is being executed, the data has been processed and cleaned and
the output flow is inserted into the Microsoft CRM dataset you have defined.
You can log in your Microsoft Dynamics account to see the contacts that you have inserted.
