The first step in creating a Live dataset is to design a Job in a remote project that uses the tDatasetOutput component as output.
Creating a Live dataset from a
.zip archive is also possible with a
In order for dataset to be able to communicate with Talend Administration Center, it is recommended to open a project with a remote connection.
The simplest Job design required to create a working Live dataset is the following:
Before you begin
To create a working Live dataset when running Talend Data Preparation with an
https connection, complete the following configuration.
- Retrieve Talend Data Preparation certificate, or its Certificate Authority and add it to an existing or new
.jks file following this example:
keytool -import -trustcacerts -alias <cert-alias> -file <dp_certificate.crt> -keystore <truststore.jks>
- Connect a tSetKeystore component to tRowGenerator with an OnSubjobOk link in order for the Job to trust the Talend Data Preparation certificate. For more information on how to configure the tSetKeystore, see the tSetKeystore documentation.
- In the design workspace, add an input component,
tRowGenerator in this example, and click the
Component tab to define its basic settings.
- Click the [...] next to RowGenerator Editor to configure a schema for your data and choose the number of rows to be generated.
- Add the tDatasetOutput component in the design
workspace, and in the Context tab, add
dataprep_limitas new context variables. In the Type column, select
These two variables are mandatory to make the Live dataset work.
You do not have to enter a default value for the two context variables. Talend Data Preparation will dynamically add the correct values during the Job execution.
- Click the Component tab of the
tDatasetOutput component to define its basic
- Click Sync Column to retrieve the schema from the previous component.
- In the Url field, use the context variable created
- Select LiveDataset in the Mode list.
- In the Limit field, enter the number of rows you want to process. This field is optional, you can leave it empty.
- Link the two components together using a Row > Main link.
- Save your Job.
- If you are working on a local project, right-click the name of your Job in the
Repository tree view and click Build
Job to export your Job as an archive that you will be able to upload
in Talend Administration Center.