- Go to .
In the Add a new dataset
panel, give a name to your dataset and select the connection in which you want
to create your dataset.
If you want to add a dataset from a connection that does not exist yet, you can create this connection directly from the connection drop-down list.
Add a description if needed, and fill in the required properties of the
For S3 and HDFS file storage connections, an AUTO DETECT button allows you to automatically detect and fill in the format of your data (CSV, Excel, Avro or Parquet).
The database query and table types are not compatible as you cannot use a query type database as a Destination dataset. Therefore if you try to change the database configuration to another type after saving it, a check will be triggered on your pipeline to see whether this operation is possible.
(Optional) Click VIEW
SAMPLE to see a preview of the first 50 records of your dataset
- click VALIDATE to save your dataset.
- Grid: from this view you can display the first 10 000 records of your data in tabular form
- Hierarchy: from this view you can display the first 10 000 records of your data in a tree-like structure
- Raw: from this view you can display an untouched and unfiltered version of the first 10 000 records of your data