Snowflake connection
|
Property |
Configuration |
|
|---|---|---|
| Selection | Select or enter Snowflake. | |
| Configuration | ||
| Engine | Select your engine in the list. | |
| Main | If Define JDBC URL is disabled | If this option is disabled, enter each parameter that identifies the
database to be used in the corresponding fields. Click Load default values in order to help you pre-fill the fields with the default values associated with this type of database. Note: Use the host name of the target system
instead of 'localhost' in the URL as the Remote Engine Gen2 needs to be able to communicate
with the target system.
|
| If Define JDBC URL is enabled | If this option is enabled, enter the JDBC URL that identifies the
Snowflake database. The expected format is the following: jdbc:snowflake://<account_name>.snowflakecomputing.com/?<connection_params> Example:
Note: Use the host name of the target system
instead of 'localhost' in the URL as the Remote Engine Gen2 needs to be able to communicate
with the target system.
|
|
| Authentication type | Select the authentication method to connect to the Snowflake database:
For more information on secure authentication to Snowflake, read the Snowflake documentation. |
|
| Advanced | Force protocol | If Define JDBC URL is disabled, you can enable this option to define the JDBC driver protocol. |
| Connection timeout | Sets the maximum number of seconds that a user will wait for a connection to be available. If this time is exceeded and the connection is still unavailable, an exception is thrown. | |
| Connection validation timeout | Sets the maximum waiting time in seconds for a connection to be considered as alive. | |
| Description | Enter a display name (mandatory) and a description (optional) for the connection. | |
Snowflake dataset
| Property | Configuration | |
|---|---|---|
| Dataset name | Enter a display name for the dataset. This name will be used as a unique identifier of the dataset in all Talend Cloud apps. | |
| Connection | Select your connection in the list. If you are creating a dataset based on an existing connection, this field is read-only. | |
| Type | Select the type of dataset you want to create:
|
|
| Main | Query | Enter the SQL query to access the data of your choice located in your Snowflake table. |
| Table name | Select or enter the unique name of your Snowflake table. | |
| Advanced | Fetch size | Specifies the amount of data sent during one single communication step with the database. In the Fetch size field displayed, you need to enter the size in KB. |
Additional JDBC parameters might be displayed depending on whether the connector is used as a source or destination dataset, read this section to know more about these parameters.
Snowflake destination dataset: limitation and workaround
If the Snowflake destination dataset contains records with the Time type, the pipeline will fail as Talend Cloud Pipeline Designer only supports the Datetime type.
To prevent this from happening, you can add a Type converter processor before your destination in your pipeline, and convert the fields from Time type to String type using the "HH:mm:ss" pattern.