Connecting to an ADLS Databricks Gen2 file - Cloud

Talend Cloud API Services Platform Studio User Guide

Version
Cloud
Language
English (United States)
EnrichDitaval
API Services Platform
Product
Talend Cloud
Module
Talend Studio
Content
Design and Development

You need to create an external table and set up a parameter to profile an ADLS Databricks Gen2 file.

Before you begin

You have created an external table. For more information, see Microsoft Azure documentation.

To create an external table, you can also use the tAzureFSConfiguration and tJava components.

About this task

This procedure is specific to ADLS Databricks Gen2.

Procedure

  1. On the Configuration tab of your Databricks cluster page, expand the Advanced options.
  2. In the Spark tab, add the following Spark properties: spark.hadoop.fs.azure.account.key.<storage_account>.dfs.core.windows.net <key>

    This key is associated with the storage account to be used. You can find it in the Access keys blade of this storage account. Two keys are available for each account and by default, either of them can be used for this access.

    Ensure that the account to be used has the appropriate read/write rights and permissions.