Connecting to an ADLS Databricks Gen2 file

You need to create an external table and set up a parameter to profile an ADLS Databricks Gen2 file.

Before you begin

You have created an external table. For more information, see Microsoft Azure documentation.

To create an external table, you can also use the tAzureFSConfiguration and tJava components.

This procedure is specific to ADLS Databricks Gen2.

On the Configuration tab of your Databricks cluster page, expand the Advanced options.
In the Spark tab, add the following Spark properties: spark.hadoop.fs.azure.account.key.<storage_account>.dfs.core.windows.net <key>

This key is associated with the storage account to be used. You can find it in the Access keys blade of this storage account. Two keys are available for each account and by default, either of them can be used for this access.

Ensure that the account to be used has the appropriate read/write rights and permissions.

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!