Available in...Big Data Platform
Cloud API Services Platform
Cloud Big Data Platform
Cloud Data Fabric
Cloud Data Management Platform
Data Fabric
Data Management Platform
Data Services Platform
MDM Platform
Real-Time Big Data Platform
You need to create an external table and set up a parameter to profile an ADLS
Databricks Gen2 file.
About this task
This procedure is specific to ADLS Databricks
Gen2.
Procedure
-
On the Configuration tab of your Databricks cluster
page, expand the Advanced options.
-
In the Spark tab, add the following Spark properties:
spark.hadoop.fs.azure.account.key.<storage_account>.dfs.core.windows.net
<key>
This key is associated with the storage account to be used. You can find it
in the Access keys blade of this storage account. Two
keys are available for each account and by default, either of them can be
used for this access.
Ensure that the account to be used has the appropriate read/write rights and
permissions.