Configuring your Azure Data Lake Storage - 7.1

Databricks

author
Talend Documentation Team
EnrichVersion
Cloud
7.1
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Real-Time Big Data Platform
task
Design and Development > Designing Jobs > Hadoop distributions > Databricks
Design and Development > Designing Jobs > Serverless > Databricks
EnrichPlatform
Talend Studio

Before you begin

An Azure subscription is required.

Procedure

  1. Create your Azure Data Lake Storage account. For more details about how to do this, see Azure documentation: Create an Azure Data Lake Storage account.
  2. Create an Azure Active Directory application on your Azure portal. For more details about how to do this, see the "Create an Azure Active Directory application" section in Azure documentation: Use portal to create an Azure Active Directory application.
  3. Obtain the application ID and the authentication key from the portal.
    1. On the list of the registered applications, click the application you created and registered in the previous step to display its information blade.
    2. In the Essentials area, copy its application ID.
    3. Click All settings to display the Settings blade and click Required permissions on that blade.
    4. On the Required permissions blade, click Windows Azure Active Directory to display the Enable Access blade.
    5. Select the permissions to be granted to your application and click Save to close the Enable Access blade. You may need the consent of the administrator of your Azure portal to eventually validate the grant.
    6. Still on the Required permissions blade of your application, click Add and on the Add API access blade, click Select an API.
    7. Click Azure Data Lake and then click Select to validate your selection and automatically open the Enable Access blade of this API.
    8. Select the permission to be granted and click Select to close the Enable Access blade.
    9. On the Add API access blade, click Done to return to the Setting blade of your application.
    10. Click Keys to open the Keys blade.
    11. In the Password area, enter the description of you key, define its duration of validity and then click Save to display the value of your key.
    12. Copy the key value and keep it somewhere you think safe because you are not able to retrieve the key anymore once you leave this blade.
  4. Back to the list of the Azure Data Lake Storage services, select the Data Lake Storage you created at the beginning of the procedure and then click Data Explorer.
  5. On the blade that is opened, click Access to open the Access blade.
  6. Click Add and on the Select User or Group blade, search for your application, select it and click the Select button to open the Select Permission blade.
  7. Select the permission to be assigned to your application and click OK.
    In this example, select all the permissions.
  8. Obtain the Azure OAUTH 2.0 token endpoint by proceeding as follows:
    1. Click Azure Active Directory and on the blade that is displayed, click App registrations.
    2. On the App registrations blade, click Endpoints and on the Endpoints blade, copy the value of the OAUTH 2.0 TOKEN ENDPOINT field.