How to retrieve third-party drivers when the Talend Data Catalog server has no Internet connection - 8.0

Version
8.0
Language
English
Product
Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Data Catalog
Content
Installation and Upgrade
Last publication date
2023-04-14

How to retrieve third-party drivers when the Talend Data Catalog server has no Internet connection

Some import bridges need to access Apache Maven and/or other tool sites and use them automatically to download the drivers.

  • If the drivers have been successfully downloaded, messages like Downloading https://repo.maven.apache.org/maven2/ appear in the bridge log.
  • If the drivers have not been downloaded, messages like Error downloading data from URL appear in the bridge log.
When you use a server that does not have an Internet connection, you cannot download the drivers and the import can fail or be incomplete.

In this case, you need to use another server that has an Internet connection to retrieve the drivers and copy them to the first server.

Perform one of the following procedures each time you use an import bridge which requires an Internet connexion.
In the following example:
  • You use a Talend Data Catalog server, called Production, that cannot connect to the Internet for security reasons.
  • You need to import metadata using the Apache Atlas bridge, which requires an Internet connection to download specific drivers.
  • You use another server with an Internet access, called Development, to download the drivers.
  • You copy them manually from the Development server to the Production server.

Downloading the drivers by using a command line

You can download all the drivers or only the drivers needed for a given bridge by using a command line.

Before you begin

  • You have set up the Development server.
  • You have signed in to Talend Data Catalog as an administrator using the Development server.

Procedure

  1. Open the Windows command line or Linux terminal, and go to the <TDC_HOME>/TalendDataCatalog/bin folder.
  2. Execute the following command according to your operating system:
    • To download the necessary drivers for a given bridge:
      • MIMB.sh -d -i <bridge_name> for Linux, in this example MIMB.sh -d -i ApacheAtlas.
      • MIMB.bat -d -i <bridge_name> for Windows, in this example MIMB.bat -d -i ApacheAtlas.
    • To download all the drivers:
      • MIMB.sh -d for Linux.
      • MIMB.bat -d for Windows.
      Note: This command will produce a patch file MIMB-ThirdParty-Patch-HHmm-YYYYMMDD.zip in the <TDC_HOME>/TalendDataCatalog/ directory. You can upload it to all connected agents. For more information, see Upgrading Talend Data Catalog.

    When the drivers have been successfully downloaded, the following message displays Downloaded the necessary drivers in: C:\TDC_HOME\TalendDataCatalog\bin\..\data.

  3. Once finished, close the command prompt window.
  4. Go to <TDC_HOME>/TalendDataCatalog/data/download/MIMB/ and zip the directory.
  5. Copy it from the Development server to the Production server.

Results

You are ready to import metadata with the Apache Atlas bridge using the Production server.

Downloading the drivers by harvesting a model

You can download only the drivers needed for a given bridge by harvesting a model.

Before you begin

  • You have set up the Development server.
  • Sign in to Talend Data Catalog as an administrator using the Development server.

Procedure

  1. Add a new model and select Apache Atlas as the import bridge.
  2. In the Import Setup tab, fill in the required parameter(s).
    You can enter random values as you only need to retrieve the drivers from this server.
  3. Click Test to test the connection.
    Even if the connection test failed, the drivers needed for the Apache Atlas bridge have been downloaded, as you can see in the Testing Error Messages dialog box.
  4. Once finished, close the dialog box.
  5. Go to <TDC_HOME>/TalendDataCatalog/data/download/MIMB/ and zip the directory.
  6. Copy it from the Development server to the Production server.

Results

You are ready to import metadata with the Apache Atlas bridge using the Production server.