Adding a remote harvesting server connected to a cloud-based Talend Data Catalog server - 8.0

Talend Data Catalog Installation and Upgrade Guide for Windows

Version
8.0
Language
English (United States)
EnrichDitaval
windows
Product
Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Data Catalog
Content
Installation and Upgrade

Perform the following procedure each time you have installed a new remote harvesting server connected to a cloud-based Talend Data Catalog server.

Both the cloud-based application server and the remote harvesting server installed on premises use a shared secret.

In the Over the Web (Cloud) mode, the harvesting is invoked according to a schedule on the remote harvesting server and the result is pushed up to the cloud.

Before you begin

  • You have been assigned a global role with the Application Administration capability.
  • You have installed a remote harvesting server following one of the previous deployment procedures.
  • You have installed and configured a remote harvesting server with the same version as the Talend Data Catalog application server.
  • You have applied the same patches on the Talend Data Catalog application server and the remote harvesting server.

Procedure

  1. Go to MANAGE > Servers.
  2. In the Heartbeat Frequency field, select the frequency of the heartbeat to check the status of the servers.

    Talend Data Catalog sends a notification email when a server goes down once the maximum number of missed heartbeats specified in the server properties is reached.

    By default, this feature is disabled and no notifications will be sent.
  3. Click Add.
  4. In the New Server dialog box, fill in the following fields.
    Field Action
    Name Type in the name of the remote harvesting server.
    Type Select Over the Web (Cloud).

    It applies to a remote harvesting server connected to a Talend Data Catalog server on the cloud, where a secure firewall is in place.

    The remote harvesting server connects proactively over HTTP on regular basis to a dedicated remote Talend Data Catalog server to perform any metadata import/export activities.

    URL Replace <name> with the shared secret you have previously defined in:
    • AGENT_STRING parameter if you used the Docker deployment methods
    • M_AGENT_NAME parameter if you used the manual installation methods
    Description Type in a description.
    Max missed heartbeats Set the maximum number of missed heartbeats (regular contact) from the remote harvesting server before it is considered disconnected.

    Talend Data Catalog sends an email notification when the harvesting server goes down once the maximum number of missed heartbeats is reached. You need to define the duration between each heartbeat check in the Heartbeat Frequency field.

    Compress Data Select the check box to use data compression for the communication between the servers.
    Set as Default Select the check box to define the remote harvesting server as the default when harvesting metadata.
  5. Click CREATE.

Results

When the remote harvesting server is connected, you can see a Connected icon in the Status column.