Adding a remote harvesting server in Talend Cloud Data Catalog UI - Cloud

Talend Cloud Data Catalog Administration Guide

Version
Cloud
Language
English (United States)
Product
Talend Cloud
Module
Talend Data Catalog
Content
Administration and Monitoring
Data Governance

Perform the following procedure each time you have installed a new remote harvesting server.

Both the cloud-based application server and the remote harvesting server installed on premises use a shared secret.

In the Over the Web (Cloud) mode, the harvesting is invoked according to a schedule on the remote harvesting server and the result is pushed up to the cloud.

Before you begin

  • You have been assigned a global role with the Application Administration capability.
  • You have installed a remote harvesting server following one of the previous deployment procedures.

Procedure

  1. Go to MANAGE > Servers.
  2. In the Heartbeat Frequency field, select the frequency of the heartbeat to check the status of the servers.

    Talend Cloud Data Catalog sends a notification email when a server goes down once the maximum number of missed heartbeats specified in the server properties is reached.

    By default, this feature is disabled and no notifications will be sent.
  3. Click Add.
  4. In the New Server dialog box, fill in the following fields.
    Field Action
    Name Type in the name of the remote harvesting server.
    Type Select Over the Web (Cloud).

    It applies to a remote harvesting server connected to a Talend Cloud Data Catalog server on the cloud, where a secure firewall is in place.

    The remote harvesting server connects proactively over HTTP on regular basis to a dedicated remote Talend Cloud Data Catalog server to perform any metadata import/export activities.

    URL Replace <name> with the shared secret you have previously defined in:
    • AGENT_STRING parameter if you used the Docker deployment methods
    • M_AGENT_NAME parameter if you used the manual installation methods
    Description Type in a description.
    Max missed heartbeats Set the maximum number of missed heartbeats (regular contact) from the remote harvesting server before it is considered disconnected.

    Talend Cloud Data Catalog sends an email notification when the harvesting server goes down once the maximum number of missed heartbeats is reached. You need to define the duration between each heartbeat check in the Heartbeat Frequency field.

    Compress Data Select the check box to use data compression for the communication between the servers.
    Set as Default Select the check box to define the remote harvesting server as the default when harvesting metadata.
  5. Click CREATE.

Results

When the remote harvesting server is connected, you can see a Connected icon in the Status column.