Adding a remote harvesting server in Talend Cloud Data Catalog UI - Cloud

Talend Cloud Data Catalog Administration Guide
Version
Cloud
Language
English
Product
Talend Cloud
Module
Talend Data Catalog
Content
Administration and Monitoring
Data Governance
Last publication date
2024-01-17
AWS

Perform the following procedure each time you have installed a new remote harvesting server.

Both the cloud-based application server and the remote harvesting server installed on premises use a shared secret.

In the Over the Web (Cloud) mode, the harvesting is invoked according to a schedule on the remote harvesting server and the result is pushed up to the cloud.

Before you begin

  • You have been assigned a global role with the Application Administration capability.
  • You have installed a remote harvesting server following one of the previous deployment procedures.

Procedure

  1. Go to MANAGE > Servers.
  2. In the Heartbeat Frequency field, select the frequency of the heartbeat to check the status of the servers.

    Talend Cloud Data Catalog sends a notification email when a server goes down once the maximum number of missed heartbeats specified in the server properties is reached.

    By default, this feature is disabled and no notifications will be sent.
  3. Click Add.
  4. In the New Server dialog box, fill in the following fields.
    Field Action
    Name Type in the name of the remote harvesting server.
    Type Select Over the Web (Cloud).

    It applies to a remote harvesting server connected to a Talend Cloud Data Catalog server on the cloud, where a secure firewall is in place.

    The remote harvesting server connects proactively over HTTP on regular basis to a dedicated remote Talend Cloud Data Catalog server to perform any metadata import/export activities.
    Shared secret

    Enter the shared secret which is a string and must match the M_AGENT_SHARED_SECRET assigned to the remote harvesting server as defined in the agent.properties configuration file.

    The shared secret is used to ensure proper authentication of the remote server by the application server for Over the Web (Cloud) remote harvesting servers.

    The M_AGENT_SHARED_SECRET also acts as an identifier. It must be made unique for a given application server.
    Definition Type in a description.
    Max missed heartbeats Set the maximum number of missed heartbeats (regular contact) from the remote harvesting server before it is considered disconnected.

    Talend Cloud Data Catalog sends an email notification when the harvesting server goes down once the maximum number of missed heartbeats is reached. You need to define the duration between each heartbeat check in the Heartbeat Frequency field.
    Compress Data Select the check box to use data compression for the communication between the servers.
    Set as Default Select the check box to define the remote harvesting server as the default when harvesting metadata.
  5. Click CREATE.

Results

When the remote harvesting server is connected, you can see a Connected icon in the Status column.