Configuring the storage of Job archives and logs - 8.0

Talend Administration Center User Guide

Version
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Administration Center
Content
Administration and Monitoring
Last publication date
2024-04-15

When deploying and executing tasks in Talend Administration Center, configure Job Conductor to manage the generated files, such as defining the retention or storage period, the storage directory, or the maximum number of logs.

These files are created and stored locally. They include the Job archives, execution, recovery, and deployment logs.

About this task

From Talend Administration Center, you can modify the path to those log files. To do so, proceed as follows:

Procedure

  1. On the Menu tree view, click Configuration.
  2. Click the Job Conductor group to display its parameters.
    The parameters are the following:

    Parameter

    Value

    Generated jobs folder

    Type in the path to the folder that has been created to store the Job execution archives, grouped by execution tasks. This folder can not be removed. Otherwise, the tasks can not be executed.

    Task logs folder

    Type in the path to the folder that has been created to store the Job execution logs, grouped by execution tasks. The logs in this folder are used to be downloaded as execution log on UI and/or for manual check of the Job execution. It is recommended not to remove this folder either.

    Number of execution logs

    This parameter is optional, as you can enter a value in the Storage period for log files field instead.

    Enter how many execution log files you want to store in each folder created for the Jobs. Note that this limitation applies only to execution log files. The folders also contain resuming log files as well, therefore the file count in the folders is twice the value of the limit set in the Number of execution logs parameter. If this value is set to 0, there will be no limit on the number of execution logs.

    Note: When this value is set, the value of the Storage period for log files field is ignored.

    Storage period for log files (days)

    This parameter is optional, as you can enter a value in the Number of execution logs parameter field instead.

    Enter how long the log files of all Jobs will be kept, in days, before they are deleted. If this value is set to 0, there will be no limit on the storage period for log files.

    Maximum number of generated Jobs

    This parameter is optional, as you can enter a value in the Storage period for generated Jobs parameter field instead.

    Enter how many generated Job archives you want to store in the dedicated folder. If this value is set to 0, there will be no limit on the number of generated Jobs.

    This parameter is optional, as you can enter a value in the Storage period for generated Jobs parameter field instead.

    Storage period for generated Jobs (days)

    This parameter is optional, as you can enter a value in the Maximum number of generated Jobs parameter field instead.

    Enter how long the generated Job archives will be kept, in days, before they are deleted. If this value is set to 0, there will be no limit on the storage period for generated Jobs.

    Quartz servlet

    Shows the status of the Job Conductor. It can be Initialized or Not initialized.