How file triggers work in Talend Administration Center

EnrichVersion
6.4
EnrichProdName
Talend Big Data
Talend ESB
Talend Big Data Platform
Talend Data Services Platform
Talend Real-Time Big Data Platform
Talend Data Integration
Talend MDM Platform
Talend Data Management Platform
Talend Data Fabric
task
Administration and Monitoring > Managing servers
Deployment > Scheduling > Scheduling Jobs
EnrichPlatform
Talend Administration Center

How file triggers work in Talend Administration Center

This article applies to users of Talend Administration Center who are using files to trigger their Job execution. tasks.
Below is a diagram introducing the way file triggers work in Talend Administration Center.
  • Talend Administration Center registers a file trigger in the JobServer to watch the folder located in the file system of the JobServer.

  • Talend Administration Center requests the JobServer after each polling period to get the file events of a given Talend Administration Center file trigger. Note that each JobServer file trigger has an independent queue in memory.

  • Between each polling and for each file trigger, events are added to the queue at the JobServer side, then when Talend Administration Center polls the server at the end of the polling period, all the events related to this file trigger are retrieved.

    At the same time, the JobServer empties the queue, and Talend Administration Center triggers a task execution for each event that is thus added to the Quartz queue.

  • The JobServer events queue is cleared each time Talend Administration Center polls the server.

    Note that the JobServer events are not supposed to be cleared manually, however you can reset the Talend Administration Center Quartz queue of a given task from the Job Conductor page of the web application.