Writing the flight KPI results in your filesystem - 7.2

Delta Lake

EnrichVersion
7.2
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Real-Time Big Data Platform
EnrichPlatform
Talend Studio
task
Data Governance > Third-party systems > Technical components > Delta Lake components
Data Quality and Preparation > Third-party systems > Technical components > Delta Lake components
Design and Development > Third-party systems > Technical components > Delta Lake components

Procedure

  1. Double-click tFileOutputDelimited (labeled kpi_output) to open its Component view.
  2. Select Define a storage configuration component check box to reuse the connection information defined in tS3Configuration.
  3. Click Sync columns to ensure that the data schema defined in tMap is properly retrieved by tFileOutputDelimited.
  4. In the Folder field, enter the directory in which you want to store the calculated KPI results, in the S3 bucket defined in tS3Configuration.
  5. From the Action drop-down list, select Create if the folder to be used does not exist yet; otherwise, select Overwrite.
  6. Select the Include Header to output the column names with the calculation results.
  7. Select the Merge result to single file to merge the part files into one single file and in the Merge File Path field that is displayed, enter the directory and the filename in which the merged data is written, in the same S3 bucket.
  8. If the target file exists already, select Override target file.
  9. In the Run tab, click Run to execute the Job.

Results

Once the execution is successfully done, download this merge file from S3 to consult the KPI information of the US flights.