Centralizing HDFS metadata - 7.1

Talend Real-time Big Data Platform Studio User Guide

EnrichVersion
7.1
EnrichProdName
Talend Real-Time Big Data Platform
EnrichPlatform
Talend Studio
task
Design and Development

If you often need to use a file schema from HDFS, the Hadoop Distributed File System, then you may want to centralize the connection information to the HDFS and the schema details in the Metadata folder in the Repository tree view.

Prerequisites:

  • Launch the Hadoop distribution you need to use and ensure that you have the proper access permission to that distribution and its HDFS.

  • Create the connection to that Hadoop distribution from the Hadoop cluster node. For further information, see Centralizing a Hadoop connection.