Centralizing HDFS metadata - 7.1

Talend Real-time Big Data Platform Studio User Guide

Version
7.1
Language
English (United States)
Product
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Design and Development

If you often need to use a file schema from HDFS, the Hadoop Distributed File System, then you may want to centralize the connection information to the HDFS and the schema details in the Metadata folder in the Repository tree view.

Prerequisites:

  • Launch the Hadoop distribution you need to use and ensure that you have the proper access permission to that distribution and its HDFS.

  • Create the connection to that Hadoop distribution from the Hadoop cluster node. For further information, see Centralizing a Hadoop connection.