Centralizing Hive metadata - 7.1

Talend Real-time Big Data Platform Studio User Guide

Version
7.1
Language
English (United States)
Product
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Design and Development

If you often need to use a database table from Hive, then you may want to centralize the connection information to the Hive database and the table schema details in the Metadata folder in the Repository tree view.

Even though you can still do this from the DB connection mode, using the Hadoop cluster node is the alternative that makes better use of the centralized connection properties for a given Hadoop distribution.

Prerequisites:
  • Launch the Hadoop distribution you need to use and ensure that you have the proper access permission to that distribution and its Hive database.

  • Create the connection to that Hadoop distribution from the Hadoop cluster node. For further information, see Centralizing a Hadoop connection.