tLibraryLoad MapReduce properties (deprecated) - 7.3

Library import

Version
7.3
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Custom code components (Integration) > Library import component
Data Quality and Preparation > Third-party systems > Custom code components (Integration) > Library import component
Design and Development > Third-party systems > Custom code components (Integration) > Library import component
Last publication date
2024-02-21

These properties are used to configure tLibraryLoad running in the MapReduce Job framework.

The MapReduce tLibraryLoad component belongs to the Custom Code family.

The component in this framework is available in all Talend products with Big Data and Talend Data Fabric.

The MapReduce framework is deprecated from Talend 7.3 onwards. Use Talend Jobs for Apache Spark to accomplish your integration tasks.

Basic settings

Library

Click on the [...] button to to open the Module dialog box from which you can import the library to be used.

For more information, see Importing an external library.

Advanced settings

Dynamic Libs

Lib Paths: Enter the access path to your library, between double quotation marks.

Import

Enter the Java code required to import, if required, the external library used in the code editing field of the Basic settings tab of the components such as tJavaMR in a Map/Reduce Job.

Global Variables

Global Variables

ERROR_MESSAGE: the error message generated by the component when an error occurs. This is an After variable and it returns a string. This variable functions only if the Die on error check box is cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl + Space to access the variable list and choose the variable to use from it.

For further information about variables, see Talend Studio User Guide.

Usage

Usage rule

In a Talend Map/Reduce Job, this component is used standalone. It generates native Map/Reduce code that can be executed directly in Hadoop.

You need to use the Hadoop Configuration tab in the Run view to define the connection to a given Hadoop distribution for the whole Job.

This connection is effective on a per-Job basis.

For further information about a Talend Map/Reduce Job, see the sections describing how to create, convert and configure a Talend Map/Reduce Job of the Talend Big Data Getting Started Guide .

Note that in this documentation, unless otherwise explicitly stated, a scenario presents only Standard Jobs, that is to say traditional Talend data integration Jobs, and non Map/Reduce Jobs.

Limitation

The library is loaded locally.