tNeo4jOutput properties - 6.1

Talend Components Reference Guide

EnrichVersion
6.1
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Open Studio for Data Quality
Talend Open Studio for ESB
Talend Open Studio for MDM
Talend Real-Time Big Data Platform
task
Data Governance
Data Quality and Preparation
Design and Development
EnrichPlatform
Talend Studio

Component family

Big Data / Neo4j

 

Function

tNeo4jOutput receives data from the preceding component, and writes the data into Neo4j.

Purpose

tNeo4jOutput is used to write data into a Neo4j database, and/or update or delete entries in the database based on the index defined.

Basic settings

Use an existing connection

Select this check box and in the Component List click the relevant connection component to reuse the connection details you already defined.

 

DB version

Select the Neo4j version you are using, between Neo4J 1.X.X and Neo4J 2.X.X.

Note that Neo4j version 2.X.X is compatible only with Java 7 or higher but it offers support of advanced features such as node labels.

This list is not shown if the Use an existing connection check box is selected.

Upon selecting a database version, you will be prompted to install the corresponding database driver JAR files if not yet installed. For more information on installing third-party modules, see the Talend Installation Guide.

 

Remote server

Select this check box if you use a Neo4j REST server, and specify the root URL in the Server URL field.

  • Set username: this check box is available when you have selected the Use a remote server check box and the Neo4j version you are using is earlier than 2.2. If the remote Neo4j server you want to connect to does not require user credentials, leave it clear.

  • Username and Password: enter the authentication information to connect to the remote Neo4j server to be used. Since Neo4j 2.2, user credentials are always required.

This check box appears only if you do not select the Use an existing connection check box.

 

Database path

If you use Neo4j in embedded mode, specify the directory to hold your data files. If the specified directory does not exist, it will be created.

This field appears only if you do not select the Use an existing connection check box or the Remote server check box.

 

Shutdown after job (Only embedded database)

Select this check box if you want to shutdown the Neo4j database connection at the end of the Job.

This check box is available only if the Use an existing connection check box is selected.

 Mapping

Click the [...] button or double-click the component on the design workspace to open the indexes and relationships mapping editor. Use it to index node or create relationships during the node insertion.

  • Select the Auto indexed check box for a column to automatically index nodes with this property.

  • Index creation: With a column selected, click the [+] button to create as many indexes as you want on nodes with the property corresponding to the selected column.

    • Name: Specify an index name in double quotes.

    • Key: Specify an index key in double quotes.

    • Value (empty for current row): Specify an index value in double quotes. If you leave this field empty, the default value of the index added on each node will be the value of this property of the current node.

    • Unique: Select this check box if you want the defined index to be created only once within the graph, rather than on each node.

  • Relationship creation: With a column selected, click the [+] button to create as many relationships as you want for nodes with the property corresponding to the selected column.

    • Type: Specify a relationship type in double quotes.

    • Direction: Select a relationship direction, between Outgoing and Incoming.

    • Index name: Specify an index name for the relationship, in double quotes.

    • Index key: Specify an index key for the relationship, in double quotes.

    • Value (empty for current row): Specify an index value for the relationship, in double quotes. If you leave this field empty, the default value of the index added on the relationship will be the value of this property of the current node.

 

Use label (Neo4j > 2.0)

Select this check box to create nodes with a label. Enter your label name in the Label name field.

This check box is not shown if Neo4J 1.X.X is selected from the DB Version list or Delete is selected from the Data action list.

Note that this option works only with Neo4j 2.0 onwards and Java 7.

 

Data action

On the data of the node, you can perform:

  • Insert: Add new node to the database.

  • Update: Make changes to existing entries.

  • Update or insert: Search the node with an index to update and make changes. If the node doesn't exist, a new node will be inserted.

  • Delete: Remove nodes fetched by the index according to the input flow.

 

Index name

Specify the index name to query.

This field is available only if the action selected in Data action is other than Insert.

 

Index key

Specify the index key to query.

This field is available only if the action selected in Data action is other than Insert.

 

Index value

Select the index value to query.

This field is available only if the action selected in Data action is other than Insert.

 

Schema and Edit schema

A schema is a row description. It defines the number of fields (columns) to be processed and passed on to the next component. The schema is either Built-In or stored remotely in the Repository.

Since version 5.6, both the Built-In mode and the Repository mode are available in any of the Talend solutions.

Click Edit schema to make changes to the schema. If the current schema is of the Repository type, three options are available:

  • View schema: choose this option to view the schema only.

  • Change to built-in property: choose this option to change the schema to Built-in for local changes.

  • Update repository connection: choose this option to change the schema stored in the repository and decide whether to propagate the changes to all the Jobs upon completion. If you just want to propagate the changes to the current Job, you can select No upon completion and choose this schema metadata again in the [Repository Content] window.

 

 

Built-In: You create and store the schema locally for this component only. Related topic: see Talend Studio User Guide.

 

 

Repository: You have already created the schema and stored it in the Repository. You can reuse it in various projects and Job designs. Related topic: see Talend Studio User Guide.

When the schema to be reused has default values that are integers or functions, ensure that these default values are not enclosed within quotation marks. If they are, you must remove the quotation marks manually.

For more details, see https://help.talend.com/display/KB/Verifying+default+values+in+a+retrieved+schema.

Advanced settings

Commit every

Enter the number of rows to be completed before committing batches of nodes to the DB. This option ensures transaction quality (but not rollback) and, above all, better performance at execution.

Warning

This option is only supported by the embedded mode of the database. You can't make transactions in REST mode.

 

Batch import

Select this check box to activate the batch mode.

Warning

This option is only supported by the embedded mode of the database.

It is recommended that you perform a backup operation before executing the Job to prevent data corruption.

Note

If you have configured index creation on multiple columns in the Mapping table, it is recommended that you select the Unique check box in the index setting for the last column to avoid creating unwanted redundant indexes that may cause batch load issues.

If you want more explanations about memory mapping configuration of batch import, please refer to Neo4j documentation at: http://docs.neo4j.org/chunked/milestone/configuration-io-examples.html#configuration-batchinsert.

 

Node store mapped memory

Type in the memory size in MB allocated to nodes.

 

Relationship store mapped memory

Type in the memory size in MB allocated to relationships.

 

Property store mapped memory

Type in the memory size in MB allocated to property.

 

String store mapped memory

Type in the memory size in MB allocated to strings.

 

Array store mapped memory

Type in the memory size in MB allocated to arrays.

 

tStatCatcher Statistics

Select this check box to gather the Job processing metadata at the Job level as well as at each component level.

Global Variables

NB_LINE: the number of rows read by an input component or transferred to an output component. This is an After variable and it returns an integer.

ERROR_MESSAGE: the error message generated by the component when an error occurs. This is an After variable and it returns a string. This variable functions only if the Die on error check box is cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl + Space to access the variable list and choose the variable to use from it.

For further information about variables, see Talend Studio User Guide.

UsageThis component is used as an output component and it always needs an incoming link.
Limitationn/a