Scenario: Inserting documents to a data bucket in the Couchbase database - 6.1

Talend Components Reference Guide

EnrichVersion
6.1
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Open Studio for Data Quality
Talend Open Studio for ESB
Talend Open Studio for MDM
Talend Real-Time Big Data Platform
task
Data Governance
Data Quality and Preparation
Design and Development
EnrichPlatform
Talend Studio

This scenario inserts three blog posts to a data bucket in the Couchbase database. The source records are of flat data type and thus wrapped into JSON data before storage in the Couchbase database as documents. Note that the values of the source data field title, which is selected as the Key in the Basic settings of tCouchbaseOutput, are used as the document IDs in the Couchbase database.

Linking the components

  1. Drop tCouchbaseConnection, tFixedFlowInput, tCouchbaseOutput, and tCouchbaseClose onto the workspace.

  2. Link tCouchbaseConnection to tFixedFlowInput using the OnSubjobOk trigger.

  3. Link tFixedFlowInput to tCouchbaseOutput using a Row > Main connection.

  4. Link tFixedFlowInput to tCouchbaseClose using the OnSubjobOk trigger.

Configuring the components

  1. Double-click tCouchbaseConnection to open its Basic settings view.

  2. In the Data Bucket field, enter the name of the data bucket in the Couchbase database.

    In the Password field, enter the password for access to the data bucket.

    In the URIs table, click the [+] button to add lines as needed, where you can enter the URIs of the Couchbase server nodes.

  3. Double-click tFixedFlowInput to open its Basic settings view.

    Select Use Inline Content (delimited file) in the Mode area.

    In the Content field, enter the data to write to the Couchbase database, for example:

    1;Andy;Integration at any scale;Talend, the leader of the DI space...
    2;Andy;Data Integration Overview;Talend, the leading player in the DI field...
    3;Andy;ELT Overview;Talend, the big name in the ELT circle...
  4. Click the Edit schema button to open the schema editor.

  5. Click the [+] button to add four columns, namely id, author, title and contents, of the string type.

    Click OK to validate the setup and close the editor.

  6. Click tCouchbaseOutput to open its Basic settings view.

  7. Select the Use existing connection check box to reuse the connection.

  8. In the Key list, select the field title whose values will be used as the IDs of documents inserted to the Couchbase database.

  9. Select the Generate JSON Document check box and click the Configure JSON Tree button to open the JSON tree mapper.

  10. Press the Shift key to select all the fields in the Linker source area and drop them onto the rootTag node in the Link target part.

  11. In the pop-up box, select Create as sub-element of target node.

    Click OK to validate the setup and close the box.

  12. Right-click the id node in the Link target part and select Set as Loop Element from the contextual menu.

    Click OK to validate the setup and close the mapper.

Executing the Job

  1. Press F6 to save and run the Job.

  2. Go to the Couchbase web console and view the documents stored in the data bucket blog:

    As shown above, the source records have been saved in the Couchbase database in the form of JSON documents.