Linking the components - 7.3

MongoDB

Version
7.3
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > NoSQL components > MongoDB components
Data Quality and Preparation > Third-party systems > NoSQL components > MongoDB components
Design and Development > Third-party systems > NoSQL components > MongoDB components
Last publication date
2024-02-21

Procedure

  1. In the Integration perspective of the Studio, create an empty Spark Batch Job from the Job Designs node in the Repository tree view.
    For further information about how to create a Spark Streaming Job, see Talend Big Data Getting Started Guide .
  2. In the workspace, enter the name of the component to be used and select this component from the list that appears. In this scenario, the components are tHDFSConfiguration, tMongoDBConfiguration, tFixedFlowInput, tMongoDBOutput, tMongoDBLookupInput, tMap and tLogRow.
    The tFixedFlowInput components are used to load the data about movies into the data flow. In the real-world practice, you can use other components such as tFileInputDelimited instead to design a sophisticated process to prepare your data to be processed.
  3. Connect tFixedFlowInput to tMap using the Row > Main link.
    This way, the main flow to tMap is created. The movie information is sent via this flow.
  4. Connect tMongoDBLookupInput to tMap using the Row > Main link.
    This way, the lookup flow to tMap is created. The movie director information is sent via this flow.
  5. Connect tMap to tMongoDBOutput using the Row > Main link and name this connection in the dialog box that is displayed. For example, name it to out1.
  6. Do the same to connect tMap to tLogRow and name this connection to reject.
  7. Leave tHDFSConfiguration and tMongoDBConfiguration alone without any connection.