Building access to Cloud Storage - 7.3

Google BigQuery

Version
7.3
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Cloud storages > Google components > Google BigQuery components
Data Quality and Preparation > Third-party systems > Cloud storages > Google components > Google BigQuery components
Design and Development > Third-party systems > Cloud storages > Google components > Google BigQuery components
Last publication date
2024-02-21

Procedure

  1. Double-click tBigQueryOutput to open its Component view.
  2. Click Sync columns to retrieve the schema from its preceding component.
  3. In the Local filename field, enter the directory where you need to create the file to be transferred to BigQuery.
  4. Navigate to the Google APIs Console in your web browser to access the Google project hosting the BigQuery and the Cloud Storage services you need to use.
  5. Click Google Cloud Storage > Interoperable Access to open its view.
  6. In Google storage configuration area of the Component view, paste Access key, Access secret from the Interoperable Access tab view to the corresponding fields, respectively.
  7. In the Bucket field, enter the path to the bucket you want to store the transferred data in. In this example, it is talend/documentation
    This bucket must exist in the directory in Cloud Storage
  8. In the File field, enter the directory where in Google Clould Storage you receive and create the file to be transferred to BigQuery. In this example, it is gs://talend/documentation/biquery_UScustomer.csv. The file name must be the same as the one you defined in the Local filename field.

    Troubleshooting: if you encounter issues such as Unable to read source URI of the file stored in Google Cloud Storage, check whether you put the same file name in these two fields.

  9. Enter 0 in the Header field to ignore no rows in the transferred data.