Beam BigQuery Input

Description

The Beam BigQuery Input transform can be used to input data from Google Cloud BigQuery using the Beam execution engine.

Options

OptionDescription

Transform name

Name of the transform, this name has to be unique in a single pipeline.

Project ID

The Google Cloud project.

Data set ID

The BigQuery dataset ID.

Table ID

The BigQuery table ID.

Query

The input query, blank means everything from the table.

Return fields selection

A list of result fields.

BQ Field name

The field name in the BigQuery table.

Rename to…​ (optional)

The name to be given to a column.

Hop data type

The field data type.