BigQuery Input

OAuth

The OAuth credentials to use.

Only Google service account credentials are supported.

Evaluated for each input row

Default Dataset

The dataset to use.

Evaluated for each input row

Query

The query to run.

The query is processed in standard SQL mode. Legacy mode is not supported.

Evaluated for each input row

Query Parameters

Query Parameters

You can bind named or positional parameters to the query.

Named Parameters

If given a dict, each key/value pair is bound as a named parameter in the query.

Given the following query:

SELECT f FROM bar WHERE f == @field LIMIT @limit

Supply a dict of the form:

{
  :field "some value",
  :limit 100
}

Positional Parameters

If given a list, each value is bound to ? placeholders in order of appearance as a positional parameter.

Given the following query:

SELECT f FROM bar WHERE f == ? LIMIT ?

Supply a list of the form:

["some value", 100]

Evaluated for each input row

Page Size

This is how many rows the step requests per roundtrip to the server.

Note that the server will usually impose its own limits based on response size.

Set to nil to use the driver default.

Evaluated for each input row

Start Index

The 0-based index of the first row to return.

Evaluated for each input row

Limit

Stops reading after the given amount of rows.

Set to nil to read all rows.

Evaluated for each input row

record