This is the Flyte SDK (v2) version of this plugin. The Flytekit version is available as flytekitplugins-bigquery.

BigQuery

flyteplugins-bigquery

Flyte SDK (v2)Databases & Warehousesbigquerygooglesqlwarehouseconnector

This plugin provides BigQuery integration for Flyte, enabling you to run BigQuery queries as Flyte tasks.

Install

pip install flyteplugins-bigquery

Quick Start(example, may need adjustment)

See full examples

pip install flyteplugins-bigquery

from flytekit import task, workflow
from flyteplugins.bigquery import BigQueryConfig, BigQueryTask, BigQueryConnector

@task(task_config=BigQueryTask(...))
def my_task() -> None:
    ...

@workflow
def my_workflow() -> None:
    my_task()

Available Imports (3)

configBigQueryConfig

Configuration for a BigQuery task.

extends dataclass — configuration or data structure for plugin setup

from flyteplugins.bigquery import BigQueryConfig

taskBigQueryTask

Task for BigQuery.

from flyteplugins.bigquery import BigQueryTask

connectorBigQueryConnector

Backend connector for BigQuery.

from flyteplugins.bigquery import BigQueryConnector

Related Plugins

Bigquery

Databases & Warehouses

BigQuery enables us to build data-intensive applications without operational burden. Flyte backend can be connected with the BigQuery service. Once enabled, it can allow you to query a BigQuery table.

Snowflake

Databases & Warehouses

Run Snowflake SQL queries as Flyte tasks with parameterized inputs, key-pair authentication, batch inserts, and DataFrame support.

Snowflake

Databases & Warehouses

Snowflake enables us to build data-intensive applications without operational burden. Flyte backend can be connected with the Snowflake service. Once enabled, it can allow you to query a Snowflake service.