A Flyte SDK (v2) version of this plugin is available as flyteplugins-snowflake.

Snowflake

flytekitplugins-snowflake

FlytekitDatabases & Warehousessnowflakesqlwarehouseanalytics

Snowflake enables us to build data-intensive applications without operational burden. Flyte backend can be connected with the Snowflake service. Once enabled, it can allow you to query a Snowflake service.

Install

pip install flytekitplugins-snowflake

Quick Start(example, may need adjustment)

See full examples

pip install flytekitplugins-snowflake

from flytekit import task, workflow
from flytekitplugins.snowflake import SnowflakeConnector, SnowflakeConfig, SnowflakeTask

@task(task_config=SnowflakeTask(...))
def my_task() -> None:
    ...

@workflow
def my_workflow() -> None:
    my_task()

Available Imports (3)

connectorSnowflakeConnector

Backend connector for Snowflake.

from flytekitplugins.snowflake import SnowflakeConnector

configSnowflakeConfig

SnowflakeConfig should be used to configure a Snowflake Task.

extends dataclass — configuration or data structure for plugin setup

from flytekitplugins.snowflake import SnowflakeConfig

taskSnowflakeTask

This is the simplest form of a Snowflake Task, that can be used even for tasks that do not produce any output.

extends SQLTask — a flyte task that can be used in workflows

from flytekitplugins.snowflake import SnowflakeTask

Dependencies

snowflake-connector-python

Related Plugins

Snowflake

Databases & Warehouses

Run Snowflake SQL queries as Flyte tasks with parameterized inputs, key-pair authentication, batch inserts, and DataFrame support.

Bigquery

Databases & Warehouses

BigQuery enables us to build data-intensive applications without operational burden. Flyte backend can be connected with the BigQuery service. Once enabled, it can allow you to query a BigQuery table.