DBT
flytekitplugins-dbt
Flytekit plugin for performing DBT tasks. Currently it supports dbt run , dbt test, dbt source freshness tasks.
pip install flytekitplugins-dbtQuick Start(example, may need adjustment)
See full examplespip install flytekitplugins-dbt
from flytekit import task, workflow
from flytekitplugins.dbt import BaseDBTInput, BaseDBTOutput, DBTRunInput, DBTRunOutput
config = BaseDBTInput(...)
@task
def my_task() -> None:
...
@workflow
def my_workflow() -> None:
my_task()Available Imports (8)
Base class for DBT Task Input.
extends dataclass — configuration or data structure for plugin setup
from flytekitplugins.dbt import BaseDBTInput
Base class for output of DBT task.
extends dataclass — configuration or data structure for plugin setup
from flytekitplugins.dbt import BaseDBTOutput
Input to DBT Run task.
extends dataclass — configuration or data structure for plugin setup
from flytekitplugins.dbt import DBTRunInput
Output of DBT run task.
extends dataclass — configuration or data structure for plugin setup
from flytekitplugins.dbt import DBTRunOutput
Input to DBT Test task.
extends dataclass — configuration or data structure for plugin setup
from flytekitplugins.dbt import DBTTestInput
Output of DBT test task.
extends dataclass — configuration or data structure for plugin setup
from flytekitplugins.dbt import DBTTestOutput
Input to DBT Run task.
extends dataclass — configuration or data structure for plugin setup
from flytekitplugins.dbt import DBTRun
Input to DBT Test task.
extends dataclass — configuration or data structure for plugin setup
from flytekitplugins.dbt import DBTTest
Dependencies
Related Plugins
Apache Airflow
Airflow plugin allows you to seamlessly run Airflow tasks in the Flyte workflow without changing any code.
Papermill
It is possible to run a Jupyter notebook as a Flyte task using Papermill. Papermill executes the notebook as a whole, so before using this plugin, it is essential to construct your notebook as recommended by Papermill.
AWS Athena
Flyte backend can be connected with Athena. Once enabled, it allows you to query AWS Athena service (Presto + ANSI SQL Support) and retrieve typed schema (optionally).
Bigquery
BigQuery enables us to build data-intensive applications without operational burden. Flyte backend can be connected with the BigQuery service. Once enabled, it can allow you to query a BigQuery table.
