Apache Airflow
flytekitplugins-airflow
Airflow plugin allows you to seamlessly run Airflow tasks in the Flyte workflow without changing any code.
pip install flytekitplugins-airflowQuick Start(example, may need adjustment)
See full examplespip install flytekitplugins-airflow
from flytekit import task, workflow
from flytekitplugins.airflow import AirflowConnector, AirflowObj, AirflowTask
@task(task_config=AirflowTask(...))
def my_task() -> None:
...
@workflow
def my_workflow() -> None:
my_task()Available Imports (3)
It is used to run Airflow tasks.
from flytekitplugins.airflow import AirflowConnector
This class is used to store the Airflow task configuration.
extends dataclass — configuration or data structure for plugin setup
from flytekitplugins.airflow import AirflowObj
This class is used to resolve an Airflow task.
extends PythonTask — a flyte task that can be used in workflows
from flytekitplugins.airflow import AirflowTask
Dependencies
Related Plugins
DBT
Flytekit plugin for performing DBT tasks. Currently it supports dbt run , dbt test, dbt source freshness tasks.
Papermill
It is possible to run a Jupyter notebook as a Flyte task using Papermill. Papermill executes the notebook as a whole, so before using this plugin, it is essential to construct your notebook as recommended by Papermill.
