Preview Flyte 2 for productionHosted on Union.ai

This is the Flyte SDK (v2) version of this plugin. The Flytekit version is available as flytekitplugins-pandera.

pandera

pandera

flyteplugins-pandera

Flyte SDK (v2)Developer Toolspandera

flyteplugins-pandera adds support for pandera.typing.pandas.DataFrame, pandera.typing.polars.DataFrame / LazyFrame, and pandera.typing.pyspark_sql.DataFrame in Flyte v2.

Install
pip install flyteplugins-pandera

Quick Start(example, may need adjustment)

pip install flyteplugins-pandera

from flytekit import task, workflow
from flyteplugins.pandera import ValidationConfig, register_type_transformers

config = ValidationConfig(...)

@task
def my_task() -> None:
    ...

@workflow
def my_workflow() -> None:
    my_task()

Available Imports (2)

configValidationConfig

Configuration type for pandera.

from flyteplugins.pandera import ValidationConfig

transformerregister_type_transformers

Configuration type for pandera.

from flyteplugins.pandera import register_type_transformers

Dependencies

great_tablespanderapandaspyarrowfastparquet

Related Plugins

Package Info

Min Flyte SDK
Modules2

Downloads

Last day51
Last week51
Last month51