Dolt
flytekitplugins-dolt
The DoltTable plugin is a wrapper that uses Dolt to move data between pandas.DataFrame’s at execution time and database tables at rest.
pip install flytekitplugins-doltQuick Start(example, may need adjustment)
See full examplespip install flytekitplugins-dolt
from flytekit import task, workflow
from flytekitplugins.dolt import DoltConfig, DoltTable, DoltTableNameTransformer
config = DoltConfig(...)
@task
def my_task() -> None:
...
@workflow
def my_workflow() -> None:
my_task()Available Imports (3)
Configuration type for Dolt.
extends dataclass — configuration or data structure for plugin setup
from flytekitplugins.dolt import DoltConfig
Configuration type for Dolt.
extends dataclass — configuration or data structure for plugin setup
from flytekitplugins.dolt import DoltTable
Configuration type for Dolt.
extends TypeTransformer — converts python types to/from flyte-native types
from flytekitplugins.dolt import DoltTableNameTransformer
Dependencies
Related Plugins
Bigquery
BigQuery enables us to build data-intensive applications without operational burden. Flyte backend can be connected with the BigQuery service. Once enabled, it can allow you to query a BigQuery table.
BigQuery
This plugin provides BigQuery integration for Flyte, enabling you to run BigQuery queries as Flyte tasks.
DuckDB
Run analytical workloads with ease using DuckDB.
Hive
Flyte backend can be connected with various Hive services. Once enabled, it allows you to query a Hive service (e.g., Qubole) and retrieve typed schema (optionally).