Preview Flyte 2 for productionHosted on Union.ai
JSONL (JSON Lines) Type Plugin

JSONL (JSON Lines) Type Plugin

flyteplugins-jsonl

Flyte SDK (v2)Developer Toolsjsonl

JSONL (JSON Lines) file and directory types for Flyte, backed by orjson for

Install
pip install flyteplugins-jsonl

Quick Start(example, may need adjustment)

pip install flyteplugins-jsonl

from flytekit import task, workflow
from flyteplugins.jsonl import JsonlDir, JsonlFile

config = JsonlDir(...)

@task
def my_task() -> None:
    ...

@workflow
def my_workflow() -> None:
    my_task()

Available Imports (2)

typeJsonlDir

Async sharded JSONL writer.

from flyteplugins.jsonl import JsonlDir

typeJsonlFile

A file type for JSONL (JSON Lines) files, backed by ``orjson`` for fast serialisation.

from flyteplugins.jsonl import JsonlFile

Dependencies

orjsonzstandard

Related Plugins

Package Info

Min Flyte SDK
Modules2

Downloads

Last day59
Last week285
Last month515