Kubeflow TensorFlow

flytekitplugins-kftensorflow

FlytekitML Trainingtensorflowkubeflowdistributed-training

This plugin uses the Kubeflow TensorFlow Operator and provides an extremely simplified interface for executing distributed training using various TensorFlow backends.

Install

pip install flytekitplugins-kftensorflow

Quick Start(example, may need adjustment)

See full examples

pip install flytekitplugins-kftensorflow

from flytekit import task, workflow
from flytekitplugins.kftensorflow import PS, Chief, CleanPodPolicy, Evaluator

@task(task_config=TfJob(...))
def my_task() -> None:
    ...

@workflow
def my_workflow() -> None:
    my_task()

Available Imports (8)

configPS

Configuration type for Kubeflow TensorFlow.

extends dataclass — configuration or data structure for plugin setup

from flytekitplugins.kftensorflow import PS

configChief

Configuration type for Kubeflow TensorFlow.

extends dataclass — configuration or data structure for plugin setup

from flytekitplugins.kftensorflow import Chief

enumCleanPodPolicy

CleanPodPolicy describes how to deal with pods when the job is finished.

extends Enum — enumeration of predefined options

from flytekitplugins.kftensorflow import CleanPodPolicy

configEvaluator

Configuration type for Kubeflow TensorFlow.

extends dataclass — configuration or data structure for plugin setup

from flytekitplugins.kftensorflow import Evaluator

enumRestartPolicy

RestartPolicy describes how the replicas should be restarted.

extends Enum — enumeration of predefined options

from flytekitplugins.kftensorflow import RestartPolicy

configRunPolicy

RunPolicy describes a set of policies to apply to the execution of a Kubeflow job.

extends dataclass — configuration or data structure for plugin setup

from flytekitplugins.kftensorflow import RunPolicy

configTfJob

Configuration for an executable [`TensorFlow Job`](https://github.com/kubeflow/tf-operator).

extends dataclass — configuration or data structure for plugin setup

from flytekitplugins.kftensorflow import TfJob

configWorker

Configuration type for Kubeflow TensorFlow.

extends dataclass — configuration or data structure for plugin setup

from flytekitplugins.kftensorflow import Worker

Related Plugins

Kubeflow PyTorch

ML Training

This plugin uses the Kubeflow PyTorch Operator and provides an extremely simplified interface for executing distributed training using various PyTorch backends.