Cloud & Infrastructure

flytekitplugins-athena

Flyte backend can be connected with Athena. Once enabled, it allows you to query AWS Athena service (Presto + ANSI SQL Support) and retrieve typed schema (optionally).

flytekitplugins-awsbatch

Flyte backend can be connected with AWS batch. Once enabled, it allows you to run flyte task on AWS batch service

flytekitplugins-awssagemaker

The plugin currently features a SageMaker deployment connector.

flyteplugins-databricks

This plugin provides Databricks integration for Flyte, enabling you to run Spark jobs on Databricks as Flyte tasks.

flytekitplugins-pod

By default, Flyte tasks decorated with @task are essentially single functions that are loaded in one container. But often, there is a need to run a job with more than one container.

flytekitplugins-k8sdataservice

This plugin provides support for Kubernetes StatefulSet and Service integration, enabling seamless provisioning and coordination with any Kubernetes services or Flyte tasks. It is especially suited for deep learning use cases at scale, where distributed and parallelized data loading and caching across nodes are required.

flytekitplugins-mmcloud

Flyte Connector plugin to allow executing Flyte tasks using MemVerge Memory Machine Cloud.

flytekitplugins-perian_job

Flyte Connector plugin for executing Flyte tasks on Perian Job Platform (perian.io).

flytekitplugins-slurm

The Slurm connector is designed to integrate Flyte workflows with Slurm-managed high-performance computing (HPC) clusters, enabling users to leverage Slurm's capability of compute resource allocation, scheduling, and monitoring.