Important
Read more in the announcement here.
Want to try Flyte 2 locally? Run the Devbox locally, or you can try it on Github Codespaces.
Looking for Flyte 1? Go to the master branch, where Flyte 1 is now maintained.
Reliably orchestrate ML pipelines, models, and agents at scale — in pure Python.
Flyte is a Graduated project of the LF AI & Data Foundation.
The quickest way to get a feel for Flyte 2 is in this notebook:
uv pip install flyteFor the full SDK and development tools, see the flyte-sdk repository.
import asyncio
import flyte
env = flyte.TaskEnvironment(
name="hello_world",
image=flyte.Image.from_debian_base(python_version=(3, 12)),
)
@env.task
def calculate(x: int) -> int:
return x * 2 + 5
@env.task
async def main(numbers: list[int]) -> float:
results = await asyncio.gather(*[
calculate.aio(num) for num in numbers
])
return sum(results) / len(results)
if __name__ == "__main__":
flyte.init()
run = flyte.run(main, numbers=list(range(10)))
print(f"Result: {run.result}")| Python | Flyte CLI |
python hello.py |
flyte run hello.py main --numbers '[1,2,3]' |
# serving.py
from fastapi import FastAPI
import flyte
from flyte.app.extras import FastAPIAppEnvironment
app = FastAPI()
env = FastAPIAppEnvironment(
name="my-model",
app=app,
image=flyte.Image.from_debian_base(python_version=(3, 12)).with_pip_packages(
"fastapi", "uvicorn"
),
)
@app.get("/predict")
async def predict(x: float) -> dict:
return {"result": x * 2 + 5}
if __name__ == "__main__":
flyte.init_from_config()
flyte.serve(env)| Python | Flyte CLI |
python serving.py |
flyte serve serving.py env |
Install the TUI for a rich local development experience:
uv pip install flyte[tui]The open source Flyte 2 backend is available in this repository. You can deploy it on your own Kubernetes cluster using Helm. See the deployment docs for setup instructions and the Backend README for backend architecture and development.
If you need an enterprise-ready, production-grade backend for Flyte 2 today, it is available on Union.ai.
- Try DevBox - Get started
- Try Devbox in Github Codespaces - Get started in the browser
- SDK Reference — API reference docs
- CLI Reference — CLI docs
- flyte-sdk — The Flyte 2 Python SDK repository
- Slack | GitHub Discussions | Issues
We welcome contributions! See the Backend README for backend development, or join us on slack.flyte.org.
CI container image builds for this repository are sponsored by Depot — fast, native multi-arch Docker builds with persistent layer caching.
Apache 2.0 — see LICENSE.




