Awesome Data Analysis
Section: Tools · Workflow orchestration for building resilient data pipelines.
FreshScore 80
Entry
Prefect
Appears in 11 awesome lists
Workflow management system that makes it easy to take your data pipelines and add semantics like retries, logging, dynamic mapping, caching, failure notifications, and more.
Open github.comprefecthq/prefect
Found in these lists
AWESOME DATA SCIENCE
Section: Miscellaneous Tools · Workflow management system for modern data stacks
FreshScore 92
Awesome ETL
Section: Workflow Management/Engines · "a workflow orchestration framework for building resilient data pipelines in Python."
ActiveScore 72
Awesome Integration
Section: Workflow Engine · Modern, developer-friendly orchestration tool optimized for data pipelines and complex workflows.
FreshScore 82
Awesome LLMOps
Section: Workflow · The easiest way to automate your data.
ActiveScore 75
Awesome Open Source AI
Section: 8. MLOps / LLMOps & Production · Workflow orchestration framework for building resilient data and ML pipelines. Python-native with modern observability and 200+ integrations. Apache 2.0 licensed.
FreshScore 89
Awesome Opensource Data Engineering
Section: General · ] - A workflow management system designed for modern infrastructure.
StaleScore 51
Awesome Production Machine Learning
Section: Data Pipeline · Workflow management system that makes it easy to take your data pipelines and add semantics like retries, logging, dynamic mapping, caching, failure notifications, and more.
FreshScore 92
Awesome Python
Section: Job Schedulers · A modern workflow orchestration framework that makes it easy to build, schedule and monitor robust data pipelines.
FreshScore 94
Best Of Python
Section: Prefect (32 · 24K) - Prefect is a workflow orchestration framework for building resilient.. Apache-2 · (👨💻 770 · 🔀 2.5K · 📦 8.5K):
FreshScore 88
awesome-python
Section: Data Science and Analytics · Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
FreshScore 81
Often listed next to it
Opik
Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…
In 16 listsDetails
Luigi
Python module for building complex pipelines of batch jobs. Handles dependency resolution, workflow management, visualization, and Hadoop integration. Built at Spotify and battle-tested in production. Apache 2.0 licensed.
In 15 listsDetails
Apache Airflow
"Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command line utilities make performing complex surgeries on DAGs a snap. The rich user interface makes it…
In 13 listsDetails
Ray
A fast and simple framework for building and running distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library. ray.io
In 13 listsDetails
Dagster
Cloud-native orchestration platform for developing and maintaining data assets including ML models. Declarative programming model with integrated lineage and observability. Apache 2.0 licensed.
In 12 listsDetails
Gradio
Build and share delightful machine learning apps, all in Python. The de facto standard for creating interactive ML demos with automatic UI generation from function signatures. Powers thousands of Hugging Face Spaces.
In 11 listsDetails