Skip to content

Entry

Prefect

Appears in 11 awesome lists

Workflow management system that makes it easy to take your data pipelines and add semantics like retries, logging, dynamic mapping, caching, failure notifications, and more.

Open github.comprefecthq/prefect

Found in these lists

Awesome Data Analysis

Section: Tools · Workflow orchestration for building resilient data pipelines.

FreshScore 79

AWESOME DATA SCIENCE

Section: Miscellaneous Tools · Workflow management system for modern data stacks

FreshScore 93

Awesome ETL

Section: Workflow Management/Engines · "a workflow orchestration framework for building resilient data pipelines in Python."

SlowScore 74

Awesome Integration

Section: Workflow Engine · Modern, developer-friendly orchestration tool optimized for data pipelines and complex workflows.

FreshScore 84

Awesome LLMOps

Section: Workflow · The easiest way to automate your data.

FreshScore 91

Awesome Open Source AI

Section: 8. MLOps / LLMOps & Production · Workflow orchestration framework for building resilient data and ML pipelines. Python-native with modern observability and 200+ integrations. Apache 2.0 licensed.

FreshScore 87

Awesome Opensource Data Engineering

Section: General · ] - A workflow management system designed for modern infrastructure.

StaleScore 36

Awesome Production Machine Learning

Section: Data Pipeline · Workflow management system that makes it easy to take your data pipelines and add semantics like retries, logging, dynamic mapping, caching, failure notifications, and more.

FreshScore 98

awesome-python

Section: Data Science and Analytics · Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

FreshScore 79

Best Of Python

Section: Prefect (32 · 24K) - Prefect is a workflow orchestration framework for building resilient.. Apache-2 · (👨‍💻 840 · 🔀 2.6K · 📦 8.6K):

FreshScore 94

Awesome Python

Section: Job Schedulers · A modern workflow orchestration framework that makes it easy to build, schedule and monitor robust data pipelines.

FreshScore 100

Opik

Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…

In 18 listsDetails

Luigi

Python module for building complex pipelines of batch jobs. Handles dependency resolution, workflow management, visualization, and Hadoop integration. Built at Spotify and battle-tested in production. Apache 2.0 licensed.

In 15 listsDetails

Ray

A fast and simple framework for building and running distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library. ray.io

In 14 listsDetails

Apache Airflow

"Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command line utilities make performing complex surgeries on DAGs a snap. The rich user interface makes it…

In 13 listsDetails

FunASR

industrial-grade ASR toolkit; 170× realtime on GPU, 50+ languages, built-in VAD, punctuation, speaker diarization, and emotion detection. Includes non-autoregressive SenseVoice and LLM-based Fun-ASR-Nano models.

In 12 listsDetails

Dagster

Cloud-native orchestration platform for developing and maintaining data assets including ML models. Declarative programming model with integrated lineage and observability. Apache 2.0 licensed.

In 12 listsDetails

Gradio

Build and share delightful machine learning apps, all in Python. The de facto standard for creating interactive ML demos with automatic UI generation from function signatures. Powers thousands of Hugging Face Spaces.

In 11 listsDetails

Streamlit

The fastest way to build and share data apps. Transform Python scripts into beautiful web applications with minimal code. Widely used for ML model demos, data visualization, and internal tools.

In 11 listsDetails