Skip to content

Entry

Kestra

Appears in 8 awesome lists

Event-driven orchestration and scheduling platform for mission-critical workflows. Infrastructure-as-Code approach with declarative YAML, Git version control integration, and hundreds of plugins for data pipelines and ML workflows. Apache 2.0 licensed.

Open github.comkestra-io/kestra

Found in these lists

Awesome Business Intelligence

Section: General

StaleScore 47

Awesome Data Analysis

Section: Tools · An open-source, event-driven orchestrator that simplifies data workflow management.

FreshScore 80

Awesome Data Engineering

Section: Workflow · Scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

FreshScore 87

Awesome Integration

Section: Workflow Engine · Event-driven declarative orchestrator with workflows defined in YAML and hundreds of plugins for data and infrastructure automation.

FreshScore 82

Awesome Microservices

Section: Workflow Orchestration · Open source microservices event-driven, language-agnostic orchestration and scheduling platform.

FreshScore 87

Awesome Open Source AI

Section: 8. MLOps / LLMOps & Production · Event-driven orchestration and scheduling platform for mission-critical workflows. Infrastructure-as-Code approach with declarative YAML, Git version control integration, and hundreds of plugins for data pipelines and ML workflows. Apache 2.0 licensed.

FreshScore 89

Awesome Pipeline

Section: Pipeline frameworks & libraries · Open source data orchestration and scheduling platform with declarative syntax.

FreshScore 86

Table of Contents

Section: Monitoring · is an infinitely scalable orchestration and scheduling platform, creating, running, scheduling, and monitoring millions of complex pipelines.

SlowScore 61

Taskade

Taskade AI is an AI-powered productivity suite offering tools like task and project management, notes, docs, mind maps, and AI chat to enhance team productivity and automate over 700 tasks website | github | twitter | youtube

In 33 listsDetails

Notion

write, plan, collaborate, and get organized. Notion is all you need — in one tool.

In 17 listsDetails

Luigi

Python module for building complex pipelines of batch jobs. Handles dependency resolution, workflow management, visualization, and Hadoop integration. Built at Spotify and battle-tested in production. Apache 2.0 licensed.

In 15 listsDetails

Apache Airflow

"Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command line utilities make performing complex surgeries on DAGs a snap. The rich user interface makes it…

In 13 listsDetails

Dagster

Cloud-native orchestration platform for developing and maintaining data assets including ML models. Declarative programming model with integrated lineage and observability. Apache 2.0 licensed.

In 12 listsDetails

Prefect

Workflow management system that makes it easy to take your data pipelines and add semantics like retries, logging, dynamic mapping, caching, failure notifications, and more.

In 11 listsDetails

Redash

🆓 Connect and query your data sources, build dashboards to visualize data and share them with your company. Owned by Databricks but the hosted SaaS shut down in 2021, so the project is now community-maintained under the Databricks org with no paid Redash product.

In 11 listsDetails

Hamilton

| Python | - A scalable general purpose micro-framework for defining dataflows. You can use it to build dataframes, numpy matrices, python objects, ML models, etc. Embed Hamilton anywhere python runs, e.g. spark, airflow, jupyter, fastapi, python scripts, etc.

In 10 listsDetails