Skip to content

Entry

Luigi

Appears in 15 awesome lists

Python module for building complex pipelines of batch jobs. Handles dependency resolution, workflow management, visualization, and Hadoop integration. Built at Spotify and battle-tested in production. Apache 2.0 licensed.

Open github.comspotify/luigi

Found in these lists

Awesome Big Data

Section: Service Programming · a Python package for building complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, handling failures, command line integration, and much more.

ActiveScore 84

Awesome Business Intelligence

Section: General · by Spotify

StaleScore 47

ciandcd

Section: Build And Release System · Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

ActiveScore 69

Awesome Data Analysis

Section: Tools · A Python module for building complex and batch-oriented data pipelines.

FreshScore 80

Awesome Data Engineering

Section: Workflow · A Python module that helps you build complex pipelines of batch jobs.

FreshScore 87

Awesome ETL

Section: Workflow Management/Engines · "a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in."

ActiveScore 72

Awesome MLOps

Section: Workflow Tools · Python module that helps you build complex pipelines of batch jobs.

FreshScore 80

Awesome Open Source AI

Section: 1. Core Frameworks & Libraries · Python module for building complex pipelines of batch jobs. Handles dependency resolution, workflow management, visualization, and Hadoop integration. Built at Spotify and battle-tested in production. Apache 2.0 licensed.

FreshScore 89

Awesome Pipeline

Section: Pipeline frameworks & libraries · Python module that helps you build complex pipelines of batch jobs.

FreshScore 86

Awesome Production Machine Learning

Section: Data Pipeline · Luigi is a Python module that helps you build complex pipelines of batch jobs, handling dependency resolution, workflow management, visualisation, etc..

FreshScore 92

Awesome Robotic Tooling

Section: Server Infrastructure and High Performance Computing · A Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

StaleScore 54

Best Of Python

Section: luigi (30 · 19K) - Luigi is a Python module that helps you build complex pipelines of batch.. Apache-2 · (👨‍💻 640 · 🔀 2.5K · 📦 2.9K):

FreshScore 88

Awesome AI Agents: Tools, Resources, and Projects

Section: Workflows · Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…

SlowScore 68

awesome-python

Section: Data Science and Analytics · Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

FreshScore 81

Table of Contents

Section: Python Frameworks, Libraries, and Tools · is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built-in.

SlowScore 51

Taskade

Taskade AI is an AI-powered productivity suite offering tools like task and project management, notes, docs, mind maps, and AI chat to enhance team productivity and automate over 700 tasks website | github | twitter | youtube

In 33 listsDetails

Notion

write, plan, collaborate, and get organized. Notion is all you need — in one tool.

In 17 listsDetails

Redash

🆓 Connect and query your data sources, build dashboards to visualize data and share them with your company. Owned by Databricks but the hosted SaaS shut down in 2021, so the project is now community-maintained under the Databricks org with no paid Redash product.

In 11 listsDetails

DataGrip

is a professional DataBase IDE developed by Jet Brains that provides context-sensitive code completion, helping you to write SQL code faster. Completion is aware of the tables structure, foreign keys, and even database objects created in code you're editing.

In 8 listsDetails

PostgreSQL

is a powerful, open source object-relational database system with over 30 years of active development that has earned it a strong reputation for reliability, feature robustness, and performance.

In 9 listsDetails

n8n

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

In 9 listsDetails

MySQL

is a fully managed database service to deploy cloud-native applications using the world's most popular open source database.

In 9 listsDetails

Zapier

Superpowers to get your work done. A Zap is a link between two apps (a "trigger" and an "action"). Zaps run automatically in the background every few minutes to move and manage data on your behalf. Only live Zaps count against your limit — you can have as many paused and unfinished Zaps as you'd…

In 10 listsDetails