Skip to content

Entry

Luigi

Appears in 15 awesome lists

Python module for building complex pipelines of batch jobs. Handles dependency resolution, workflow management, visualization, and Hadoop integration. Built at Spotify and battle-tested in production. Apache 2.0 licensed.

Open github.comspotify/luigi

Found in these lists

Awesome Big Data

Section: Service Programming · a Python package for building complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, handling failures, command line integration, and much more.

FreshScore 90

Awesome Business Intelligence

Section: General · by Spotify

StaleScore 49

ciandcd

Section: Build And Release System · Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

SlowScore 65

Awesome Data Analysis

Section: Tools · A Python module for building complex and batch-oriented data pipelines.

FreshScore 79

Awesome Data Engineering

Section: Workflow · A Python module that helps you build complex pipelines of batch jobs.

FreshScore 93

Awesome ETL

Section: Workflow Management/Engines · "a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in."

SlowScore 74

Awesome MLOps

Section: Workflow Tools · Python module that helps you build complex pipelines of batch jobs.

FreshScore 86

Awesome Open Source AI

Section: 1. Core Frameworks & Libraries · Python module for building complex pipelines of batch jobs. Handles dependency resolution, workflow management, visualization, and Hadoop integration. Built at Spotify and battle-tested in production. Apache 2.0 licensed.

FreshScore 87

Awesome Pipeline

Section: Pipeline frameworks & libraries · Python module that helps you build complex pipelines of batch jobs.

FreshScore 82

Awesome Production Machine Learning

Section: Data Pipeline · Luigi is a Python module that helps you build complex pipelines of batch jobs, handling dependency resolution, workflow management, visualisation, etc..

FreshScore 98

awesome-python

Section: Data Science and Analytics · Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

FreshScore 79

Awesome Robotic Tooling

Section: Server Infrastructure and High Performance Computing · A Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

StaleScore 54

Best Of Python

Section: luigi (30 · 19K) - Luigi is a Python module that helps you build complex pipelines of batch.. Apache-2 · (👨‍💻 640 · 🔀 2.5K · 📦 2.9K):

FreshScore 94

Awesome AI Agents: Tools, Resources, and Projects

Section: Workflows · Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…

SlowScore 66

Table of Contents

Section: Python Frameworks, Libraries, and Tools · is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built-in.

SlowScore 40

Taskade

Taskade AI is an AI-powered productivity suite offering tools like task and project management, notes, docs, mind maps, and AI chat to enhance team productivity and automate over 700 tasks website | github | twitter | youtube

In 33 listsDetails

Notion

write, plan, collaborate, and get organized. Notion is all you need — in one tool.

In 17 listsDetails

Redash

🆓 Connect and query your data sources, build dashboards to visualize data and share them with your company. Owned by Databricks but the hosted SaaS shut down in 2021, so the project is now community-maintained under the Databricks org with no paid Redash product.

In 12 listsDetails

Beekeeper Studio

is a cross-platform SQL editor and database manager(MySQL, Postgres, SQLite, SQL Server, and more.) available for Linux, Mac, and Windows.

In 10 listsDetails

Zapier

Automation tool that allows you to connect hundreds of web services and create automations between the processes.

In 10 listsDetails

DataGrip

is a professional DataBase IDE developed by Jet Brains that provides context-sensitive code completion, helping you to write SQL code faster. Completion is aware of the tables structure, foreign keys, and even database objects created in code you're editing.

In 8 listsDetails

n8n

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

In 10 listsDetails

MySQL

is a fully managed database service to deploy cloud-native applications using the world's most popular open source database.

In 9 listsDetails