Awesome Big Data
Section: Service Programming · a Python package for building complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, handling failures, command line integration, and much more.
Entry
Appears in 15 awesome lists
Python module for building complex pipelines of batch jobs. Handles dependency resolution, workflow management, visualization, and Hadoop integration. Built at Spotify and battle-tested in production. Apache 2.0 licensed.
Section: Service Programming · a Python package for building complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, handling failures, command line integration, and much more.
Section: General · by Spotify
Section: Build And Release System · Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Section: Tools · A Python module for building complex and batch-oriented data pipelines.
Section: Workflow · A Python module that helps you build complex pipelines of batch jobs.
Section: Workflow Management/Engines · "a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in."
Section: Workflow Tools · Python module that helps you build complex pipelines of batch jobs.
Section: 1. Core Frameworks & Libraries · Python module for building complex pipelines of batch jobs. Handles dependency resolution, workflow management, visualization, and Hadoop integration. Built at Spotify and battle-tested in production. Apache 2.0 licensed.
Section: Pipeline frameworks & libraries · Python module that helps you build complex pipelines of batch jobs.
Section: Data Pipeline · Luigi is a Python module that helps you build complex pipelines of batch jobs, handling dependency resolution, workflow management, visualisation, etc..
Section: Data Science and Analytics · Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Section: Server Infrastructure and High Performance Computing · A Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Section: luigi (30 · 19K) - Luigi is a Python module that helps you build complex pipelines of batch.. Apache-2 · (👨💻 640 · 🔀 2.5K · 📦 2.9K):
Section: Workflows · Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
Section: Python Frameworks, Libraries, and Tools · is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built-in.
Taskade AI is an AI-powered productivity suite offering tools like task and project management, notes, docs, mind maps, and AI chat to enhance team productivity and automate over 700 tasks website | github | twitter | youtube
write, plan, collaborate, and get organized. Notion is all you need — in one tool.
🆓 Connect and query your data sources, build dashboards to visualize data and share them with your company. Owned by Databricks but the hosted SaaS shut down in 2021, so the project is now community-maintained under the Databricks org with no paid Redash product.
is a cross-platform SQL editor and database manager(MySQL, Postgres, SQLite, SQL Server, and more.) available for Linux, Mac, and Windows.
Automation tool that allows you to connect hundreds of web services and create automations between the processes.
is a professional DataBase IDE developed by Jet Brains that provides context-sensitive code completion, helping you to write SQL code faster. Completion is aware of the tables structure, foreign keys, and even database objects created in code you're editing.