Awesome Data Engineering
Section: Databases · The Hadoop database, a distributed, scalable, big data store.
Entry
Appears in 4 awesome lists
is an open-source, NoSQL, distributed big data store. It enables random, strictly consistent, real-time access to petabytes of data. HBase is very effective for handling large, sparse datasets. HBase serves as a direct input and output to the Apache MapReduce framework for Hadoop, and works with…
Section: Databases · The Hadoop database, a distributed, scalable, big data store.
Section: Scalability
Section: Databases · is an open-source, NoSQL, distributed big data store. It enables random, strictly consistent, real-time access to petabytes of data. HBase is very effective for handling large, sparse datasets. HBase serves as a direct input and output to the Apache MapReduce framework for Hadoop, and works with…
Section: SQL/NoSQL Tools and Databases · is an open-source, NoSQL, distributed big data store. It enables random, strictly consistent, real-time access to petabytes of data. HBase is very effective for handling large, sparse datasets. HBase serves as a direct input and output to the Apache MapReduce framework for Hadoop, and works with…
Infrastructure for log storage, processing, and visualization rather than a complete SIEM. Elastic relicensed Elasticsearch and Kibana back to open source in 2024 under a dual license: AGPL-3.0 or Elastic License 2.0, with the core stack freely available under AGPL. However, SIEM-relevant features…
is a cross-platform SQL editor and database manager(MySQL, Postgres, SQLite, SQL Server, and more.) available for Linux, Mac, and Windows.
TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.
General purpose, document-based, distributed database built for modern applications. free paid self-hosted
The lightweight, fault-tolerant database built on SQLite. Designed to keep your data highly available with minimal effort.
is an open-source workflow management platform created by the community to programmatically author, schedule and monitor workflows. Install. Principles. Scalable. Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers. Airflow is ready to scale to…