Awesome Data Engineering
Section: Databases · Declarative multimodal AI data engine providing versioned tables, computed columns, incremental transformation, and vector search.
Entry
Appears in 4 awesome lists
Declarative multimodal AI data engine providing versioned tables, computed columns, and native LangChain VectorStore (langchain-pixeltable) and LangGraph memory store (langgraph-store-pixeltable) integrations.
Section: Databases · Declarative multimodal AI data engine providing versioned tables, computed columns, incremental transformation, and vector search.
Section: Platforms · Declarative multimodal AI data engine providing versioned tables, computed columns, and native LangChain VectorStore (langchain-pixeltable) and LangGraph memory store (langgraph-store-pixeltable) integrations.
Section: Data Storage · Declarative multimodal AI data engine for versioned tables, computed columns, and vector search.
Section: Data Pipeline · Open-source Python library providing declarative, incremental data infrastructure for building and managing multimodal AI workloads.
Infrastructure for log storage, processing, and visualization rather than a complete SIEM. Elastic relicensed Elasticsearch and Kibana back to open source in 2024 under a dual license: AGPL-3.0 or Elastic License 2.0, with the core stack freely available under AGPL. However, SIEM-relevant features…
Data version control for your data lake that transforms object storage into Git-like repositories. Enables atomic, versioned data lake operations with branching, committing, and merging for data pipelines. Apache 2.0 licensed.
TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.
General purpose, document-based, distributed database built for modern applications. free paid self-hosted
A high-performance Cloud-Native file system driven by object storage for large-scale data storage.
The lightweight, fault-tolerant database built on SQLite. Designed to keep your data highly available with minimal effort.
OpenTelemetry-based instrumentation for LLM calls and agent steps: adds trace spans to every inference and tool call without modifying business logic. The cleanest way to bring the existing OTEL ecosystem (Grafana, Datadog, Jaeger) to a harness.