Awesome Big Data
Section: Search engine and framework · open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.
Entry
Appears in 5 awesome lists
Full-text search and data analytics, with fast response time for small, medium and big data (alternative to Elasticsearch). GPL-3.0 Docker/deb/C++/K8S
Section: Search engine and framework · open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.
Section: Databases · An open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.
Section: 5. Retrieval-Augmented Generation (RAG) & Knowledge · Easy to use open source fast database for search. Good alternative to Elasticsearch with SQL-like interface and vector search capabilities.
Section: Search Engines · Full-text search and data analytics, with fast response time for small, medium and big data (alternative to Elasticsearch). GPL-3.0 Docker/deb/C++/K8S
Section: Other · Open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.
(MIT) provides modules for structured outputs at different levels of abstraction, including output parsers for text completion endpoints, Pydantic programs for mapping prompts to structured outputs using function calling or output parsing, and pre-defined Pydantic programs for specific output types.
Milvus is a cloud-native, open-source vector database built to manage embedding vectors generated by machine learning models and neural networks.
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…
Infrastructure for log storage, processing, and visualization rather than a complete SIEM. Elastic relicensed Elasticsearch and Kibana back to open source in 2024 under a dual license: AGPL-3.0 or Elastic License 2.0, with the core stack freely available under AGPL. However, SIEM-relevant features…
TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.
is a library for efficient similarity search and clustering of dense vectors. It contains algorithms that search in sets of vectors of any size, up to ones that possibly do not fit in RAM. It also contains supporting code for evaluation and parameter tuning. Faiss is written in C++ with complete…
Python tool for converting files and office documents to Markdown. Supports PDF, PowerPoint, Word, Excel, images, audio, HTML, and more with OCR and transcription capabilities. MIT licensed.