Skip to content

Entry

CocoIndex

Appears in 8 awesome lists

Incremental data transformation engine for AI pipelines with built-in chunking, embedding, and source connectors that recomputes only the inputs that changed. Apache-2.0 licensed.

Open github.comcocoindex-io/cocoindex

Found in these lists

Awesome Data Engineering

Section: Stream Processing · An open source ETL framework to build fresh index for AI.

FreshScore 93

Awesome LLMOps

Section: Data/Feature enrichment · An ETL framework for AI that transforms data into embeddings and knowledge graphs, with incremental processing to recompute only what changed and keep indexes fresh.

FreshScore 91

Awesome Open Source AI

Section: 5. Retrieval-Augmented Generation (RAG) & Knowledge · Incremental data transformation engine for AI pipelines with built-in chunking, embedding, and source connectors that recomputes only the inputs that changed. Apache-2.0 licensed.

FreshScore 87

Awesome Pipeline

Section: Pipeline frameworks & libraries · ETL framework to build fresh index.

FreshScore 82

awesome-python

Section: LLM and Inference · Incremental engine for long horizon agents Star if you like it!

FreshScore 79

Awesome Vector Search

Section: Library

ActiveScore 71

Best Of Python

Section: CocoIndex (24 · 6.1K) - Data transformation framework for AI. Ultra performant, with.. Apache-2 · (👨‍💻 110 · 🔀 450 · 📦 81):

FreshScore 94

Awesome Rust

Section: MLOps · ETL framework to build fresh context for AI agents, with incremental processing

FreshScore 81

LlamaIndex

(MIT) provides modules for structured outputs at different levels of abstraction, including output parsers for text completion endpoints, Pydantic programs for mapping prompts to structured outputs using function calling or output parsing, and pre-defined Pydantic programs for specific output types.

In 14 listsDetails

Milvus

Milvus is a cloud-native, open-source vector database built to manage embedding vectors generated by machine learning models and neural networks.

In 14 listsDetails

Haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…

In 13 listsDetails

FAISS

is a library for efficient similarity search and clustering of dense vectors. It contains algorithms that search in sets of vectors of any size, up to ones that possibly do not fit in RAM. It also contains supporting code for evaluation and parameter tuning. Faiss is written in C++ with complete…

In 9 listsDetails

MarkItDown

Python tool for converting files and office documents to Markdown. Supports PDF, PowerPoint, Word, Excel, images, audio, HTML, and more with OCR and transcription capabilities. MIT licensed.

In 9 listsDetails

DocsGPT

Private AI platform for building intelligent agents and assistants with enterprise search. Features Agent Builder, deep research tools, multi-format document analysis, and multi-model support. MIT licensed.

In 10 listsDetails

Chroma

An open-source embedding database for building AI applications with semantic search.

In 8 listsDetails

Infinity

AI-native database built for LLM applications with incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text. Powers RAGFlow's document engine. Apache 2.0 licensed.

In 9 listsDetails