Skip to content

Entry

Pathway

Appears in 7 awesome lists

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG. Features 350+ connectors with always-in-sync data from SharePoint, Google Drive, S3, Kafka, PostgreSQL and more. BSL 1.1 license (becomes Apache 2.0 after 4 years).

Open github.compathwaycom/pathway

Found in these lists

Awesome Ai Agents 2026

Section: RAG and Knowledge Bases · Live data RAG. Real-time streaming. 50k+ stars.

ActiveScore 70

Awesome Data Engineering

Section: Stream Processing · Performant open-source Python ETL framework with Rust runtime, supporting 300+ data sources.

FreshScore 93

Awesome local LLM

Section: Retrieval-Augmented Generation · Python ETL framework for stream processing, real-time analytics, LLM pipelines and RAG

FreshScore 90

Awesome Open Source AI

Section: 5. Retrieval-Augmented Generation (RAG) & Knowledge · Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG. Features 350+ connectors with always-in-sync data from SharePoint, Google Drive, S3, Kafka, PostgreSQL and more. BSL 1.1 license (becomes Apache 2.0 after 4 years).

FreshScore 87

Awesome Pipeline

Section: Extract, transform, load (ETL) · Performant open-source Python ETL framework with Rust runtime, supporting 300+ data sources.

FreshScore 82

awesome-python

Section: Data Science and Analytics · Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

FreshScore 79

Awesome Rust

Section: Data processing · Performant open-source Python ETL framework with Rust runtime, supporting 300+ data sources.

FreshScore 81

mem0

The most-deployed memory layer for AI agents — drop-in add/search/update/delete fact storage with LLM-extracted long-term / short-term / semantic memory: automatic fact consolidation (dedup, contradiction resolution, decay) so agents keep "context that persists" without context bloat;…

In 14 listsDetails

Milvus

Milvus is a cloud-native, open-source vector database built to manage embedding vectors generated by machine learning models and neural networks.

In 14 listsDetails

Haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…

In 13 listsDetails

Chroma

An open-source embedding database for building AI applications with semantic search.

In 8 listsDetails

Weaviate

An open source vector database that stores both objects and vectors, allowing for combining vector search with structured filtering with the fault-tolerance and scalability of a cloud-native database, all accessible through GraphQL, REST, and various language clients.

In 8 listsDetails

Qdrant

Vector Search Engine and Database for the next generation of AI applications. Also available in the cloud

In 8 listsDetails

CocoIndex

Incremental data transformation engine for AI pipelines with built-in chunking, embedding, and source connectors that recomputes only the inputs that changed. Apache-2.0 licensed.

In 8 listsDetails

RAGFlow

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

In 7 listsDetails