Skip to content

Entry

Haystack

Appears in 5 awesome lists

A framework for building NLP applications (e.g. agents, semantic search, question-answering) with language models.

Open haystack.deepset.ai

Found in these lists

Awesome AI Coding Tools

Section: AI Frameworks and SDKs · Open-source framework for building production-ready LLM applications, RAG pipelines, and agents.

FreshScore 85

Awesome AI Tools

Section: Developer tools · A framework for building NLP applications (e.g. agents, semantic search, question-answering) with language models.

SlowScore 67

Awesome Generative AI Data Scientist

Section: AI Frameworks (Build Your Own) · Deepset AI's open-source AI orchestration framework for building customizable, production-ready LLM applications.

SlowScore 52

awesome-huggingface

Section: Question Answering · (from deepset) - End-to-end framework for developing and deploying question-answering systems in the wild.

ArchivedScore 49

Awesome Generative AI

Section: Developer tools · A framework for building NLP applications (e.g. agents, semantic search, question-answering) with language models.

FreshScore 90

LiteLLM

Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider…

In 16 listsDetails

AutoGen

Microsoft's multi-agent conversation framework with a complete AgentChat layer covering agent loop, tool integration, termination conditions, and human-in-the-loop. The most comprehensive open-source reference for large-scale multi-agent harness design.

In 14 listsDetails

promptfoo

Test your prompts, models, RAGs. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality. LLM evals for OpenAI/Azure GPT, Anthropic Claude, VertexAI Gemini, Ollama, Local & private models like Mistral/Mixtral/Llama with CI/CD

In 11 listsDetails

Semantic Kernel

Semantic Kernel is an SDK that integrates Large Language Models (LLMs) like OpenAI, Azure OpenAI, and Hugging Face with conventional programming languages like C#, Python, and Java. Semantic Kernel achieves this by allowing you to define plugins that can be chained together in just a few lines of…

In 11 listsDetails

Langfuse

LLM engineering platform for model tracing, prompt management, and application evaluation. Langfuse helps teams collaboratively debug, analyze, and iterate on their LLM applications such as chatbots or AI agents. (Demo, Source Code, Clients) MIT Docker

In 10 listsDetails

gpt4all

is an ecosystem of open-source chatbots trained on a massive collections of clean assistant data including code, stories and dialogue based on LLaMa.

In 11 listsDetails

Plandex

Terminal-based AI coding agent with REPL mode for planning and executing complex tasks across multiple files, 2M token context.

In 9 listsDetails

Ollama

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models. (Source Code) MIT Docker/Python

In 8 listsDetails