Awesome Ai Agents 2026
Section: Tracing and Monitoring · OSS LLM observability. One-line integration.
ActiveScore 74
Entry
Helicone
Appears in 8 awesome lists
Open-source LLM observability proxy (YC W23) with the largest open-source pricing database (300+ models). One-line proxy integration provides cost tracking, token monitoring, session tracing, and prompt versioning across providers. The AI Gateway component handles request routing and caching with…
Open github.comhelicone/helicone
Found in these lists
Awesome Ai Sdks
Section: Links
ActiveScore 70
awesome-ChatGPT-repositories
Section: Prompts · 🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. 🍓 YC W23
FreshScore 87
Awesome GPT-4
Section: Open-source projects · GPT4 Monitoring and Observability.
StaleScore 52
Awesome Harness Engineering
Section: Observability & Tracing · Open-source LLM observability proxy (YC W23) with the largest open-source pricing database (300+ models). One-line proxy integration provides cost tracking, token monitoring, session tracing, and prompt versioning across providers. The AI Gateway component handles request routing and caching with…
FreshScore 88
Awesome LLMOps
Section: Observability · Open source LLM observability platform. One line of code to monitor, evaluate, and experiment with features like prompt management, agent tracing, and evaluations.
ActiveScore 75
Awesome Open Source AI
Section: 8. MLOps / LLMOps & Production · Open-source LLM observability with request logging, caching, rate limiting, and cost analytics.
FreshScore 89
Awesome Production Machine Learning
Section: Evaluation and Monitoring · Helicone is the all-in-one, open-source LLM developer platform.
FreshScore 92
Often listed next to it
promptfoo
Test your prompts, models, RAGs. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality. LLM evals for OpenAI/Azure GPT, Anthropic Claude, VertexAI Gemini, Ollama, Local & private models like Mistral/Mixtral/Llama with CI/CD
In 11 listsDetails
Prompt Engineering Guide
🐙 Guides, papers, lecture, notebooks and resources for prompt engineering
In 11 listsDetails
Phoenix
Open-source AI observability & evaluation platform (Arize) — OpenTelemetry-native tracing for agents, LLM-as-judge evals, versioned datasets & experiments for prompt regression testing, prompt management with version control and replay, plus an MCP endpoint so Claude Code/Cursor can query traces…
In 10 listsDetails
Langfuse
The most widely adopted self-hostable LLM observability platform: traces every agent step, manages prompt versions, and runs evals in one tool. Preferred over cloud-only alternatives when data residency or cost control is a constraint.
In 10 listsDetails
DocsGPT
Private AI platform for building intelligent agents and assistants with enterprise search. Features Agent Builder, deep research tools, multi-format document analysis, and multi-model support. MIT licensed.
In 10 listsDetails
DemoGPT
DemoGPT enables you to create quick demos by just using prompt. It applies ToT approach on Langchain documentation tree.
In 9 listsDetails
Portkey AI Gateway
🟢🟠 — Open AI gateway with provider routing, fallback and retry controls, guardrail integrations, observability, and MCP traffic support for model and agent applications. (Portkey) — note: the gateway is general infrastructure rather than a standalone security scanner; model-provider…
In 6 listsDetails