Awesome Ai Sdks
Section: Links
ActiveScore 70
Entry
Helicone
Appears in 5 awesome lists
Helicone is an open-source observability platform for Language Learning Models (LLMs), providing features like request logging, caching, rate limiting, cost and latency tracking, UI-based prompt iteration, and collaboration tools website | github
Found in these lists
Awesome Developer-First
Section: Monitoring · LLM observabilty and monitoring for your LLM apps in production.
FreshScore 84
Awesome Generative AI Data Scientist
Section: LLMOps · Open-source LLM observability platform for developers to monitor, debug, and improve production-ready applications.
SlowScore 52
Awesome AI Agents: Tools, Resources, and Projects
Section: Repositories · Helicone is an open-source observability platform for Language Learning Models (LLMs), providing features like request logging, caching, rate limiting, cost and latency tracking, UI-based prompt iteration, and collaboration tools website | github
SlowScore 68
Awesome Generative AI
Section: Developer tools · Open-source LLM observability platform for logging, monitoring, and debugging AI applications. #opensource
FreshScore 90
Often listed next to it
Langfuse
LLM engineering platform for model tracing, prompt management, and application evaluation. Langfuse helps teams collaboratively debug, analyze, and iterate on their LLM applications such as chatbots or AI agents. (Demo, Source Code, Clients) MIT Docker
In 10 listsDetails
Pinecone
The Pinecone vector database makes it easy to build high-performance vector search applications. Developer-friendly, fully managed, and easily scalable without infrastructure hassles.
In 8 listsDetails
Maxim AI
The agent simulation, evaluation, and observability platform helping product teams ship their AI applications with the quality and speed needed for real-world use.
In 8 listsDetails
Helicone
Open-source LLM observability proxy (YC W23) with the largest open-source pricing database (300+ models). One-line proxy integration provides cost tracking, token monitoring, session tracing, and prompt versioning across providers. The AI Gateway component handles request routing and caching with…
In 8 listsDetails
Sentry
is a service that helps you monitor and fix crashes in realtime. The server is in Python, but it contains a full API for sending events from any language, in any application.
In 8 listsDetails
Opik
Open source engineering platform to debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. (Source Code)
In 6 listsDetails
Agenta
Agenta provides end-to-end tools for the entire LLMOps workflow: building (LLM playground, evaluation), deploying (prompt and configuration management), and (LLM observability and tracing).
In 6 listsDetails
Middleware
A Full-Stack Cloud Observability Platform designed to empower developers and organizations to monitor, optimize, and streamline their applications and infrastructure in real-time.
In 6 listsDetails