Skip to content

Entry

LLM App

Appears in 5 awesome lists

LLM App is a Python library that helps you build real-time LLM-enabled data pipelines with few lines of code.

Open github.compathwaycom/llm-app

Found in these lists

Awesome Generative AI

Section: LLMOps · LLM App is a Python library that helps you build real-time AI-powered data pipelines with few lines of code.

SlowScore 58

Awesome LLMOps

Section: LLMOps · LLM App is a Python library that helps you build real-time LLM-enabled data pipelines with few lines of code.

FreshScore 91

Awesome local LLM

Section: Retrieval-Augmented Generation · ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data

FreshScore 90

Awesome Vector Search

Section: Library

ActiveScore 71

Awesome Generative AI

Section: Developer tools · Open-source Python library to build real-time LLM-enabled data pipeline.

FreshScore 90

Opik

Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…

In 18 listsDetails

LiteLLM

Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider…

In 16 listsDetails

Dify

February 2026 release making human oversight a native workflow primitive: suspend execution at critical decision points, expose review-and-edit UI mid-flow, and route subsequent execution based on human action (approve/reject/escalate). Demonstrates how HITL transitions from bolt-on approval gates…

In 14 listsDetails

Haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…

In 13 listsDetails

Phoenix

Open-source AI observability & evaluation platform (Arize) — OpenTelemetry-native tracing for agents, LLM-as-judge evals, versioned datasets & experiments for prompt regression testing, prompt management with version control and replay, plus an MCP endpoint so Claude Code/Cursor can query traces…

In 12 listsDetails

Langfuse

The most widely adopted self-hostable LLM observability platform: traces every agent step, manages prompt versions, and runs evals in one tool. Preferred over cloud-only alternatives when data residency or cost control is a constraint.

In 11 listsDetails

Helicone

Open-source LLM observability proxy (YC W23) with the largest open-source pricing database (300+ models). One-line proxy integration provides cost tracking, token monitoring, session tracing, and prompt versioning across providers. The AI Gateway component handles request routing and caching with…

In 9 listsDetails

GPTCache

@ferret_db @ossinsight @milvusio we'd love to get a ferretdb backend for gptcache. we'll add it to the todo list.and on behalf of milvus developers and the broader community, thanks for the shout-out!

In 9 listsDetails