Skip to content

Entry

Weave Router

Appears in 4 awesome lists

Self-hostable drop-in proxy for the Anthropic Messages, OpenAI Chat Completions and Gemini APIs that picks a model for each request with an on-box embedder; supports BYOK and OTLP traces and works with Claude Code, Codex, opencode and pi. Apache 2.0 licensed.

Open github.comweave-os/router

Found in these lists

Awesome Open Source AI

Section: 3. Inference Engines & Serving · Self-hostable drop-in proxy for the Anthropic Messages, OpenAI Chat Completions and Gemini APIs that picks a model for each request with an on-box embedder; supports BYOK and OTLP traces and works with Claude Code, Codex, opencode and pi. Apache 2.0 licensed.

FreshScore 87

Awesome Production Machine Learning

Section: Deployment and Serving · Weave Router is a self-hostable, BYOK drop-in proxy for the Anthropic Messages, OpenAI Chat Completions and Gemini APIs that picks a model for each request with an on-box embedder and exports OTLP traces.

FreshScore 98

awesome-go

Section: Other · Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change.

FreshScore 79

Awesome Harness Engineering

Section: Runtime Foundations & Control Layers · Apache-2.0 drop-in proxy for the Anthropic, OpenAI and Gemini APIs that sits under harnesses like Claude Code, Codex, opencode and pi and picks the model for each request with an on-box embedder; self-hostable, BYOK, OTLP traces.

FreshScore 93

LiteLLM

Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider…

In 16 listsDetails

Milvus

Milvus is a cloud-native, open-source vector database built to manage embedding vectors generated by machine learning models and neural networks.

In 14 listsDetails

LocalAI

robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video,…

In 14 listsDetails

Ollama

Ollama is a tool for running large language models locally, offering easy setup for macOS, Windows, Linux, and Docker, along with a library of models and quickstart guides for customization and integration github | github profile

In 13 listsDetails

prometheus

/mysqld_exporter - Time series database for real-time monitoring and alerting.

In 13 listsDetails

Open WebUI

Open WebUI is an extensible, feature-rich, and user-friendly self-hosted AI platform designed to operate entirely offline. It supports various LLM runners like Ollama and OpenAI-compatible APIs, with built-in inference engine for RAG, making it a powerful AI deployment solution.

In 12 listsDetails

llama.cpp

Pure C/C++ inference engine with GGUF format support. The gold standard for CPU/GPU/Apple Silicon on-device running. Includes llama-server for OpenAI-compatible API. Now at 100K+ stars.

In 12 listsDetails

fx

Command-line JSON processing tool by anononymus JavaScript functions

In 12 listsDetails