Skip to content
91

Awesome LLMOps

An awesome & curated list of best LLMOps tools for developers

6k stars1,344 forks501 entriesLast push Nov 16, 2026 (today)License CC0-1.0

This page lists names, links and short descriptions. The original list on GitHub is the source and belongs to its authors.

Model >Large Language Model

Alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

In 5 listsDetails

BELLE

A 7B Large Language Model fine-tune by 34B Chinese Character Corpus, based on LLaMA and Alpaca.

In 3 lists

Bloom

BigScience Large Open-science Open-access Multilingual Language Model

dolly

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

In 4 lists

Falcon 40B

Falcon-40B-Instruct is a 40B parameters causal decoder-only model built by TII based on Falcon-40B and finetuned on a mixture of Baize. It is made available under the Apache 2.0 license.

FastChat (Vicuna)

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.

In 11 listsDetails

Gemma

Gemma is a family of lightweight, open models built from the research and technology that Google used to create the Gemini models.

GLM-6B (ChatGLM)

An Open Bilingual Pre-Trained Model, quantization of ChatGLM-130B, can run on consumer-level GPUs.

In 3 lists

ChatGLM2-6B

ChatGLM2-6B is the second-generation version of the open-source bilingual (Chinese-English) chat model ChatGLM-6B.

In 2 lists

GLM-130B (ChatGLM)

An Open Bilingual Pre-Trained Model (ICLR 2023)

In 4 lists

GPT-NeoX

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

In 3 lists

Jebadiah

Open decision models that return a probability for each option instead of generating text; available in 4B, 9B and 27B sizes.

In 2 lists

Luotuo

A Chinese LLM, Based on LLaMA and fine tune by Stanford Alpaca, Alpaca LoRA, Japanese-Alpaca-LoRA.

Mixtral-8x7B-v0.1

The Mixtral-8x7B Large Language Model (LLM) is a pretrained generative Sparse Mixture of Experts.

StableLM

StableLM: Stability AI Language Models

In 5 listsDetails

Model >CV Foundation Model

disco-diffusion

A frankensteinian amalgamation of notebooks, models and techniques for the generation of AI Art and Animations.

In 3 lists

midjourney

Midjourney is an independent research lab exploring new mediums of thought and expanding the imaginative powers of the human species.

In 2 listsLink may be dead

segment-anything (SAM)

produces high quality object masks from input prompts such as points or boxes, and it can be used to generate masks for all objects in an image.

In 2 lists

stable-diffusion

A latent text-to-image diffusion model

In 2 lists

Model >Audio Foundation Model

bark

Bark is a transformer-based text-to-audio model created by Suno. Bark can generate highly realistic, multilingual speech as well as other audio - including music, background noise and simple sound effects.

In 6 listsDetails

FunASR

Speech recognition toolkit with pretrained models and tools for voice activity detection, punctuation restoration, and speaker diarization.

In 12 listsDetails

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

In 13 listsDetails

Model >Robotics Foundation Model

LeRobot

A central community library by Hugging Face for AI in robotics — end-to-end learning tools, data pipelines, and support for training/deploying VLA models.

In 6 listsDetails

Octo

A transformer-based generalist robot policy pretrained on 800K+ robot trajectories from the Open X-Embodiment dataset. Supports language instructions, goal images, and fine-tuning to new embodiments.

OpenPI

Open-source VLA models from Physical Intelligence, including π₀ and π₀.5 — flow-based vision-language-action models pretrained on large-scale robot data with fine-tuning support.

In 2 lists

OpenVLA

A 7B-parameter open-source Vision-Language-Action model trained on 970K+ robot demonstrations from the Open X-Embodiment dataset for generalist robotic manipulation.

SmolVLA

A compact ~450M parameter VLA by Hugging Face, designed to be computationally efficient and accessible, running on consumer GPUs or CPUs. Part of the LeRobot ecosystem.

Serving >Large Model Serving

Alpaca-LoRA-Serve

Alpaca-LoRA as Chatbot service

Higgs

Rust inference server for Apple Silicon: MLX models behind OpenAI and Anthropic APIs, routing to remote providers, desktop dashboard.

In 2 lists

OneComp

Fujitsu Research's post-training quantization pipeline for LLMs (QEP, AutoBit, JointQ, rotation) with vLLM plugin (arXiv:2603.28845).

In 2 lists

CTranslate2

fast inference engine for Transformer models in C++

In 3 lists

Clip-as-a-service

serving the OpenAI CLIP model

In 2 lists

DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

Faster Whisper

fast inference engine for whisper in C++ using CTranslate2.

In 3 lists

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios. (Archived)

In 2 lists

Flowise

Drag & drop UI to build your customized LLM flow using LangchainJS.

In 12 listsDetails

lilbee

Single-binary local manager and search engine that stands up a llama-server fleet sized to your GPUs by gguf-parser for VRAM-aware multi-GPU placement

In 3 lists

llama.cpp

Port of Facebook's LLaMA model in C/C++

In 7 listsDetails

LLMKube

Kubernetes operator for LLM inference with pluggable runtimes (llama.cpp, PersonaPlex/Moshi, generic), multi-GPU sharding, NVIDIA CUDA and Apple Silicon Metal support, and GGUF/MLX/SafeTensors model formats.

Shimmy

Python-free Rust inference server with OpenAI API compatibility and hot model swapping

In 7 listsDetails

Infinity

Rest API server for serving text-embeddings

In 2 lists

Kapitsa

Native C++ LLM inference engine for Apple silicon (Metal kernels and the Neural Engine) with OpenAI- and Anthropic-compatible APIs

In 2 lists

Modelz-LLM

OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)

NobodyWho

On-device LLM inference engine (Rust / llama.cpp) to embed local models directly in games and apps, with Godot / Flutter / React Native / Swift bindings; streaming, embeddings, tool calling, GBNF-structured output, and STT/TTS.

In 5 listsDetails

Off Grid

Open-source iOS/Android app running LLMs on-device via llama.cpp. Voice (Whisper), vision, image gen, tool calling — fully offline.

In 2 lists

Ollama

Serve Llama 2 and other large language models locally from command line or through a browser interface.

In 4 listsDetails

Rapid-MLX

OpenAI-compatible LLM inference server for Apple Silicon using MLX. 2-4x faster than Ollama with tool calling and prompt caching.

In 6 listsDetails

TensorRT-LLM

Inference engine for TensorRT on Nvidia GPUs

In 8 listsDetails

text-generation-inference

Large Language Model Text Generation Inference

In 3 lists

text-embeddings-inference

Inference for text-embedding models

In 2 lists

tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

In 6 listsDetails

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs.

In 11 listsDetails

whisper-ctranslate2

is a 4x faster and low-memory usage drop-in cli replacement that supports word-level timestamps and VAD filter

In 4 lists

whisper.cpp

Port of OpenAI's Whisper model in C/C++

In 5 listsDetails

x-stable-diffusion

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. (Archived)

Serving >Frameworks/Servers for Serving

BentoML

The Unified Model Serving Framework

In 7 listsDetails

Bifrost

High-performance AI gateway written in Go. Unifies 23+ providers behind one OpenAI-compatible endpoint with automatic failover, adaptive load balancing, semantic caching, virtual keys and budgets, MCP tool calling, and native Prometheus observability.

In 11 listsDetails

Dynamo

NVIDIA's datacenter-scale distributed inference framework. Runs vLLM, SGLang or TensorRT-LLM as workers and adds disaggregated prefill/decode, KV-cache-aware routing and multi-node scheduling.

In 4 listsDetails

Jina

Build multimodal AI services via cloud native technologies · Model Serving · Generative AI · Neural Search · Cloud Native

In 3 lists

Mosec

A machine learning model serving framework with dynamic batching and pipelined stages, provides an easy-to-use Python interface.

In 2 lists

mcpproxy-go

Open-source MCP proxy with BM25 tool filtering, quarantine security, activity logging, and web UI. Routes multiple MCP servers through single endpoint, reducing context bloat by ~97%.

SentryNode Gateway

Open-core AI inference governance and FinOps platform providing semantic routing, <40ms agent loop intervention, strict budget caps, and cryptographic audit trails. Includes voice pipeline governance (STT→LLM→TTS).

TFServing

A flexible, high-performance serving system for machine learning models.

In 3 lists

Torchserve

Serve, optimize and scale PyTorch models in production (Archived)

In 2 lists

Triton Server (TRTIS)

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

In 5 listsDetails

langchain-serve

Serverless LLM apps on Production with Jina AI Cloud (Archived)

lanarky

FastAPI framework to build production-grade LLM applications

ray-llm

LLMs on Ray - RayLLM (Archived)

SIE

Open-source inference server and production cluster for serving embeddings, reranking, OCR, structured output, content safety, and generative models through one API.

In 3 lists

Xinference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the…

In 6 listsDetails

KubeAI

Deploy and scale machine learning models on Kubernetes. Built for LLMs, embeddings, and speech-to-text.

Kaito

A Kubernetes operator that simplifies serving and tuning large AI models (e.g. Falcon or phi-3) using container images and GPU auto-provisioning. Includes an OpenAI-compatible server for inference and preset configurations for popular runtimes such as vLLM and transformers.

Julep

Serverless open-source platform for building long-running LLM agents with tool use.

In 3 lists

KubeStellar Console

AI-powered multi-cluster Kubernetes dashboard for hybrid edge and cloud. GPU monitoring, LLM inference cluster management, benchmark streaming, and 20+ CNCF integrations. CNCF Sandbox (Apache 2.0).

In 14 listsDetails

laya-decision-api

FastAPI HTTP service for the local Laya System-1 decision model: offline structured decisions (choice / score / yes-no) with probabilities and confidence; MLX and torch backends

Security >Frameworks for LLM security

API Relay Audit

Local security audit for AI API relays and LLM proxies; checks prompt injection, model identity drift, tool-call rewriting, error leakage, SSE anomalies, and Web3 wallet probes.

In 2 lists

Argus

Open-source red-team testing for AI agents. Selected probes use recorded browser requests, MCP tool calls, or mock payments, with SARIF output and a GitHub Action.

In 2 lists

Argus

OpenAI-compatible gateway that enforces security policy on every LLM call: blocks secrets, redacts PII, and flags prompt injection, with a full audit log that never stores raw secrets or PII.

In 2 lists

Cordum

Safety-first agent orchestration platform with pre-dispatch policy evaluation, output scanning (PII, secrets, injection), job scheduling, workflow engine, and full audit trail.

In 3 lists

brood-box

CLI tool for running coding agents inside hardware-isolated microVMs with snapshot isolation, egress control, and MCP authorization.

In 6 listsDetails

DOS Kernel

Deterministic trust kernel for AI-agent fleets: verifies agent "done" claims from git evidence rather than self-report, arbitrates concurrent file access between agents, and audits commit messages against their own diffs.

In 2 lists

dstack

Open-source confidential AI framework for secure LLM deployment with data privacy, providing hardware-enforced isolation using Intel TDX and NVIDIA Confidential Computing.

In 2 lists

EmbedGuard

Cross-layer detection and provenance attestation for adversarial embedding attacks in RAG systems. Flags poisoned or manipulated embeddings before they reach the retrieval layer.

Plexiglass

A Python Machine Learning Pentesting Toolbox for Adversarial Attacks. Works with LLMs, DNNs, and other machine learning algorithms.

In 2 lists

PrivacyScrubber

Zero-Trust client-side PII and developer secrets sanitizer and MCP server for Cursor, Windsurf, and Claude Desktop with sub-2ms in-memory tokenization.

In 2 lists

PrivAiTe

Self-hosted OpenAI-compatible proxy that reversibly pseudonymizes PII before requests reach the provider, tool-call arguments and multimodal included.

In 2 lists

sayfirst

Local control plane an agent asks before it acts: allow, deny or suspend from a readable policy, with one-person approval and a hash-chained decision record checked offline.

Sentience Governor

Open-source, local-first runtime governance for AI agents: evaluates observed agent actions against declared scope and policy, with the declared objective as context, flags deviations, and records local evidence. Blocking and course correction are available separately as Sentience Runtime…

shim

Open-core AI gateway that redacts PII before prompts reach model providers (Presidio plus Turkish TCKN/VKN recognizers). The source-available enterprise edition adds a tamper-evident hash-chain audit log with daily Merkle anchors as evidence for EU AI Act and KVKK record-keeping.

wardcat

On-premises PII and sensitive-data detection and masking for LLM and RAG workflows, combining regex, NER, and optional local LLMs with reversible masking.

Security >Observability

AgentCost

Track and optimize LLM API costs across OpenAI, Anthropic, and LangChain.

AI observability pack

Grafana dashboards, Prometheus alerts and Zabbix templates for self-hosted inference: vLLM, SGLang, llama.cpp, TEI, Triton, NVIDIA DCGM, KServe, Ray Serve, LiteLLM, Qdrant and Weaviate.

ai-token-cost-scripts

Dependency-free Python scripts that count Claude Code token usage correctly (its logs repeat each response) and price Claude and OpenAI API responses from their usage blocks: where a bill went, caching and Batch API savings, duplicate requests.

Azure OpenAI Logger

"Batteries included" logging solution for your Azure OpenAI instance.

budget-guard

Zero-infra hard spending caps for LLM APIs — blocks before overspending (atomic reservation), per-feature cost attribution, streaming usage, retry-storm detection, and adapters for Vercel AI SDK / LangChain.js / LlamaIndex.TS / Mastra.

ClevAgent

Runtime monitoring for AI agents — heartbeat watchdog, loop detection, cost tracking, auto-restart. Python SDK or HTTP API.

CodeBurn

Local-first cost and token tracking for AI coding agents (Claude Code, Codex, Cursor and 38 more) by project, model and task, with waste detection and plan quota tracking.

In 6 listsDetails

Deepchecks

Tests for Continuous Validation of ML Models & Data. Deepchecks is a Python package for comprehensively validating your machine learning models and data with minimal effort.

In 9 listsDetails

digline

Regression testing for LLM apps: approved scores, prompt and commit pinned as a versioned baseline in your repo; compare says which case got worse and by how much.

Evidently

An open-source framework to evaluate, test and monitor ML and LLM-powered systems.

In 8 listsDetails

EvalView

Regression testing for AI agents. Snapshot behavior, detect tool-call and output regressions, with golden-baseline diffing and LLM-as-judge scoring. Supports LangGraph, CrewAI, OpenAI, Claude, and any HTTP API.

Flowlines

Behavioral observability for production AI agents that detects drift, context loss, constraint violations, and user frustration across sessions.

Giskard

Testing framework dedicated to ML models, from tabular to LLMs. Detect risks of biases, performance issues and errors in 4 lines of code.

In 3 lists

QWED

Deterministic verification protocol for LLM outputs using 8 formal verification engines (SymPy, Z3, AST, SQLGlot). Prevents hallucinations through mathematical proofs rather than statistical methods.

Great Expectations

Always know what to expect from your data.

In 5 listsDetails

Helicone

Open source LLM observability platform. One line of code to monitor, evaluate, and experiment with features like prompt management, agent tracing, and evaluations.

In 9 listsDetails

hermes-rubric

Evidence-first assessment for agent outputs and applications. Synthesizes, loads, or accepts a rubric; collects citations for each dimension; scores against accepted evidence; reports coverage; and emits reproducibility receipts. Apache-2.0.

honeybeepf-llm

eBPF agent that counts LLM API tokens and cost per Kubernetes pod and workload by observing TLS traffic on each node, with no SDK, gateway or code change. Exports Prometheus and OpenTelemetry metrics.

Inferrail

Per-run dollar budgets for AI agents and jobs: an OpenAI- and Anthropic-compatible gateway (in-process or self-hosted) that reserves each call's worst-case cost before it is sent, refuses calls that don't fit before the provider, and keeps a payload-free cost record per run.

JevOss

Test suite for decision-model servers that implement the Jev API: accuracy, probability calibration, and probes for option order, injected instructions, irrelevant padding, yes/no rewording and repeated calls. Apache-2.0.

In 2 lists

Traceloop OpenLLMetry

OpenTelemetry-based observability and monitoring for LLM and agents workflows.

In 8 listsDetails

Langfuse 🪢

Open-source LLM observability platform that helps teams collaboratively debug, analyze, and iterate on their LLM applications.

In 10 listsDetails

LLMTraceFX

Evidence-first measurement for local (MLX, llama.cpp) and OpenAI-compatible LLM inference. Every metric carries its provenance (measured, provider-reported or derived), outputs are checked with deterministic workloads, and a configuration is recommended only when the evidence supports it.

Lookspan

Local-first observability for AI agents. One command (npx lookspan) runs a dashboard with traces, a timeline/waterfall view, cost tracking, replay & LLM-as-judge, and datasets. MCP-native, with OpenAI/Anthropic drop-ins and an OpenTelemetry receiver — data stays on your machine.

whylogs

The open standard for data logging

In 2 lists

Maxim AI

Platform for AI Agent Simulation, Evaluation & Observability

In 9 listsDetails

mcp-reportcard

Report card for MCP server tools: lints tool descriptions, input schemas and safety annotations, measures per-turn token cost, and safely fuzzes error handling. A–F grade, --fail-under gate for CI, GitHub Action and pre-commit hook.

Noveum

AI agent tracing, evaluation datasets from production interactions, and model comparisons on quality, latency, and cost.

onWatch

Lightweight Go CLI that tracks AI API quota usage across 7 providers (Anthropic, OpenAI, GitHub Copilot, MiniMax, and more). Background daemon, <50MB RAM, zero telemetry, SQLite storage.

In 6 listsDetails

OpenGATE

Deterministic verification for evidence-grounded AI — gold-anchored grounding checks (required facts, ungrounded numbers, abstention) with no LLM judge, plus CI regression gates, pytest/DeepEval integrations, and an MCP server.

otelcol-genai-sketches

OpenTelemetry Collector connector that tracks LLM token usage by user and session without a Prometheus cardinality explosion: bounded per-model metrics plus keyed top users and sessions. Includes a tested LiteLLM recipe and a Helm chart.

phoenix2pytest

Reads Arize Phoenix traces flagged as failures and synthesises pytest regression tests, so production-discovered LLM failures feed back into the test suite without manual translation.

RAGeval

Drop-in LLMOps observability platform for RAG with built-in UI and tracing.

runtape

Finds which part of an agent's context caused a bad decision by rerunning it with pieces removed, checks candidate fixes the same way, and writes a pytest regression test. Runs locally with OpenAI, Anthropic, LangGraph and Ollama.

traceAI

Open-source AI tracing framework built on OpenTelemetry for deep observability across agentic and LLM workflows.

In 4 listsDetails

Future AGI

Production-grade SDK for observability, automated evaluations and prompt management with sub-100ms guardrails for LLM/agent workflows.

semantic-coverage

Visualizes RAG knowledge gaps and "blind spots" using 2D UMAP clustering and density detection.

spantruth

Tests LLM instrumentation libraries against a local fake provider and reports where their spans disagree with what the provider sent: tokens, cost, errors and streams. CLI, GitHub Action, and uvx spantruth doctor for your own lock file.

Spend Brake

Self-hostable egress proxy that enforces hard dollar caps on the paid APIs agents call (search, maps, SMS, custom APIs): each call is priced before it leaves and refused with 402 once a cap per key, agent or session would be crossed. Loop detection, kill switch, Prometheus metrics and…

Token Police

SDK (Python, Node) that prices each LLM call before it is made and blocks or reroutes it on per-user, per-session or per-workflow budget rules; prompt text never leaves the app.

tokenecon

Token-economics cost tracking for agent runs: decomposes per-task spend across prompt, completion, tool-call, and retrieval tokens, with tiered routing, budget guardrails, and cost-per-correct-answer metrics; includes a CostTracker for Strands Agents.

In 2 lists

Tracekit

Tamper-evident tracing and policy checks for AI agent tool calls: each call is checked before it runs and signed with its decision into a hash chain, with one .tkb file per run that verifies offline (Python and TypeScript verifiers). Hooks for Claude Code, Codex, Cursor and Gemini CLI;…

In 3 lists

Weco Observe

Observability and debugging tool for AI research agents. Trace multi-step LLM agent runs, visualize decision trees, and identify failure modes in autonomous research workflows. Cloud hosted with open-source agent integration.

In 3 lists

witness

A recording cache for model APIs: one Rust binary that proxies any LLM endpoint, dedupes repeat calls, and writes every model call, MCP tool call, and command side effect into a tamper-evident hash-chained journal with Ed25519 agent identity and Merkle proofs anchored to Sigstore Rekor.

wobbly

Metamorphic testing for LLM extraction — catch wrong outputs with no ground-truth labels: perturb inputs in ways that shouldn't change the answer, flag when they do.

LLMOps

agenta

The LLMOps platform to build robust LLM apps. Easily experiment and evaluate different prompts, models, and workflows to build robust apps.

In 6 listsDetails

agent-convergence-scorer

Zero-dependency Python CLI and library for measuring lexical convergence, exact-match rate, overlap, and divergence across parallel agent runs.

AgentField

Open-source control plane for building and operating AI agents like APIs at scale, with routing, memory, observability, identity, auth, and policy controls.

In 3 lists

Agnos

Gateway-agnostic, self-hosted LLM control plane (MIT): an OpenAI-compatible governance proxy (auth, budgets, guardrails, cost, observability) that runs LiteLLM, Bifrost or Portkey as a swappable, stateless translation engine, so provider keys stay in your own control plane instead of the gateway.

AI Apps That Work

Free tools for people building AI apps: real cost per AI result, LLM prices, model switch costs, shutdown dates, A/B test sizes and judge checks. No sign-up. Also available as a remote MCP server.

AI studio

A Reliable Open Source AI studio to build core infrastructure stack for your LLM Applications. It allows you to gain visibility, make your application reliable, and prepare it for production with features such as caching, rate limiting, exponential retry, model fallback, and more.

AISIX

Open-source AI gateway written in Rust: one OpenAI-compatible API (plus a native Anthropic Messages API) in front of LLM providers, and a gateway for MCP servers and A2A agents, with shared API keys, rate limits, guardrails, caching, and Prometheus/OTLP observability.

In 3 lists

AIWG

Deploys project-owned agents, skills, rules, and governed workflows across AI coding platforms.

In 3 lists

App AI Gateway

Open-source (Apache-2.0) AI gateway for iOS apps: provider keys stay on the server instead of shipping in the app, every request is checked with Apple App Attest, and per-install and per-user rate limits and budgets cap spending. Self-host on Cloudflare or use the hosted service.

ARCI

Regression testing for AI agents in CI: compares a candidate with its baseline over repeated runs, with injected tool faults or from pass/fail results another tool produced, and returns PASS, BLOCK or INCONCLUSIVE from one rule file.

Arize-Phoenix

ML observability for LLMs, vision, language, and tabular models.

In 12 listsDetails

BitRouter

Agent-native LLM router that optimizes your agent with every run — zero harness changes, with every model call reliable, traceable, secure, and cost-effective. Routes across OpenAI, Anthropic, Google, OpenRouter, Bedrock, GitHub Copilot, and more through one local endpoint, with cross-protocol…

In 3 lists

boldrouter

OpenAI-compatible AI gateway developed and hosted in Switzerland, with automatic routing, failover, and unified prepaid billing.

BudgetML

Deploy a ML inference service on a budget in less than 10 lines of code.

In 2 lists

Caliper

Measures whether an agent skill helps: runs real Claude Code, Codex, Pi, or Hermes k times per task with and without the skill, scores task success and skill activation separately, and reports token and wall-time cost.

In 3 lists

Caura

Governed shared memory for AI agent fleets. Multi-agent, multi-tenant and MCP-native, with trust tiers, audit trails, a knowledge graph and self-improving retrieval.

In 2 lists

Cheshire Cat AI

Web framework to create vertical AI agents. FastAPI based, plugin system inspired to WordPress, admin panel, vector DB included

In 3 lists

Chimeraforge

LLM deployment planner and benchmarking CLI: given a model and a GPU it answers will it fit, will it hit your SLO, and what will it cost. Searches model x quantization x backend x GPU count against VRAM, quality, latency, cost, energy and an opt-in safety gate; models tensor/pipeline parallelism,…

claude-router

Local prompt router that picks the right Claude model tier and prepends the right scaffold using local embeddings, before the API call.

CogniCore

Structured experience memory and learning infrastructure for AI agents, providing verified experience reuse, failure learning, environment-aware validity, and cross-session/cross-agent memory.

Contexto

Self-hosted context engine for AI agents with persistent conversation memory and recall. Works as a drop-in OpenAI-compatible proxy, OpenClaw plugin, or memory SDK — no code changes required.

Copilotz

Open-source TypeScript runtime for apps used by people, the app's own agents and AI assistants over MCP, with one set of Actions, access rules and audit record for every caller. Runs on Node.js 24+, Deno and Bun.

Cortex

Generates typed MCP servers, interactive API documentation, and SDKs from OpenAPI, AsyncAPI, GraphQL, gRPC, and OpenRPC sources.

In 9 listsDetails

CrewDock

Self-hosted control plane for managing AI agents, with task approvals, activity logs, and cost tracking.

Dataoorts

Enjoy unlimited API calls with Serverless AI Workers/LLMs for just $25 per month. No rate or concurrency limits.

Link may be dead

deeplake

Stream large multimodal datasets to achieve near 100% GPU utilization. Query, visualize, & version control data. Access data w/o the need to recompute the embeddings for the model finetuning.

In 6 listsDetails

depdesk

Finds deprecated and retired LLM model identifiers in a codebase and fails CI before a provider retirement reaches production. Parses Python with the stdlib ast module, weights findings by real call volume from a usage export, and ships a hand-transcribed Anthropic and OpenAI catalog carrying the…

Dify

Open-source framework aims to enable developers (and even non-developers) to quickly build useful applications based on large language models, ensuring they are visual, operable, and improvable.

In 14 listsDetails

Distil

Reversible, certified context compression for LLM agents: gates each compression through a statistical non-inferiority test so the agent's decisions don't change. Stdlib-only, zero-dependency proxy for Anthropic/OpenAI/Gemini.

Doubleword Control Layer

The world's fastest open-source AI model gateway — ~450× less overhead than LiteLLM. Turns any model into a production-ready, OpenAI-compatible API with built-in auth, rate limits, and user controls.

Dstack

Cost-effective LLM development in any cloud (AWS, GCP, Azure, Lambda, etc).

In 4 listsDetails

Ejentum

Cognitive-harness MCP server with four tools (reasoning, code, anti-deception, memory) returning a structured scaffold (failure pattern, procedure, suppression vectors, falsification test) the agent absorbs before generating. Hosted at api.ejentum.com/mcp and on npm as ejentum-mcp.

In 4 lists

Embedchain

Framework to create ChatGPT like bots over your dataset.

In 9 listsDetails

EmberTail Money Check

Tests whether AI agents keep money correct: 57 simulated payment-failure scenarios (timeouts, duplicate charges, spending caps, reverted payments), graded against an independent record of where the money went, with replayable evidence and a GitHub Action.

Ertir

Self-hosted, no-code platform for building and running AI agents on a visual canvas, with built-in local inference (llama.cpp, MLX, vLLM) or any OpenAI-compatible API. Durable crash-resumable runs, per-run trace waterfalls with OTLP export, MCP tools, RAG on pgvector, and human-in-the-loop…

Epsilla

An all-in-one platform to create vertical AI agents powered by your private data and knowledge.

Evidently

An open-source framework to evaluate, test and monitor ML and LLM-powered systems.

In 8 listsDetails

FerryAPI

Low-cost OpenAI-compatible AI API gateway for production workloads, with prepaid balance, usage billing, customer API keys, and provider account pools.

Fiddler AI

Evaluate, monitor, analyze, and improve MLOps and LLMOps from pre-production to production.

FreeLLMAPI

OpenAI-compatible proxy that stacks the free tiers of 28 LLM providers (~4B free tokens/month) behind one /v1 endpoint — smart routing, automatic failover, encrypted keys.

In 2 lists

Glide

Cloud-Native LLM Routing Engine. Improve LLM app resilience and speed.

GoModel

AI gateway exposing a unified OpenAI-compatible API across OpenAI, Anthropic, Gemini, Groq, xAI, Ollama and other providers, with routing, usage tracking, rate limits, and guardrails.

In 4 listsDetails

gotoHuman

Bring a human into the loop in your LLM-based and agentic workflows. Prompt users to approve actions, select next steps, or review and validate generated results.

GPTCache

Creating semantic cache to store responses from LLM queries.

In 9 listsDetails

GPUStack

An open-source GPU cluster manager for running and managing LLMs

In 5 listsDetails

Haystack

Quickly compose applications with LLM Agents, semantic search, question-answering and more.

In 13 listsDetails

Hive

Open-source AI agent framework for building goal-driven, self-improving autonomous agents with auto-generated graphs, evolution loops, and MCP integration.

In 5 listsDetails

Helicone

Open source LLM observability platform. One line of code to monitor, evaluate, and experiment with features like prompt management, agent tracing, and evaluations.

In 9 listsDetails

HiAPI

Hosted OpenAI-compatible gateway for text models (Responses and Chat Completions) plus asynchronous task APIs for image, video, and audio generation; prepaid balance in USD with per-model pricing, and failed tasks are refunded automatically.

Humanloop

The LLM evals platform for enterprises, providing tools to develop, evaluate, and observe AI systems.

In 2 lists

Hypersigil

Open-source prompt lifecycle management and gateway with a Web UI.

Izlo

Prompt management tools for teams. Store, improve, test, and deploy your prompts in one unified workspace.

Keywords AI

A unified DevOps platform for AI software. Keywords AI makes it easy for developers to build LLM applications.

In 2 lists

KubeIntellect

LLM-orchestrated multi-agent framework for Kubernetes operations. Investigates a live cluster via kubectl, Prometheus (PromQL) and Loki (LogQL), correlates the evidence into a root cause, and gates every mutating action behind human approval with role-based access control.

In 2 lists

Kunavo

Hosted AI API gateway with OpenAI-compatible and native Anthropic endpoints, one prepaid balance, and per-request cost accounting.

MLflow

An open-source framework for the end-to-end machine learning lifecycle, helping developers track experiments, evaluate models/prompts, deploy models, and add observability with tracing.

In 8 listsDetails

Laminar

Open-source all-in-one platform for engineering AI products. Traces, Evals, Datasets, Labels.

In 2 lists

langchain

Building applications with LLMs through composability

In 6 listsDetails

LangFlow

An effortless way to experiment and prototype LangChain flows with drag-and-drop components and a chat interface.

In 4 lists

Langfuse

Open Source LLM Engineering Platform: Traces, evals, prompt management and metrics to debug and improve your LLM application.

In 11 listsDetails

LangKit

Out-of-the-box LLM telemetry collection library that extracts features and profiles prompts, responses and metadata about how your LLM is performing over time to find problems at scale.

In 6 listsDetails

LangWatch

LLM Ops platform with Analytics, Monitoring, Evaluations and an LLM Optimization Studio powered by DSPy

In 5 listsDetails

lintlang

Static analysis for AI agent configs, tool descriptions, and system prompts. Catches vague tool descriptions, missing stop conditions, and schema gaps before they reach runtime. Zero-LLM, deterministic checks, built for CI.

In 5 listsDetails

LiteLLM 🚅

A simple & light 100 line package to standardize LLM API calls across OpenAI, Azure, Cohere, Anthropic, Replicate API Endpoints

In 16 listsDetails

LlamaIndex

Provides a central interface to connect your LLMs with external data.

In 2 lists

LLMApp

LLM App is a Python library that helps you build real-time LLM-enabled data pipelines with few lines of code.

In 5 listsDetails

LLMFlows

LLMFlows is a framework for building simple, explicit, and transparent LLM applications such as chatbots, question-answering systems, and agents.

In 2 lists

LLMGraph

No-code visual builder for LLM/AI workflows: turn your docs and models into RAG chatbots and AI agents, then deploy each to a REST API and an embeddable chat widget in one click.

LRM

CLI/TUI tool for managing localization files (.resx, JSON, Android, iOS) with LLM-powered translation via Ollama, validation, and code scanning for unused/missing keys.

In 2 lists

Mengram

Open-source memory infrastructure for AI agents. Provides semantic (entities/facts), episodic (conversations), and procedural (learned behaviors) memory with auto-reflection. Python SDK, JS SDK, MCP server, and REST API.

magentic

Seamlessly integrate LLMs as Python functions. Use type annotations to specify structured output. Mix LLM queries and function calling with regular Python code to create complex LLM-powered functionality.

In 4 listsDetails

Manag.ai

Your all-in-one prompt management and observability platform. Craft, track, and perfect your LLM prompts with ease.

Mandare

Self-hosted LLM gateway that enforces human-signed per-agent spend mandates (cost reserved before the call), records every allow and refusal in a tamper-evident ledger, and has a kill switch.

Mirascope

Intuitive convenience tooling for lightning-fast, efficient development and ensuring quality in LLM-based applications

In 3 lists

MorrowCache

Open-source (MIT) LLM response cache that runs as a local OpenAI-compatible proxy: change the client base URL and repeated or reworded questions are answered from cache. Similarity only proposes candidates; an LLM judge (cloud or local) must admit a hit, and the proxy fails open to the model.…

NativePort

Infrastructure for accessing web-search, scraping, browser-automation, voice, and model-inference providers through a single account, API key, and balance. Publishes dated, capability-specific leaderboards and a public methodology.

Neurolink

Multi-provider AI agent framework that unifies 12+ LLM providers (OpenAI, Google, Anthropic, AWS, Azure, Groq, etc.) with workflow orchestration. Production-grade platform for building LLM applications with streaming, tool calling, caching, and enterprise features. Battle-tested at 15M+…

In 8 listsDetails

Nora

Self-hosted control plane for deploying and operating OpenClaw and Hermes agent fleets on Docker and Kubernetes, with lifecycle management, observability, cost tracking, secrets, schedules, and REST, CLI, and MCP interfaces.

OpenConnector

Self-hostable tool gateway for LLM agents with SaaS action discovery, OAuth/API-key credential management, scoped runtime tokens, and MCP, HTTP, and OpenAPI interfaces.

In 3 lists

OpenLIT

OpenLIT is an OpenTelemetry-native GenAI and LLM Application Observability tool and provides OpenTelmetry Auto-instrumentation for monitoring LLMs, VectorDBs and Frameworks. It provides valuable insights into token & cost usage, user interaction, and performance related metrics.

In 5 listsDetails

OpenProxyAI

Open-source LLM gateway that routes by data class: each model is cleared for a sensitivity level and every request, fallbacks included, can only use models cleared for it. Audit trail, policy, budgets and MCP tool control.

Opik

Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.

In 18 listsDetails

OrcaRouter Lite

Self-hosted, OpenAI-compatible LLM router. Bring your own provider keys and route across 100+ models from multiple providers with automatic failover and streaming; model="auto" selects a model by cost, latency, or quality. Includes a local analytics dashboard and does not send telemetry.

Overmind

Turns production traces into specialised models you own: OpenTelemetry trace ingest, datasets, evals, LoRA fine-tuning of open-weight models and OpenAI-compatible serving. Self-hostable.

Parea AI

Platform and SDK for AI Engineers providing tools for LLM evaluation, observability, and a version-controlled enhanced prompt playground.

Link may be dead

Pezzo 🕹️

Pezzo is the open-source LLMOps platform built for developers and teams. In just two lines of code, you can seamlessly troubleshoot your AI operations, collaborate and manage your prompts in one place, and instantly deploy changes to any environment.

In 4 lists

Pilot Protocol

Open-source overlay network giving AI agents a permanent virtual address, encrypted UDP tunnels with NAT traversal, and an explicit per-peer trust model, plus an app store of installable agent-native capabilities (discover → install → call).

PraisonAI

Production-ready Multi-AI Agents framework with self-reflection. Fastest agent instantiation (3.77μs), 100+ LLM support via LiteLLM, MCP integration, agentic workflows (route/parallel/loop/repeat), built-in memory, Python & JS SDKs.

In 9 listsDetails

PromptHub

Full stack prompt management tool designed to be usable by technical and non-technical team members. Test, version, collaborate, deploy, and monitor, all from one place.

In 2 lists

promptfoo

Open-source tool for testing & evaluating prompt quality. Create test cases, automatically check output quality and catch regressions, and reduce evaluation cost.

PromptFoundry

The simple prompt engineering and evaluation tool designed for developers building AI applications.

Link may be dead

PromptLayer 🍰

Prompt Engineering platform. Collaborate, test, evaluate, and monitor your LLM applications

In 2 lists

PromptMage

Open-source tool to simplify the process of creating and managing LLM workflows and prompts as a self-hosted solution.

PromptSite

A lightweight Python library for prompt lifecycle management that helps you version control, track, experiment and debug with your LLM prompts with ease. Minimal setup, no servers, databases, or API keys required - works directly with your local filesystem, ideal for data scientists and engineers…

Prompteams

Prompt management system. Version, test, collaborate, and retrieve prompts through real-time APIs. Have GitHub style with repos, branches, and commits (and commit history).

prompttools

Open-source tools for testing and experimenting with prompts. The core idea is to enable developers to evaluate prompts using familiar interfaces like code and notebooks. In just a few lines of codes, you can test your prompts and parameters across different models (whether you are using OpenAI,…

Puzzlet AI

The Git-Based LLM Engineering Platform. Achieve more from GenAI: Manage, evaluate, and improve your full-stack LLM application - with version control, type-safety, and local development built-in.

Link may be dead

Quotaflow

AI token and API resource utilization platform that helps teams reduce wasted subscribed quota and improve turnover across controlled internal pools.

systemprompt.io

Systemprompt.io is a Rest API with quality tooling to enable the creation, use and observability of prompts in any AI system. Control every detail of your prompt for a SOTA prompt management experience.

TeamoRouter

LLM routing gateway for OpenClaw. One API key to access Claude, GPT-4o, Gemini, DeepSeek, Kimi, MiniMax. Smart routing modes (teamo-best, teamo-balanced, teamo-eco) auto-pick the optimal model. Up to 50% off official prices. 2-second install via skill.md.

Link may be dead

TokenMix

AI gateway routing 171 LLMs from 14 providers (Claude, GPT, Gemini, DeepSeek, Qwen, and more) through one OpenAI-compatible endpoint. Pass-through pricing, automatic failover, no monthly subscription.

TreeScale

All In One Dev Platform For LLM Apps. Deploy LLM-enhanced APIs seamlessly using tools for prompt optimization, semantic querying, version management, statistical evaluation, and performance tracking. As a part of the developer friendly API implementation TreeScale offers Elastic LLM product, which…

TrueFoundry

Deploy LLMOps tools like Vector DBs, Embedding server etc on your own Kubernetes (EKS,AKS,GKE,On-prem) Infra including deploying, Fine-tuning, tracking Prompts and serving Open Source LLM Models with full Data Security and Optimal GPU Management. Train and Launch your LLM Application at Production…

In 2 lists

Rhesis

Open-source testing infrastructure for LLM and agentic applications. Collaborative platform enabling teams to define quality metrics, run evaluations, and ship confidently with version control and peer review workflows built for AI engineering.

In 3 lists

rote

Open-source CLI that compiles a proven agent skill (a SKILL.md plus references) into a typed, deterministic pipeline. Fixed logic becomes reviewable Python or TypeScript with per-step tests, while judgment steps stay as typed LLM-judge signatures. Emits DBOS, Temporal, Cloudflare Workflows,…

Roundtable

Zero-configuration unified AI assistant management built on the FastMCP framework. Provides seamless integration with Claude, ChatGPT, and other AI assistants through a single MCP interface with session management, logging, and production-ready operations.

In 2 lists

Portkey

Control Panel with an observability suite & an AI gateway — to ship fast, reliable, and cost-efficient apps.

In 3 lists

SAVI SDK

Open-source observability SDK for LLM cost, PII masking, carbon, and compliance — drop-in wrapper for OpenAI/Anthropic/Bedrock/Cohere/Mistral/Vertex; works standalone with zero account via local_mode.

Self-Hosted AI Stack

Docker Compose stack for local AI with Ollama, a LiteLLM gateway, RAG, voice services, MCP tools, persistent data, and health checks.

In 2 lists

Semantic Cache Router

Distributed semantic cache and stateful routing system that cuts LLM API costs by returning cached responses for semantically similar queries. Uses ANN vector search (cosine ≥ 0.8) and consistent hashing to pin requests to the same worker, achieving ~7× latency reduction on cache hits while…

Spendline

Financial control layer for AI spend — per-customer cost attribution and hierarchical budgets enforced before the provider call.

Statewave

Open-source memory runtime for AI agents. Compiles events into deterministic, provenance-tagged context bundles instead of query-time retrieval. Apache-2.0, self-hostable on Postgres + pgvector.

In 2 lists

Symbioza

Run a GPU job under a hard dollar cap and collect the files it writes.

TensorZero

TensorZero is an open-source framework for building production-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluations, and experimentation.

In 3 lists

ThinkWatch Lite

Desktop app for macOS, Windows and Linux that runs a local LLM gateway for Claude Code, Codex and other AI coding clients: routing rules with failover, conversion between the Anthropic, OpenAI and Gemini APIs, a record of each request's route and cost, and redaction of API keys before requests…

In 2 lists

Trinity

Self-hosted platform that runs AI coding agents as persistent scheduled services. Each agent runs in a Docker container with its own workspace and git-backed memory, plus scheduling, an approvals queue, an MCP server and a web console.

UberLLM

Hosted gateway with OpenAI-compatible (Chat Completions, Responses) and native Anthropic Messages endpoints for GPT, Claude, Gemini, DeepSeek, Qwen and other text models plus image, video, music and speech models; prepaid balance, each request billed at what its provider charged.

In 2 lists

UnoRouter

OpenAI-compatible LLM gateway with one API key for every major provider and smart routing across models. Drop-in for code, Claude Code, and chat clients like SillyTavern, Janitor.AI, RisuAI, and Chub.

Vellum

An AI product development platform to experiment with, evaluate, and deploy advanced LLM apps.

In 2 lists

Weights & Biases (Prompts)

A suite of LLMOps tools within the developer-first W&B MLOps platform. Utilize W&B Prompts for visualizing and inspecting LLM execution flow, tracking inputs and outputs, viewing intermediate results, securely managing prompts and LLM chain configurations.

Wenlan

Local-first AI knowledge base and LLM wiki that distills agent work into source-cited pages with graph context and hybrid retrieval across MCP clients.

In 2 lists

Wiro AI

Hosted LLM gateway with OpenAI Chat Completions, OpenAI Responses and Anthropic Messages routes for models from OpenAI, Anthropic, Google, xAI, DeepSeek, Qwen and others, one API key, and the billed cost in every response.

Wordware

A web-hosted IDE where non-technical domain experts work with AI Engineers to build task-specific AI agents. It approaches prompting as a new programming language rather than low/no-code blocks.

In 4 lists

XiuRouter

Hosted multi-model API service with OpenAI Chat Completions and Responses, Anthropic Messages, and Gemini GenerateContent routes, scoped API keys, usage-based pricing, and request-level usage and cost records.

xTuring

Build and control your personal LLMs with fast and efficient fine-tuning.

In 2 lists

ZenML

Open-source framework for orchestrating, experimenting and deploying production-grade ML solutions, with built-in langchain & llama_index integrations.

In 5 listsDetails

SwarmClaw

Self-hosted multi-agent AI runtime with 23+ LLM providers, persistent memory, skills, schedules, sub-agent spawning, and MCP client + server support. Ships as desktop app, CLI, or Docker.

In 4 lists

ai-evaluation

Evaluation framework for automated, reproducible scoring of LLM, agent, and workflow performance.

future-agi

Open-source self-hostable end-to-end agent engineering and optimization platform unifying tracing, evals, simulations, datasets, gateway, and guardrails for LLM and AI agent applications.

In 9 listsDetails

Modelglass

Sourced, versioned pricing and capability data for AI models (image, language, video, audio, plus coding/science/agentic benchmark verticals) to find the cheapest model that clears a capability bar.

Airweave

An easy way to turn any app into searchable data for LLMs.

MemorySync

Persistent multi-tenant memory layer and MCP server for AI coding assistants with sub-50ms hybrid recall.

PipesHub

Enterprise search for LLMs and agents: hybrid and knowledge-graph retrieval over 30+ workplace sources, with source permissions enforced and an MCP server.

In 3 lists

Remio

Local-first personal knowledge base that pre-parses files, webpages, recordings, notes, emails, messages, and images into indexed and vector-retrievable context for faster AI search and agent workflows, reducing repeated raw-file scans and context-token cost.

In 3 lists

AquilaDB

An easy to use Neural Search Engine. Index latent vectors along with JSON metadata and do efficient k-NN search.

In 2 lists

Awadb

AI Native database for embedding vectors

Chroma

the open source embedding database

In 8 listsDetails

Epsilla

A 10x faster, cheaper, and better vector database

In 3 lists

Infinity

The AI-native database built for LLM applications, providing incredibly fast vector and full-text search

In 9 listsDetails

Infino

Embedded retrieval engine on Apache Parquet: BM25 full-text, vector, hybrid (RRF), and SQL from one engine over object storage.

Lancedb

Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!

In 4 listsDetails

Marqo

Tensor search for humans.

In 5 listsDetails

Milvus

Vector database for scalable similarity search and AI applications.

In 14 listsDetails

Omnigraph

Typed graph database where agents branch and merge like Git. S3-native, Rust, traversal + vector + BM25 in one runtime.

In 6 listsDetails

ParadeDB

The transactional alternative to Elasticsearch, built on Postgres.

In 4 lists

Pinecone

The Pinecone vector database makes it easy to build high-performance vector search applications. Developer-friendly, fully managed, and easily scalable without infrastructure hassles.

In 8 listsDetails

pgvector

Open-source vector similarity search for Postgres.

In 6 listsDetails

Rivestack

Managed PostgreSQL with pgvector for AI workloads. Built-in SQL editor lets you query your database with natural language (auto-converted to vector embeddings). Free tier includes 2GB storage.

In 3 lists

SynapCores

Self-hosted AI-native database: vector search + Cypher graph + embedded GGUF inference and SQL in one engine. Free Community Edition binary; source proprietary.

VectorChord

Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.

In 2 lists

pgvecto.rs

Vector database plugin for Postgres, written in Rust, specifically designed for LLM.

In 2 lists

Qdrant

Vector Search Engine and Database for the next generation of AI applications. Also available in the cloud

In 8 listsDetails

txtai

Build AI-powered semantic search applications

In 9 listsDetails

Vald

A Highly Scalable Distributed Vector Search Engine

In 3 lists

Vearch

A distributed system for embedding-based vector retrieval

In 3 lists

VectorDB

A Python vector database you just need - no more, no less.

Vellum

A managed service for ingesting documents and performing hybrid semantic/keyword search across them. Comes with out-of-box support for OCR, text chunking, embedding model experimentation, metadata filtering, and production-grade APIs.

Weaviate

Weaviate is an open source vector search engine that stores both objects and vectors, allowing for combining vector search with structured filtering with the fault-tolerance and scalability of a cloud-native database, all accessible through GraphQL, REST, and various language clients.

In 2 lists

Code AI

aigent-os

MIT harness for long-running Claude Code sessions that saves a capsule, runs /clear and resumes instead of compacting.

In 2 lists

Atomic Agent

Local-first CLI and TUI coding agent that runs open-weight models entirely on your machine through a llama.cpp fork. No account or API key required. 56 built-in tools (browser, filesystem, git, memory, vision), MCP support, five-layer local memory, macOS/Linux/Windows.

In 5 listsDetails

Bernstein

Deterministic Python orchestrator for 37 CLI coding agents (Claude Code, Codex CLI, Gemini CLI, GitHub Copilot CLI, Cursor, Aider, OpenHands, OpenCode, Goose, Qwen, Ollama, ...) running in parallel git worktrees. First-class MCP server, quality gates, cost tracking with budgets.

In 6 listsDetails

CodeGeeX

CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)

In 2 lists

CodeGen

CodeGen is an open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

In 4 lists

Coder Eval

Framework for evaluating, benchmarking, and A/B-testing AI coding agents (Claude Code, Codex CLI, Gemini/Antigravity) and their skills. Runs a real agent in a sandbox against declarative YAML tasks, then scores the resulting files and commands with weighted 0.0-1.0 criteria. Includes 14 criterion…

In 3 lists

CodeT5

Open Code LLMs for Code Understanding and Generation.

In 2 lists

Continue

⏩ the open-source autopilot for software development—bring the power of ChatGPT to VS Code

In 10 listsDetails

Cotal

Open pub/sub standard over NATS JetStream for coordinating coding agents. Claude Code, Codex, OpenCode, Hermes, Jcode and pi agents share a space with presence, channels, durable direct messages and role-addressed delivery.

In 2 lists

deja-vu

Local searchable memory over the session transcripts 44 coding agents (Claude Code, Codex CLI, Cursor, Gemini CLI, OpenCode, Aider) already write to disk, with MCP tools, hooks, and secret redaction.

In 11 listsDetails

DSH Studio

Cross-platform desktop host for installing, configuring, and managing DeepSeek Harness.

In 7 listsDetails

fauxpilot

An open-source alternative to GitHub Copilot server

In 2 lists

fractal

Hierarchical coding-agent orchestrator with recursive delegation, per-node Git worktrees, configurable limits, persistent SQLite state, and live terminal monitoring and steering.

In 4 listsDetails

Kodama

API-first, multi-tenant software factory in Go (Apache-2.0) running sequential container pipelines and AI coding agents (Claude Code, OpenCode, Codex, Pi) on Podman 5 or Kubernetes Jobs, with REST and MCP JSON-RPC edges, external MCP proxy, OpenAI-compatible model gateway, Git access control, and…

Kolega Code

Python terminal coding agent where the model writes its own multi-agent workflows (Gigacode). Provider-agnostic, local-first, 15+ model providers, MCP client, browser agent.

In 2 lists

MCP-Plugin-dotnet

Open-source .NET library/SDK that turns any .NET application into an MCP server.

In 2 lists

Orbi

Self-hosted runner that takes a labelled GitHub Issue to a pull request, has a separate review session check the frozen diff against the acceptance criteria, merges only the reviewed head, and publishes the tagged release. Works with any OpenAI-compatible model.

In 7 listsDetails

promptext

Smart code context extractor for AI assistants with accurate token counting and budget management

Relay

Universal AI API proxy — hot-switch between 14+ LLM providers (GitHub Copilot, OpenAI, Anthropic, DeepSeek, Groq, Ollama, and more) from any AI coding agent without restarting sessions. Local proxy with automatic Anthropic <-> OpenAI protocol translation, account rotation, and real-time usage…

Superagent

Open-source macOS desktop app that gives Claude Code and Codex a real browser to drive, an iOS Simulator to install and screenshot apps in, and a phone companion app for remote monitoring.

In 5 listsDetails

Synaps

Terminal AI agent runtime in Rust with a ratatui TUI, parallel subagents, MCP, and plugins; works with Claude, OpenAI, Gemini, or local models.

In 4 listsDetails

tabby

Self-hosted AI coding assistant. An opensource / on-prem alternative to GitHub Copilot.

In 8 listsDetails

Unreal-MCP

Open-source MCP server connecting AI agents to Unreal Engine 5.7, editor and runtime (C++ plugin + .NET sidecar).

In 4 lists

AIDE

Open-source ML engineering agent that uses tree search to explore solution spaces. Automates machine learning experimentation from data analysis to model training. Paper.

In 5 listsDetails

Kapso

Long-running agents that optimize AI and Data systems, and learn from every experience. #1 open-source on MLE-Bench; ALE-Bench; RelBench.

webcmd

Self-learning browser infrastructure for AI coding agents that compiles site navigation into deterministic per-site CLI commands.

In 6 listsDetails

Training >IDEs and Workspaces

code server

Run VS Code on any machine anywhere and access it in the browser.

In 5 listsDetails

conda

OS-agnostic, system-level binary package manager and ecosystem.

In 4 listsDetails

Docker

Moby is an open-source project created by Docker to enable and accelerate software containerization.

In 9 listsDetails

envd

🏕️ Reproducible development environment for AI/ML.

In 5 listsDetails

Jupyter Notebooks

The Jupyter notebook is a web-based notebook environment for interactive computing.

In 5 listsDetails

Kurtosis

A build, packaging, and run system for ephemeral multi-container environments.

In 2 lists

LayerSmith

Self-hosted web UI, TUI, and CLI for building OCI images with Docker or Podman, including LLM training environments and air-gap bundles.

In 2 lists

Wordware

A web-hosted IDE where non-technical domain experts work with AI Engineers to build task-specific AI agents. It approaches prompting as a new programming language rather than low/no-code blocks.

In 4 lists

Training >Foundation Model Fine Tuning

alpaca-lora

Instruct-tune LLaMA on consumer hardware

In 4 lists

finetuning-scheduler

A PyTorch Lightning extension that accelerates and enhances foundation model experimentation with flexible fine-tuning schedules.

Flyflow

Open source, high performance fine tuning as a service for GPT4 quality models with 5x lower latency and 3x lower cost

LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models

In 4 listsDetails

Lora

Using Low-rank adaptation to quickly fine-tune diffusion models.

peft

State-of-the-art Parameter-Efficient Fine-Tuning.

In 7 listsDetails

p-tuning-v2

An optimized prompt tuning strategy achieving comparable performance to fine-tuning on small/medium-sized models and sequence tagging challenges. (ACL 2022)

QLoRA

Efficient finetuning approach that reduces memory usage enough to finetune a 65B parameter model on a single 48GB GPU while preserving full 16-bit finetuning task performance.

In 2 lists

TrainJudge

Diagnoses whether fine-tuning fits, then verifies fine-tunes on held-out task metrics and a regression suite, not training loss.

TRL

Train transformer language models with reinforcement learning.

In 10 listsDetails

Training >Frameworks for Training

Accelerate

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision.

In 6 listsDetails

Apache MXNet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler.

In 2 lists

axolotl

A tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.

Caffe

A fast open framework for deep learning.

In 10 listsDetails

Candle

Minimalist ML framework for Rust .

In 5 listsDetails

ColossalAI

An integrated large-scale model training system with efficient parallelization techniques.

In 14 listsDetails

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

In 7 listsDetails

Horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

In 4 lists

Jax

Autograd and XLA for high-performance machine learning research.

In 5 listsDetails

Kedro

Kedro is an open-source Python framework for creating reproducible, maintainable and modular data science code.

In 7 listsDetails

Keras

Keras is a deep learning API written in Python, running on top of the machine learning platform TensorFlow.

In 9 listsDetails

LightGBM

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

In 7 listsDetails

MegEngine

MegEngine is a fast, scalable and easy-to-use deep learning framework, with auto-differentiation.

In 2 lists

metric-learn

Metric Learning Algorithms in Python.

In 2 lists

MindSpore

MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

In 2 lists

Oneflow

OneFlow is a performance-centered and open-source deep learning framework.

In 2 lists

PaddlePaddle

Machine Learning Framework from Industrial Practice.

In 6 listsDetails

PyTorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration.

In 16 listsDetails

PyTorch Lightning

Deep learning framework to train, deploy, and ship AI products Lightning fast.

In 3 lists

XGBoost

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.

In 11 listsDetails

scikit-learn

Machine Learning in Python.

In 10 listsDetails

TensorFlow

An Open Source Machine Learning Framework for Everyone.

In 23 listsDetails

VectorFlow

A minimalist neural network library optimized for sparse data and single machine environments.

In 2 lists

Training >Experiment Tracking

Aim

an easy-to-use and performant open-source experiment tracker.

In 8 listsDetails

ClearML

Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management

In 2 lists

Comet

Comet is an MLOps platform that offers experiment tracking, model production management, a model registry, and full data lineage from training straight through to production. Comet plays nicely with all your favorite tools, so you don't have to change your existing workflow. Comet Opik to…

In 5 listsDetails

Guild AI

Experiment tracking, ML developer tools.

MLRun

Machine Learning automation and tracking.

In 4 listsDetails

Kedro-Viz

Kedro-Viz is an interactive development tool for building data science pipelines with Kedro. Kedro-Viz also allows users to view and compare different runs in the Kedro project.

In 2 lists

LabNotebook

LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.

Sacred

Sacred is a tool to help you configure, organize, log and reproduce experiments.

In 6 listsDetails

Weights & Biases

A developer first, lightweight, user-friendly experiment tracking and visualization tool for machine learning projects, streamlining collaboration and simplifying MLOps. W&B excels at tracking LLM-powered applications, featuring W&B Prompts for LLM execution flow visualization, input and output…

In 5 listsDetails

Training >Visualization

Fiddler AI

Rich dashboards, reports, and UMAP to perform root cause analysis, pinpoint problem areas, like correctness, safety, and privacy issues, and improve LLM outcomes.

LangWatch

LLM Ops platform with Analytics, Monitoring, Evaluations and an LLM Optimization Studio powered by DSPy

In 5 listsDetails

Maniford

A model-agnostic visual debugging tool for machine learning.

In 3 lists

netron

Visualizer for neural network, deep learning, and machine learning models.

In 16 listsDetails

TensorBoard

TensorFlow's Visualization Toolkit.

In 4 listsDetails

TensorSpace

Neural network 3D visualization framework, build interactive and intuitive model in browsers, support pre-trained deep learning models from TensorFlow, Keras, TensorFlow.js.

dtreeviz

A python library for decision tree visualization and model interpretation.

In 2 lists

Zetane Viewer

ML models and internal tensors 3D visualizer.

Zeno

AI evaluation platform for interactively exploring data and model outputs.

Training >Model Editing

FastEdit

FastEdit aims to assist developers with injecting fresh and customized knowledge into large language models efficiently using one single command.

Data >Data Management

ArtiVC

A version control system to manage large files. Lake is a dataset format with a simple API for creating, storing, and collaborating on AI datasets of any size.

Dolt

Git for Data.

In 10 listsDetails

DVC

Data Version Control - Git for Data & Models - ML Experiments Management.

In 7 listsDetails

Delta-Lake

Storage layer that brings scalable, ACID transactions to Apache Spark and other engines.

In 6 listsDetails

Pachyderm

Pachyderm is a version control system for data.

In 5 listsDetails

Quilt

A self-organizing data hub for S3.

In 3 lists

Data >Data Storage

JuiceFS

A distributed POSIX file system built on top of Redis and S3.

In 9 listsDetails

LakeFS

Git-like capabilities for your object storage.

In 10 listsDetails

Lance

Modern columnar data format for ML implemented in Rust.

Pixeltable

Declarative multimodal AI data engine for versioned tables, computed columns, and vector search.

In 4 listsDetails

Data >Data Tracking

Piperider

A CLI tool that allows you to build data profiles and write assertion tests for easily evaluating and tracking your data's reliability over time.

LUX

A Python library that facilitates fast and easy data exploration by automating the visualization and data analysis process.

In 5 listsDetails

ragfresh

A CLI that detects stale, drifted, and ghost documents in RAG vector indexes by diffing content hashes and embedding drift against the source of truth.

Data >Feature Engineering

Featureform

The Virtual Feature Store. Turn your existing data infrastructure into a feature store.

In 3 lists

FeatureTools

An open source python framework for automated feature engineering

In 3 lists

Data >Data/Feature enrichment

CocoIndex

An ETL framework for AI that transforms data into embeddings and knowledge graphs, with incremental processing to recompute only what changed and keep indexes fresh.

In 8 listsDetails

Upgini

Free automated data & feature enrichment library for machine learning: automatically searches through thousands of ready-to-use features from public and community shared data sources and enriches your training dataset with only the accuracy improving features

In 4 listsDetails

Feast

An open source feature store for machine learning.

In 6 listsDetails

distilabel

⚗️ distilabel is a framework for synthetic data and AI feedback for AI engineers that require high-quality outputs, full data ownership, and overall efficiency.

In 3 lists

FastDatasets

A powerful tool for creating high-quality training datasets for Large Language Models.

fastdocparse

Extracts structured data from documents with an LLM, then grounds every field against the source text to flag hallucinated values automatically.

Sugo

Local-first, offline tool that cleans and converts PDFs, Office files, screenshots and images into compact Markdown for LLM/RAG pipelines, stripping repeated headers/footers and tracking noise while recording every removal.

Large Scale Deployment >ML Platforms

Comet

Comet is an MLOps platform that offers experiment tracking, model production management, a model registry, and full data lineage from training straight through to production. Comet plays nicely with all your favorite tools, so you don't have to change your existing workflow. Comet Opik to…

In 5 listsDetails

ClearML

Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management

In 2 lists

dstack

Open-source confidential AI framework for secure LLM deployment with data privacy, providing hardware-enforced isolation using Intel TDX and NVIDIA Confidential Computing.

In 2 lists

Hopsworks

Hopsworks is a MLOps platform for training and operating large and small ML systems, including fine-tuning and serving LLMs. Hopsworks includes both a feature store and vector database for RAG.

In 5 listsDetails

OpenLLM

An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease.

In 10 listsDetails

MLflow

An open-source framework for the end-to-end machine learning lifecycle, helping developers track experiments, evaluate models/prompts, deploy models, and add observability with tracing.

In 8 listsDetails

MLRun

Machine Learning automation and tracking.

In 4 listsDetails

ModelFox

ModelFox is a platform for managing and deploying machine learning models.

Kserve

Standardized Serverless ML Inference Platform on Kubernetes

In 6 listsDetails

KubeStellar Console

Open source AI-powered multi-cluster Kubernetes dashboard for managing LLM workloads across hybrid edge and cloud environments. GPU monitoring, benchmark streaming, real-time observability with 20+ CNCF integrations, and AI-guided cluster operations. CNCF Sandbox project.

In 3 lists

Kubeflow

Machine Learning Toolkit for Kubernetes.

In 7 listsDetails

PAI

Resource scheduling and cluster management for AI.

piqc

Open-source, read-only GPU waste scanner for Kubernetes inference clusters. Deploys in minutes, no write permissions required.

Polyaxon

Machine Learning Management & Orchestration Platform.

In 9 listsDetails

Primehub

An effortless infrastructure for machine learning built on the top of Kubernetes.

OpenModelZ

One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).

Seldon-core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

In 6 listsDetails

Starwhale

An MLOps/LLMOps platform for model building, evaluation, and fine-tuning.

In 2 lists

TrueFoundry

A PaaS to deploy, Fine-tune and serve LLM Models on a company’s own Infrastructure with Data Security and Optimal GPU and Cost Management. Launch your LLM Application at Production scale with best DevSecOps practices.

Weights & Biases

A developer first, lightweight, user-friendly experiment tracking and visualization tool for machine learning projects, streamlining collaboration and simplifying MLOps. W&B excels at tracking LLM-powered applications, featuring W&B Prompts for LLM execution flow visualization, input and output…

In 5 listsDetails

Large Scale Deployment >Workflow

Airflow

A platform to programmatically author, schedule and monitor workflows.

In 9 listsDetails

aqueduct

An Open-Source Platform for Production Data Science

In 2 lists

Argo Workflows

Workflow engine for Kubernetes.

In 10 listsDetails

awaithumans

One-function HITL primitive for AI agents. await_human blocks like a Promise; a human reviews via Slack/email/dashboard; the agent resumes with the typed response. Durable across restarts via Stripe-style idempotency keys. Temporal + LangGraph adapters included.

Flyte

Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale.

In 5 listsDetails

Hamilton

A lightweight framework to represent ML/language model pipelines as a series of python functions.

In 9 listsDetails

Heym

Source-available, self-hosted AI workflow automation platform with a visual canvas for agent, RAG, and tool-using workflows. Includes MCP support, evals, traces, and cost tracking.

In 4 listsDetails

Kitaru

Durable execution layer for AI agents. Checkpoints, replay, resume, and observability primitives that make agent workflows persistent and replayable — no graph DSL required.

In 2 lists

Kubeflow Pipelines

Machine Learning Pipelines for Kubeflow.

In 3 lists

LangFlow

An effortless way to experiment and prototype LangChain flows with drag-and-drop components and a chat interface.

In 4 lists

Metaflow

Build and manage real-life data science projects with ease!

In 6 listsDetails

Ploomber

The fastest way to build data pipelines. Develop iteratively, deploy anywhere.

In 5 listsDetails

Prefect

The easiest way to automate your data.

In 11 listsDetails

VDP

An open-source unstructured data ETL tool to streamline the end-to-end unstructured data processing pipeline.

In 3 lists

ZenML

Open-source framework for orchestrating, experimenting and deploying production-grade ML solutions, with built-in langchain & llama_index integrations.

In 5 listsDetails

simulate-sdk

Enterprise-grade Voice AI simulation SDK for scenario-driven stress testing of multimodal and agentic systems.

Large Scale Deployment >Scheduling

Kueue

Kubernetes-native Job Queueing.

In 3 lists

PAI

Resource scheduling and cluster management for AI.

Slurm

A Highly Scalable Workload Manager.

In 3 lists

Volcano

A Cloud Native Batch System (Project under CNCF).

In 5 listsDetails

Yunikorn

Light-weight, universal resource scheduler for container orchestrator systems.

In 2 lists

Large Scale Deployment >Model Management

Comet

Comet is an MLOps platform that offers experiment tracking, model production management, a model registry, and full data lineage from training straight through to production. Comet plays nicely with all your favorite tools, so you don't have to change your existing workflow. Comet Opik to…

In 5 listsDetails

DVC

Data Version Control - Git for Data & Models - ML Experiments Management.

In 7 listsDetails

ModelDB

Open Source ML Model Versioning, Metadata, and Experiment Management

In 2 lists

MLEM

A tool to package, serve, and deploy any ML model on any platform.

In 4 listsDetails

ormb

Docker for Your ML/DL Models Based on OCI Artifacts

Performance >ML Compiler

ONNX-MLIR

Compiler technology to transform a valid Open Neural Network Exchange (ONNX) graph into code that implements the graph with minimum runtime support.

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

In 4 listsDetails

TVM

Open deep learning compiler stack for cpu, gpu and specialized accelerators

In 3 lists

Performance >Profiling

GuideLLM

vLLM project's benchmark for OpenAI-compatible and vLLM servers: synchronous, concurrent and rate sweeps with TTFT, inter-token latency and throughput distributions for SLO checks.

In 2 lists

octoml-profile

octoml-profile is a python library and cloud service designed to provide the simplest experience for assessing and optimizing the performance of PyTorch models on cloud hardware with state-of-the-art ML acceleration technology.

scalene

a high-performance, high-precision CPU, GPU, and memory profiler for Python

In 6 listsDetails

AutoML

Archai

a platform for Neural Network Search (NAS) that allows you to generate efficient deep networks for your applications.

In 2 lists

autoai

A framework to find the best performing AI/ML model for any AI problem.

AutoGL

An autoML framework & toolkit for machine learning on graphs

In 2 lists

AutoGluon

AutoML for Image, Text, and Tabular Data.

In 4 listsDetails

automl-gs

Provide an input CSV and a target field to predict, generate a model + code to run it.

AutoRAG

AutoML tool for RAG - Boost your LLM app performance with your own data

In 5 listsDetails

autokeras

AutoML library for deep learning.

In 5 listsDetails

Auto-PyTorch

Automatic architecture search and hyperparameter optimization for PyTorch.

In 4 lists

auto-sklearn

an automated machine learning toolkit and a drop-in replacement for a scikit-learn estimator.

In 4 listsDetails

Dragonfly

An open source python library for scalable Bayesian optimisation.

Determined

scalable deep learning training platform with integrated hyperparameter tuning support; includes Hyperband, PBT, and other search methods.

In 5 listsDetails

DEvol (DeepEvolution)

a basic proof of concept for genetic architecture search in Keras.

EvalML

An open source python library for AutoML.

In 3 lists

FEDOT

AutoML framework for the design of composite pipelines.

In 2 lists

FLAML

Fast and lightweight AutoML (paper).

In 4 listsDetails

Goptuna

A hyperparameter optimization framework, inspired by Optuna.

In 3 lists

HpBandSter

a framework for distributed hyperparameter optimization.

HPOlib2

a library for hyperparameter optimization and black box optimization benchmarks.

Hyperband

open source code for tuning hyperparams with Hyperband.

Hypernets

A General Automated Machine Learning Framework.

Hyperopt

Distributed Asynchronous Hyperparameter Optimization in Python.

In 5 listsDetails

hyperunity

A toolset for black-box hyperparameter optimisation.

Intelli

A framework to connect a flow of ML models by applying graph theory.

Katib

Katib is a Kubernetes-native project for automated machine learning (AutoML).

In 5 listsDetails

Keras Tuner

Hyperparameter tuning for humans.

In 4 listsDetails

learn2learn

PyTorch Meta-learning Framework for Researchers.

In 2 lists

Ludwig

a toolbox built on top of TensorFlow that allows to train and test deep learning models without the need to write code.

In 3 lists

MOE

a global, black box optimization engine for real world metric optimization by Yelp.

Model Search

a framework that implements AutoML algorithms for model architecture search at scale.

In 2 lists

NASGym

a proof-of-concept OpenAI Gym environment for Neural Architecture Search (NAS).

NNI

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

In 5 listsDetails

Optuna

A hyperparameter optimization framework.

In 9 listsDetails

Pycaret

An open-source, low-code machine learning library in Python that automates machine learning workflows.

In 5 listsDetails

Ray Tune

Scalable Hyperparameter Tuning.

In 14 listsDetails

REMBO

Bayesian optimization in high-dimensions via random embedding.

In 2 lists

RoBO

a Robust Bayesian Optimization framework.

scikit-optimize(skopt)

Sequential model-based optimization with a scipy.optimize interface.

In 3 lists

Spearmint

a software package to perform Bayesian optimization.

In 3 lists

TPOT

one of the very first AutoML methods and open-source software packages.

Torchmeta

A Meta-Learning library for PyTorch.

In 2 lists

Vegas

an AutoML algorithm tool chain by Huawei Noah's Arb Lab.

Optimizations

AI Agent Token Cost Calculator

Browser-only calculator for estimating monthly AI agent token spend, avoidable cost, and optimization payback. Live calculator

Entroly

Information-theoretic context optimization proxy. Cuts LLM token costs by 70–95% with zero accuracy loss using greedy submodular knapsack maximization.

In 5 listsDetails

FeatherCNN

FeatherCNN is a high performance inference engine for convolutional neural networks.

In 2 lists

Forward

A library for high performance deep learning inference on NVIDIA GPUs.

LangWatch

LLM Ops platform with Analytics, Monitoring, Evaluations and an LLM Optimization Studio powered by DSPy

In 5 listsDetails

lean-ctx

Context runtime and MCP server that reduces AI coding agent token costs via session caching, AST-aware compression, and shell output patterns. Website

In 4 lists

LLMSlim

Open-source context compression for RAG and agents: selects query-relevant units under a hard token budget (lexical, or an optional 22M cross-encoder), with a reproducible benchmark against LLMLingua-2 and LongLLMLingua.

In 5 listsDetails

LMCache

KV cache layer for vLLM and SGLang that stores and reuses KV caches across GPU memory, CPU memory, local disk and remote storage, cutting time to first token for long contexts and multi-turn chats.

In 5 listsDetails

NCNN

ncnn is a high-performance neural network inference framework optimized for the mobile platform.

In 6 listsDetails

PocketFlow

use AutoML to do model compression.

subagent-tuner

Claude Code mod for steering the cost and quality of coding-agent subagents: a Manual/Auto band, a pick pane, and a saved default that picks the model and effort per subagent, so reviews stay on a strong model and searches on a cheap one.

In 3 lists

TensorFlow Model Optimization

A suite of tools that users, both novice and advanced, can use to optimize machine learning models for deployment and execution.

TNN

A uniform deep learning inference framework for mobile, desktop and server.

In 2 lists

optimum-tpu

Google TPU optimizations for transformers models

agent-opt

Automated optimization engine for improving agent workflows using feedback-driven iterative refinements.

cap-evolve

Optimize agentic capabilities with agents. Reflective optimizer for AI agent prompts, tool code, MCP tool surfaces, and skill packages; learning from evaluation traces, val-only significance gate with a sealed test split scored once. Adapters for τ²-bench, SWE-bench, SkillsBench. Zero runtime…

reliopt

Reliability-constrained, multi-objective optimization for LLM/agent programs — contract-gated Pareto frontiers instead of a single blended score.

Federated ML

EasyFL

An Easy-to-use Federated Learning Platform

FATE

An Industrial Grade Federated Learning Framework

In 2 lists

FedML

The federated learning and analytics library enabling secure and collaborative machine learning on decentralized data anywhere at any scale. Supporting large-scale cross-silo federated learning, cross-device federated learning on smartphones/IoTs, and research simulation.

In 2 lists

Flower

A Friendly Federated Learning Framework

In 2 lists

Harmonia

Harmonia is an open-source project aiming at developing systems/infrastructures and libraries to ease the adoption of federated learning (abbreviated to FL) for researches and production usage.

TensorFlow Federated

A framework for implementing federated learning

In 3 lists
See category
100

Table of Contents

hesreallyhim/awesome-claude-code

A hand-picked collection of the finest of resources for the most awesome of agents, Claude Code, the undisputed champion of coding companions, from the unstoppable team…

Fresh★ 58k252 entriesPushed today
100

Awesome Agent Skills

VoltAgent/awesome-agent-skills

A curated collection of 1000+ agent skills from official dev teams and the community, compatible with Claude Code, Codex, Gemini CLI, Cursor, and more.

Fresh★ 37k965 entriesPushed today
98

Awesome Production Machine Learning

EthicalML/awesome-production-machine-learning

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

Fresh★ 21k535 entriesPushed 4 days ago
96

Static Analysis

analysis-tools-dev/static-analysis

⚙️ A curated list of static analysis (SAST) tools and linters for all programming languages, config files, build tools, and more. The focus is on tools which improve…

Fresh★ 15k532 entriesPushed 3 days ago
96

Awesome Nano Banana Pro Prompts

YouMind-OpenLab/awesome-nano-banana-pro-prompts

🍌 World's largest Nano Banana Pro prompt library — 10,000+ curated prompts with preview images, 16 languages. Google Gemini AI image generation. Free & open source.

Fresh★ 14k173 entriesPushed today
95

Contents

ossu/computer-science

🎓 Path to a free self-taught education in Computer Science!

Fresh★ 211k65 entriesPushed 7 days ago