Skip to content

Entry

Open Multi-Agent

Appears in 5 awesome lists

Open Multi-Agent — https://github.com/open-multi-agent/open-multi-agent/blob/main/docs/evaluation.md · tool/framework — 🆕 TypeScript-native, versioned EvalSets with offline JSON/Markdown/JUnit reports, baseline regression gates for CI, and opt-in production sampling that scores settled runs…

Open github.comopen-multi-agent/open-multi-agent

Found in these lists

Awesome Agent Orchestrators

Section: Agent Infrastructure & Primitives · TypeScript-native runtime where a coordinator turns a goal into a task DAG and a deterministic scheduler runs specialized agents, with approvals, traces, evaluation, checkpoints, and resume support.

FreshScore 86

awesome-ChatGPT-repositories

Section: NLP · Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it, audit it.

FreshScore 87

Awesome Agent Evals

Section: 5b · TypeScript/JS-native eval runners · Open Multi-Agent — https://github.com/open-multi-agent/open-multi-agent/blob/main/docs/evaluation.md · tool/framework — 🆕 TypeScript-native, versioned EvalSets with offline JSON/Markdown/JUnit reports, baseline regression gates for CI, and opt-in production sampling that scores settled runs…

FreshScore 87

Awesome Open Source AI

Section: 4. Agentic AI & Multi-Agent Systems · MIT-licensed TypeScript-native orchestration framework that plans multi-agent task DAGs at runtime, with approval gates, tracing, evaluation, checkpoints, and resumable execution in your own environment.

FreshScore 87

Awesome OpenTelemetry

Section: GenAI / LLM Instrumentation · Optional TypeScript adapter that maps OMA TraceRecord v2 batches to OpenTelemetry spans, events, and links through an application-owned tracer or provider; the core package keeps no OpenTelemetry runtime dependency.

FreshScore 79

Opik

Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…

In 18 listsDetails

OrcaReplay

by Continuum AI - Records a Claude Code run through a local proxy and replays it offline, reproducing it byte-for-byte with the network off, or forking it from any checkpoint onto a different model. Capture happens below the harness, so shell exit codes, per-turn file changes and MCP calls land on…

In 14 listsDetails

transformers

(formerly known as pytorch-transformers and pytorch-pretrained-bert) provides state-of-the-art general-purpose architectures (BERT, GPT-2, RoBERTa, XLM, DistilBert, XLNet, CTRL...) for Natural Language Understanding (NLU) and Natural Language Generation (NLG) with over 32+ pretrained models in…

In 14 listsDetails

mem0

The most-deployed memory layer for AI agents — drop-in add/search/update/delete fact storage with LLM-extracted long-term / short-term / semantic memory: automatic fact consolidation (dedup, contradiction resolution, decay) so agents keep "context that persists" without context bloat;…

In 14 listsDetails

Haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…

In 13 listsDetails

deja-vu

Indexes coding-agent sessions already written to disk and serves them back over MCP with no LLM calls, embeddings, or API keys. The zero-dependency binary solves the memory cold-start problem for cross-session persistence and demonstrates that agent memory can be built on existing filesystem…

In 11 listsDetails

Mastra

TypeScript-native agent framework (from the Gatsby team) with 22K+ stars and 300K+ weekly npm downloads. Connects to 40+ providers through one standard interface, with built-in workflows, RAG pipelines, and agent orchestration. The @mastra/deployer handles serverless deployment, and the eval…

In 12 listsDetails

Semantic Kernel

Semantic Kernel is an SDK that integrates Large Language Models (LLMs) like OpenAI, Azure OpenAI, and Hugging Face with conventional programming languages like C#, Python, and Java. Semantic Kernel achieves this by allowing you to define plugins that can be chained together in just a few lines of…

In 11 listsDetails