Skip to content

Entry

garak

Appears in 5 awesome lists

NVIDIA-maintained Generative AI Red-teaming & Assessment Kit that scans LLMs for hallucinations, data leakage, prompt injection, and jailbreaks using a comprehensive probe library, now the industry-standard open-source LLM vulnerability scanner.

Open github.comnvidia/garak

Found in these lists

Awesome AI Security Tools

Section: Scanners, Evals & Guardrails · 🟢 — The LLM vulnerability scanner — probes for prompt injection, jailbreaks, data leakage, and more. (NVIDIA) · updated 2026-10-10); Related: PyRIT · promptfoo

FreshScore 91

Awesome local LLM

Section: Security and Sandboxing · the LLM vulnerability scanner from NVIDIA

FreshScore 90

Awesome Open Source AI

Section: 8. MLOps / LLMOps & Production · The LLM vulnerability scanner. Probes models for hallucinations, data leakage, prompt injection, misinformation, toxicity, and jailbreaks. Extensive plugin-based architecture with 100+ vulnerability probes. Apache 2.0 licensed.

FreshScore 87

Awesome Prompts

Section: Red Team & Security · LLM vulnerability scanner by NVIDIA — red teaming, prompt injection, jailbreak, and leakage detection.

FreshScore 96

Hacking Tools

Section: AI & Machine Learning Security · NVIDIA-maintained Generative AI Red-teaming & Assessment Kit that scans LLMs for hallucinations, data leakage, prompt injection, and jailbreaks using a comprehensive probe library, now the industry-standard open-source LLM vulnerability scanner.

FreshScore 90

Opik

Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…

In 18 listsDetails

LiteLLM

Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider…

In 16 listsDetails

OrcaReplay

by Continuum AI - Records a Claude Code run through a local proxy and replays it offline, reproducing it byte-for-byte with the network off, or forking it from any checkpoint onto a different model. Capture happens below the harness, so shell exit codes, per-turn file changes and MCP calls land on…

In 14 listsDetails

promptfoo

🟢 — LLM eval + red-teaming/pentesting CLI with 50+ attack plugins (MIT). Note: OpenAI announced an acquisition agreement in March 2026; remains MIT-licensed — track governance. · updated 2026-10-13); Related: Promptfoo CI Action (checkout evaluation, not base/head diff; defaults to latest,…

In 13 listsDetails

Dagster

Cloud-native orchestration platform for developing and maintaining data assets including ML models. Declarative programming model with integrated lineage and observability. Apache 2.0 licensed.

In 12 listsDetails

Phoenix

Open-source AI observability & evaluation platform (Arize) — OpenTelemetry-native tracing for agents, LLM-as-judge evals, versioned datasets & experiments for prompt regression testing, prompt management with version control and replay, plus an MCP endpoint so Claude Code/Cursor can query traces…

In 12 listsDetails

Prefect

Workflow management system that makes it easy to take your data pipelines and add semantics like retries, logging, dynamic mapping, caching, failure notifications, and more.

In 11 listsDetails

KubeStellar Console

Multi-cluster Kubernetes MCP server bridging Gemini CLI to kubeconfig and Kubernetes APIs. Manage clusters, policies, and 20+ CNCF project integrations across edge and cloud. Install via brew tap kubestellar/tap && brew install kc-agent.

In 14 listsDetails