Skip to content

Entry

NeMo Guardrails

Appears in 6 awesome lists

NVIDIA's programmable guardrails toolkit: define input, dialog, retrieval, execution, and output rails that intercept the agent loop at five distinct layers using the Colang DSL. The execution rail layer specifically governs what tools the LLM can invoke and what their inputs/outputs may contain —…

Open github.comnvidia-nemo/guardrails

Found in these lists

Awesome AI Security Tools

Section: Scanners, Evals & Guardrails · 🟢 — Programmable guardrails (input/output/dialog/retrieval rails) for LLM apps. (NVIDIA) · updated 2026-10-10); Related: Backtranslation-defense reproduction (historical; legacy FastChat/GPU and model judges, separate bundled-code terms) · Jailbreak-defense research library (historical; local…

FreshScore 91

Awesome Harness Engineering

Section: Security, Sandbox & Permissions · NVIDIA's programmable guardrails toolkit: define input, dialog, retrieval, execution, and output rails that intercept the agent loop at five distinct layers using the Colang DSL. The execution rail layer specifically governs what tools the LLM can invoke and what their inputs/outputs may contain —…

FreshScore 93

Awesome local LLM

Section: Security and Sandboxing · an open-source toolkit from NVIDIA for easily adding programmable guardrails to LLM-based conversational systems

FreshScore 90

Awesome Open Source AI

Section: 10. AI Safety, Alignment & Interpretability · Programmable guardrails toolkit for LLM-based conversational systems. Uses Colang DSL to define safety rules, dialog flows, and content boundaries. Integrates with LangChain, LangGraph, and LlamaIndex for production deployments. Apache 2.0 licensed.

FreshScore 87

Awesome Production Machine Learning

Section: Privacy and Safety · NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

FreshScore 98

awesome-python

Section: LLM and Inference · NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

FreshScore 79

promptfoo

🟢 — LLM eval + red-teaming/pentesting CLI with 50+ attack plugins (MIT). Note: OpenAI announced an acquisition agreement in March 2026; remains MIT-licensed — track governance. · updated 2026-10-13); Related: Promptfoo CI Action (checkout evaluation, not base/head diff; defaults to latest,…

In 13 listsDetails

E2B

Open-source sandboxed code execution for AI agents — Firecracker microVMs with dedicated kernels per sandbox (~150 ms cold start), fork/snapshot primitives (pause/resume with full memory state), Python/JS SDKs + MCP server, self-hostable via Terraform on AWS/GCP; used by Perplexity, Hugging Face,…

In 9 listsDetails

Guardrails AI

🟢 — Python framework for adding input/output guards, validators, structured-output controls, and Guardrails Hub checks to LLM applications. (Guardrails AI) · updated 2026-08-26); Related: NeMo Guardrails · LLM Guard · Pydantic AI Shields integration (README recommends a successor)

In 7 listsDetails

LangKit

LLM monitoring toolkit from WhyLabs that extracts safety and security signals including jailbreak similarity, prompt-injection similarity, hallucination checks, PII patterns, toxicity, and refusal metrics for production observability.

In 6 listsDetails

TextAttack

Python framework for adversarial attacks, data augmentation, and model training in NLP. Augment datasets to increase model robustness and generate adversarial examples. MIT licensed.

In 6 listsDetails

microsandbox

Rust/Apache-2.0 local-first microVM runtime for untrusted agent workloads: <100ms boots, OCI-image compatible, fork-and-snapshot of live sandboxes, and an embeddable library API that spawns VMs in-process with no daemon. The distinguishing designs are secret handling — keys never enter the VM, so…

In 5 listsDetails

Agent Governance Toolkit

🟢 — Multi-language toolkit for policy-enforced agent tool calls and audit records, with optional identity, MCP-gateway, sandboxing, reliability, and compliance components. (Microsoft) — note: official public preview; APIs and deployment patterns may change before general availability. · updated…;…

In 5 listsDetails

OpenShell

Open-source policy-driven sandbox runtime for autonomous AI agents, announced at GTC 2026. Enforces security constraints at the kernel level via Landlock LSM (filesystem), seccomp BPF (syscalls), and an OPA/Rego-evaluated HTTP CONNECT proxy (network) — constraints are enforced on the environment…

In 5 listsDetails