Skip to content
49

Awesome LLM Security

A curation of awesome tools, documents and projects about LLM Security.

1.7k stars447 forks35 entriesLast push Aug 20, 2025 (1 year ago)License none

This page lists names, links and short descriptions. The original list on GitHub is the source and belongs to its authors.

Tools

UTCP

Secure, direct tool-calling to any native endpoint for your AI agent

Plexiglass

a security toolbox for testing and safeguarding LLMs

In 2 lists

PurpleLlama

set of tools to assess and improve LLM security.

Rebuff

a self-hardening prompt injection detector

In 5 listsDetails

Garak

a LLM vulnerability scanner

In 3 lists

LLMFuzzer

a fuzzing framework for LLMs

In 3 lists

LLM Guard

a security toolkit for LLM Interactions

In 2 lists

Vigil

a LLM prompt injection detection toolkit

In 2 lists

jailbreak-evaluation

an easy-to-use Python package for language model jailbreak evaluation

Prompt Fuzzer

the open-source tool to help you harden your GenAI applications

In 2 lists

WhistleBlower

open-source tool designed to infer the system prompt of an AI agent based on its generated text outputs.

In 2 lists

Open-Prompt-Injection

open-source tool to evaluate prompt injection attacks and defenses on benchmark datasets.

In 2 lists

Agentic Radar

Open-source CLI security scanner for agentic workflows.

In 6 listsDetails

Articles

Hacking Auto-GPT and escaping its docker container

Prompt Injection Cheat Sheet: How To Manipulate AI Language Models

A prompt injection cheat sheet for AI bot integrations.

In 2 listsLink may be dead

Indirect Prompt Injection Threats

Interactive playground for testing prompt injections.

In 3 lists

Prompt injection: What’s the worst that can happen?

General overview of Prompt Injection attacks, part of a series.

In 3 lists

OWASP Top 10 for Large Language Model Applications

Top 10 security risks for LLM applications.

In 2 lists

PoisonGPT: How we hid a lobotomized LLM on Hugging Face to spread fake news

ChatGPT Plugins: Data Exfiltration via Images & Cross Plugin Request Forgery

This post shows how a malicious website can take control of a ChatGPT chat session and exfiltrate the history of the conversation.

In 2 lists

Jailbreaking GPT-4's code interpreter

Securing LLM Systems Against Prompt Injection

The AI Attack Surface Map v1.0

Adversarial Attacks on LLMs

In 2 lists

How Anyone can Hack ChatGPT - GPT4o

Link may be dead

LLM Evaluation metrics, frmaework, and checklist

How RAG Poisoning Made Llama3 Racist!

Link may be dead

Other Awesome Projects

Gandalf

a prompt injection wargame

In 3 lists

LangChain vulnerable to code injection - CVE-2023-29374

LLM Security startups

Adversarial Prompting

A guide on the various types of adversarial prompting and ways to mitigate them.

In 3 lists

Epivolis

a prompt injection aware chatbot designed to mitigate adversarial efforts

Link may be dead

LLM Security Problems at DEFCON31 Quals

the world's top security competition

PromptBounty.io

PALLMs (Payloads for Attacking Large Language Models)

See category
98

Awesome Privacy

pluja/awesome-privacy

Awesome Privacy - A curated list of services and alternatives that respect your privacy because PRIVACY MATTERS.

Fresh★ 20k535 entriesPushed 2 days ago
98

Awesome-Selfhosted

awesome-selfhosted/awesome-selfhosted

A list of Free Software network services and web applications which can be hosted on your own servers

Fresh★ 338k1320 entriesPushed 8 days ago
94

Awesome Privacy

lissy93/awesome-privacy

🦄 A curated list of privacy & security-focused software and services

Fresh★ 10k472 entriesPushed yesterday
93

Awesome Bug Bounty Tools

vavkamil/awesome-bugbounty-tools

A curated list of various bug bounty tools

Fresh★ 6.5k397 entriesPushed 14 days ago
92

Awesome Claude Video Skills

zhuyansen/awesome-claude-video-skills

Open-source skills and toolkits that let Claude Code, Codex and other coding agents make video. 180 repos by type, each security-graded. English / 中文.

Fresh★ 2.2k506 entriesPushed today
91

Awesome Open Source SaaS Alternatives

Anil-matcha/awesome-open-source-saas-alternatives

Open source alternatives to paid SaaS apps: Notion, Slack, Auth0, Vercel and more. Curated list with licenses and GitHub stars.

Fresh★ 3.5k207 entriesPushed today