Skip to content

Entry

Kiln

Appears in 5 awesome lists

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

Open github.comkiln-ai/kiln

Found in these lists

awesome-ChatGPT-repositories

Section: Prompts · The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

FreshScore 87

Awesome LLM Resources

Section: 微调 Fine-Tuning · The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

FreshScore 91

Awesome local LLM

Section: Training and Fine-tuning · the easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets

FreshScore 90

Awesome Production Machine Learning

Section: Deployment and Serving · Kiln is an OSS tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

FreshScore 98

awesome-python

Section: LLM and Inference · Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

FreshScore 79

promptfoo

🟢 — LLM eval + red-teaming/pentesting CLI with 50+ attack plugins (MIT). Note: OpenAI announced an acquisition agreement in March 2026; remains MIT-licensed — track governance. · updated 2026-10-13); Related: Promptfoo CI Action (checkout evaluation, not base/head diff; defaults to latest,…

In 13 listsDetails

Phoenix

Open-source AI observability & evaluation platform (Arize) — OpenTelemetry-native tracing for agents, LLM-as-judge evals, versioned datasets & experiments for prompt regression testing, prompt management with version control and replay, plus an MCP endpoint so Claude Code/Cursor can query traces…

In 12 listsDetails

Langfuse

The most widely adopted self-hostable LLM observability platform: traces every agent step, manages prompt versions, and runs evals in one tool. Preferred over cloud-only alternatives when data residency or cost control is a constraint.

In 11 listsDetails

TRL

Hugging Face's post-training library — the reference implementation of GRPO (the algorithm DeepSeek popularized) and the most-used single-GPU-to-cluster starting point for RL post-training; 75+ trainers across SFT / DPO / KTO / PPO / ORPO / CPO and more, with vLLM generation, PEFT/LoRA, and AMD…

In 10 listsDetails

Prompt Engineering Guide

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

In 13 listsDetails

Helicone

Open-source LLM observability proxy (YC W23) with the largest open-source pricing database (300+ models). One-line proxy integration provides cost tracking, token monitoring, session tracing, and prompt versioning across providers. The AI Gateway component handles request routing and caching with…

In 9 listsDetails

DocsGPT

Private AI platform for building intelligent agents and assistants with enterprise search. Features Agent Builder, deep research tools, multi-format document analysis, and multi-model support. MIT licensed.

In 10 listsDetails

unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

In 8 listsDetails