Awesome Ai Companion
Section: Speech Recognition · C/C++ Whisper inference engine optimized for CPU, Apple Silicon, Metal, Core ML, Vulkan, CUDA, ROCm, and other local/edge targets. C++ · Cross-platform · infra.
Entry
Appears in 6 awesome lists
C/C++ Whisper inference engine optimized for CPU, Apple Silicon, Metal, Core ML, Vulkan, CUDA, ROCm, and other local/edge targets. C++ · Cross-platform · infra.
Section: Speech Recognition · C/C++ Whisper inference engine optimized for CPU, Apple Silicon, Metal, Core ML, Vulkan, CUDA, ROCm, and other local/edge targets. C++ · Cross-platform · infra.
Section: Openai · Port of OpenAI's Whisper model in C/C++
Section: Artificial Intelligence · C/C++ port of Whisper that runs efficiently on ordinary CPUs and GPUs. MIT
Section: Speech-to-text · Port of OpenAI's Whisper model in C/C++. #opensource
Section: Other · Port of OpenAI's Whisper model in C/C++
Section: Natural Language Processing · Port of OpenAI's Whisper model in C/C++
General-purpose speech recognition model for multilingual transcription, translation, language identification, and related speech tasks. Python · Self-host · infra.
industrial-grade ASR toolkit; 170× realtime on GPU, 50+ languages, built-in VAD, punctuation, speaker diarization, and emotion detection. Includes non-autoregressive SenseVoice and LLM-based Fun-ASR-Nano models.
Pure C/C++ inference engine with GGUF format support. The gold standard for CPU/GPU/Apple Silicon on-device running. Includes llama-server for OpenAI-compatible API. Now at 100K+ stars.
Terminal pair programmer that edits code in your local git repository with the model you choose. CLI · Apache-2.0
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models. (Source Code) MIT Docker/Python
AutoGPT provides accessible AI tools for building and using AI agents, offering a comprehensive framework including Forge for agent creation, agbenchmark for performance evaluation, a leaderboard for competition, a user-friendly UI, and CLI for seamless integration and management github | github…
https://github.com/openai/evals — the completion_fn abstraction = swap the system-under-test. (Best-practices: https://developers.openai.com/api/docs/guides/evaluation-best-practices)
OpenAI's cookbook includes examples of prompt engineering.