Skip to content

Entry

whisper.cpp

Appears in 5 awesome lists

is a high-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model.

Open github.comggerganov/whisper.cpp

Found in these lists

awesome-ChatGPT-repositories

Section: Openai · Port of OpenAI's Whisper model in C/C++

FreshScore 87

Awesome Generative AI

Section: Speech-to-text (STT) and spoken content analysis · Port of OpenAI's Whisper model in C/C++. It can be executed locally.

SlowScore 58

Awesome LLMOps

Section: Large Model Serving · Port of OpenAI's Whisper model in C/C++

FreshScore 91

Awesome Whisper

Section: Model variants · Port of Whisper in C++.

ActiveScore 78

Table of Contents

Section: Text-To-Speech Synthesis (TTS) · is a high-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model.

SlowScore 60

FunASR

industrial-grade ASR toolkit; 170× realtime on GPU, 50+ languages, built-in VAD, punctuation, speaker diarization, and emotion detection. Includes non-autoregressive SenseVoice and LLM-based Fun-ASR-Nano models.

In 12 listsDetails

vLLM

State-of-the-art serving engine with PagedAttention and continuous batching. Currently the fastest production-grade LLM server.

In 11 listsDetails

Flowise

Flowise simplifies the creation of applications leveraging large language models (LLMs) by providing a drag-and-drop interface for customizing AI workflows, offering easy installation, Docker support, development tools, and documentation for integrating various functionalities such as…

In 12 listsDetails

AutoGPT

AutoGPT provides accessible AI tools for building and using AI agents, offering a comprehensive framework including Forge for agent creation, agbenchmark for performance evaluation, a leaderboard for competition, a user-friendly UI, and CLI for seamless integration and management github | github…

In 10 listsDetails

TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference…

In 8 listsDetails

OpenAI Evals

https://github.com/openai/evals — the completion_fn abstraction = swap the system-under-test. (Best-practices: https://developers.openai.com/api/docs/guides/evaluation-best-practices)

In 8 listsDetails

OpenAI Cookbook

OpenAI's cookbook includes examples of prompt engineering.

In 9 listsDetails

shimmy

Python-free Rust inference server with OpenAI API compatibility. Supports GGUF and SafeTensors formats with hot model swap, auto-discovery, and single binary deployment for zero-dependency inference. Apache 2.0 licensed.

In 7 listsDetails