awesome-ChatGPT-repositories
Section: Openai · Port of OpenAI's Whisper model in C/C++
Entry
Appears in 5 awesome lists
is a high-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model.
Section: Openai · Port of OpenAI's Whisper model in C/C++
Section: Speech-to-text (STT) and spoken content analysis · Port of OpenAI's Whisper model in C/C++. It can be executed locally.
Section: Large Model Serving · Port of OpenAI's Whisper model in C/C++
Section: Model variants · Port of Whisper in C++.
Section: Text-To-Speech Synthesis (TTS) · is a high-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model.
industrial-grade ASR toolkit; 170× realtime on GPU, 50+ languages, built-in VAD, punctuation, speaker diarization, and emotion detection. Includes non-autoregressive SenseVoice and LLM-based Fun-ASR-Nano models.
State-of-the-art serving engine with PagedAttention and continuous batching. Currently the fastest production-grade LLM server.
Flowise simplifies the creation of applications leveraging large language models (LLMs) by providing a drag-and-drop interface for customizing AI workflows, offering easy installation, Docker support, development tools, and documentation for integrating various functionalities such as…
AutoGPT provides accessible AI tools for building and using AI agents, offering a comprehensive framework including Forge for agent creation, agbenchmark for performance evaluation, a leaderboard for competition, a user-friendly UI, and CLI for seamless integration and management github | github…
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference…
https://github.com/openai/evals — the completion_fn abstraction = swap the system-under-test. (Best-practices: https://developers.openai.com/api/docs/guides/evaluation-best-practices)
OpenAI's cookbook includes examples of prompt engineering.