awesome-ChatGPT-repositories
Section: Others · Making large AI models cheaper, faster and more accessible
Entry
Appears in 14 awesome lists
(from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).
Section: Others · Making large AI models cheaper, faster and more accessible
Section: Tools · High-performance distributed training framework.
Section: Frameworks
Section: Python · (label: good first issue) An open-source deep learning system for large-scale model training and inference with high efficiency and low cost.
Section: Large Language Models (LLMs) · Making large AI models cheaper, faster and more accessible
Section: Model Scalability · (from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).
Section: Agents · LLM training and inference system whose ColossalChat application implements LLM with RLHF
Section: Frameworks for Training · An integrated large-scale model training system with efficient parallelization techniques.
Section: Python · An open-source deep learning system for large-scale model training and inference with high efficiency and low cost.
Section: 7. Training & Fine-tuning Ecosystem · Unified system for 100B+ models.
Section: Computation and Communication Optimisation · A unified deep learning system for big model era, which helps users to efficiently and quickly deploy large AI model training and inference.
Section: Other LLaMA-derived projects: · An open-source solution for cloning ChatGPT with a complete RLHF pipeline.
Section: Repositories · implement LLM with RLHF, powered by the Colossal-AI project. github
Section: Other · Making large AI models cheaper, faster and more accessible
How to use the Hexagon Delegate to speed up model inference on mobile and edge devices. Also see blog post Accelerating TensorFlow Lite on Qualcomm Hexagon DSPs.
(label: good first issue) PyTorch is an open source machine learning library based on the Torch library, used for applications such as computer vision and natural language processing.
Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider…
Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…
Whisper is a general-purpose speech recognition model that can be run locally offline. It can transcribe audio from and to multiple languages.