Skip to content

Entry

Colossal-AI

Appears in 14 awesome lists

(from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).

Open github.comhpcaitech/colossalai

Found in these lists

awesome-ChatGPT-repositories

Section: Others · Making large AI models cheaper, faster and more accessible

FreshScore 87

Awesome Data Analysis

Section: Tools · High-performance distributed training framework.

FreshScore 79

Awesome Deep Learning

Section: Frameworks

SlowScore 45

Awesome First Pull Request Opportunities

Section: Python · (label: good first issue) An open-source deep learning system for large-scale model training and inference with high efficiency and low cost.

FreshScore 91

Awesome Generative AI

Section: Large Language Models (LLMs) · Making large AI models cheaper, faster and more accessible

SlowScore 58

awesome-huggingface

Section: Model Scalability · (from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).

ArchivedScore 55

Awesome LangChain

Section: Agents · LLM training and inference system whose ColossalChat application implements LLM with RLHF

FreshScore 94

Awesome LLMOps

Section: Frameworks for Training · An integrated large-scale model training system with efficient parallelization techniques.

FreshScore 91

Awesome Machine Learning

Section: Python · An open-source deep learning system for large-scale model training and inference with high efficiency and low cost.

FreshScore 93

Awesome Open Source AI

Section: 7. Training & Fine-tuning Ecosystem · Unified system for 100B+ models.

FreshScore 87

Awesome Production Machine Learning

Section: Computation and Communication Optimisation · A unified deep learning system for big model era, which helps users to efficiently and quickly deploy large AI model training and inference.

FreshScore 98

awesome-python

Section: Other · Making large AI models cheaper, faster and more accessible

FreshScore 79

Table of Contents

Section: Other LLaMA-derived projects: · An open-source solution for cloning ChatGPT with a complete RLHF pipeline.

StaleScore 44

Awesome AI Agents: Tools, Resources, and Projects

Section: Repositories · implement LLM with RLHF, powered by the Colossal-AI project. github

SlowScore 66

TensorFlow

How to use the Hexagon Delegate to speed up model inference on mobile and edge devices. Also see blog post Accelerating TensorFlow Lite on Qualcomm Hexagon DSPs.

In 23 listsDetails

Opik

Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…

In 18 listsDetails

PyTorch

(label: good first issue) PyTorch is an open source machine learning library based on the Torch library, used for applications such as computer vision and natural language processing.

In 16 listsDetails

LiteLLM

Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider…

In 16 listsDetails

Whisper

General-purpose speech recognition model for multilingual transcription, translation, language identification, and related speech tasks. Python · Self-host · infra.

In 13 listsDetails

Haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…

In 13 listsDetails

vLLM

State-of-the-art serving engine with PagedAttention and continuous batching. Currently the fastest production-grade LLM server.

In 11 listsDetails

Supercov

Coverage, security and code quality for coding agents. Gemini CLI extension that runs the project's existing tests, measures line, branch and MC/DC coverage, and hands Gemini the untested code to test next. Install with gemini extensions install https://github.com/supercorp-ai/supercov.

In 9 listsDetails