Skip to content

Entry

Colossal-AI

Appears in 14 awesome lists

(from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).

Open github.comhpcaitech/colossalai

Found in these lists

awesome-ChatGPT-repositories

Section: Others · Making large AI models cheaper, faster and more accessible

FreshScore 87

Awesome Data Analysis

Section: Tools · High-performance distributed training framework.

FreshScore 80

Awesome Deep Learning

Section: Frameworks

SlowScore 59

Awesome First Pull Request Opportunities

Section: Python · (label: good first issue) An open-source deep learning system for large-scale model training and inference with high efficiency and low cost.

ActiveScore 83

Awesome Generative AI

Section: Large Language Models (LLMs) · Making large AI models cheaper, faster and more accessible

SlowScore 62

awesome-huggingface

Section: Model Scalability · (from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).

ArchivedScore 49

Awesome LangChain

Section: Agents · LLM training and inference system whose ColossalChat application implements LLM with RLHF

FreshScore 90

Awesome LLMOps

Section: Frameworks for Training · An integrated large-scale model training system with efficient parallelization techniques.

ActiveScore 75

Awesome Machine Learning

Section: Python · An open-source deep learning system for large-scale model training and inference with high efficiency and low cost.

FreshScore 93

Awesome Open Source AI

Section: 7. Training & Fine-tuning Ecosystem · Unified system for 100B+ models.

FreshScore 89

Awesome Production Machine Learning

Section: Computation and Communication Optimisation · A unified deep learning system for big model era, which helps users to efficiently and quickly deploy large AI model training and inference.

FreshScore 92

Table of Contents

Section: Other LLaMA-derived projects: · An open-source solution for cloning ChatGPT with a complete RLHF pipeline.

StaleScore 52

Awesome AI Agents: Tools, Resources, and Projects

Section: Repositories · implement LLM with RLHF, powered by the Colossal-AI project. github

SlowScore 68

awesome-python

Section: Other · Making large AI models cheaper, faster and more accessible

FreshScore 81

TensorFlow

How to use the Hexagon Delegate to speed up model inference on mobile and edge devices. Also see blog post Accelerating TensorFlow Lite on Qualcomm Hexagon DSPs.

In 23 listsDetails

PyTorch

(label: good first issue) PyTorch is an open source machine learning library based on the Torch library, used for applications such as computer vision and natural language processing.

In 16 listsDetails

LiteLLM

Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider…

In 16 listsDetails

Opik

Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…

In 16 listsDetails

Haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…

In 13 listsDetails

Whisper

Whisper is a general-purpose speech recognition model that can be run locally offline. It can transcribe audio from and to multiple languages.

In 11 listsDetails

vLLM

State-of-the-art serving engine with PagedAttention and continuous batching. Currently the fastest production-grade LLM server.

In 11 listsDetails

MindsDB

MindsDB is an Explainable AutoML framework for developers. With MindsDB you can build, train and use state of the art ML models in as simple as one line of code.

In 11 listsDetails