Skip to content

Entry

DeepSpeed

Appears in 7 awesome lists

An easy-to-use deep learning optimization software suite that enables unprecedented scale and speed for Deep Learning Training and Inference

Open github.commicrosoft/deepspeed

Found in these lists

awesome-ChatGPT-repositories

Section: Others · DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

FreshScore 87

Awesome High Performance Computing

Section: Software · An easy-to-use deep learning optimization software suite that enables unprecedented scale and speed for Deep Learning Training and Inference

FreshScore 78

awesome-huggingface

Section: Model Scalability · (from Microsoft) - Deepspeed-ZeRO - scales any model size with zero to no changes to the model. Integrated with HF Trainer.

ArchivedScore 55

Awesome LLMOps

Section: Frameworks for Training · DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

FreshScore 91

Awesome MLOps

Section: Optimization Tools · Deep learning optimization library that makes distributed training easy, efficient, and effective.

FreshScore 86

Awesome Open Gpt

Section: GPT开源平替机器人 · 微软开源的一键式RLHF训练,让你的类ChatGPT千亿大模型提速省钱15倍,帮助用户轻松训练类ChatGPT等大语言模型,人人都有望拥有专属ChatGPT。

StaleScore 55

Awesome Open Source AI

Section: 1. Core Frameworks & Libraries · Microsoft's deep learning optimization library for extreme-scale training (ZeRO, offloading, MoE).

FreshScore 87

Docker

is an open platform for developing, shipping, and running applications. Docker enables you to separate your applications from your infrastructure so you can deliver software quickly working in collaboration with cloud, Linux, and Windows vendors, including Microsoft.

In 20 listsDetails

Colossal-AI

(from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).

In 14 listsDetails

Prometheus

is a free software application used for event monitoring and alerting. It records real-time metrics in a time series database (allowing for high dimensionality) built using a HTTP pull model, with flexible queries and real-time alerting.

In 15 listsDetails

Whisper

General-purpose speech recognition model for multilingual transcription, translation, language identification, and related speech tasks. Python · Self-host · infra.

In 13 listsDetails

Kubernetes

is an open-source system for automating deployment, scaling, and management of containerized applications.

In 12 listsDetails

Supercov

Coverage, security and code quality for coding agents. Gemini CLI extension that runs the project's existing tests, measures line, branch and MC/DC coverage, and hands Gemini the untested code to test next. Install with gemini extensions install https://github.com/supercorp-ai/supercov.

In 9 listsDetails

Apache Airflow

is an open-source workflow management platform created by the community to programmatically author, schedule and monitor workflows. Install. Principles. Scalable. Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers. Airflow is ready to scale to…

In 9 listsDetails

Jan

Jan is an open-source, development-stage ChatGPT alternative that operates fully offline on diverse hardware platforms, supporting universal architectures from PCs to multi-GPU clusters github | github profile

In 8 listsDetails