awesome-ChatGPT-repositories
Section: Others · DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
FreshScore 87
Entry
DeepSpeed
Appears in 7 awesome lists
An easy-to-use deep learning optimization software suite that enables unprecedented scale and speed for Deep Learning Training and Inference
Open github.commicrosoft/deepspeed
Found in these lists
Awesome High Performance Computing
Section: Software · An easy-to-use deep learning optimization software suite that enables unprecedented scale and speed for Deep Learning Training and Inference
FreshScore 78
awesome-huggingface
Section: Model Scalability · (from Microsoft) - Deepspeed-ZeRO - scales any model size with zero to no changes to the model. Integrated with HF Trainer.
ArchivedScore 49
Awesome LLMOps
Section: Frameworks for Training · DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
ActiveScore 75
Awesome MLOps
Section: Optimization Tools · Deep learning optimization library that makes distributed training easy, efficient, and effective.
FreshScore 80
Awesome Open Gpt
Section: GPT开源平替机器人 · 微软开源的一键式RLHF训练，让你的类ChatGPT千亿大模型提速省钱15倍，帮助用户轻松训练类ChatGPT等大语言模型，人人都有望拥有专属ChatGPT。
SlowScore 56
Awesome Open Source AI
Section: 1. Core Frameworks & Libraries · Microsoft's deep learning optimization library for extreme-scale training (ZeRO, offloading, MoE).
FreshScore 89
Often listed next to it
Docker
is an open platform for developing, shipping, and running applications. Docker enables you to separate your applications from your infrastructure so you can deliver software quickly working in collaboration with cloud, Linux, and Windows vendors, including Microsoft.
In 18 listsDetails
Colossal-AI
(from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).
In 14 listsDetails
Prometheus
is a free software application used for event monitoring and alerting. It records real-time metrics in a time series database (allowing for high dimensionality) built using a HTTP pull model, with flexible queries and real-time alerting.
In 13 listsDetails
Whisper
Whisper is a general-purpose speech recognition model that can be run locally offline. It can transcribe audio from and to multiple languages.
In 11 listsDetails
Apache Airflow
is an open-source workflow management platform created by the community to programmatically author, schedule and monitor workflows. Install. Principles. Scalable. Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers. Airflow is ready to scale to…
In 9 listsDetails
Vaex
Vaex is a high performance Python library for lazy Out-of-Core DataFrames (similar to Pandas), to visualize and explore big tabular datasets. Vaex uses memory mapping, zero memory copy policy and lazy computations for best performance (no memory wasted).
In 9 listsDetails
Kubernetes
is an open-source system for automating deployment, scaling, and management of containerized applications.
In 10 listsDetails
gpt-researcher
GPT Researcher is an AI-powered autonomous agent designed for efficient and unbiased online research, generating detailed reports by leveraging recent advancements in AI and web scraping, with a focus on speed, reliability, and cost-effectiveness github | github profile
In 9 listsDetails