Skip to content

Entry

Megatron-LM

Appears in 4 awesome lists

Distributed training framework and reference codebase for large transformer models at scale.

Open github.comnvidia/megatron-lm

Found in these lists

Awesome Open Source AI

Section: 7. Training & Fine-tuning Ecosystem · Distributed training framework and reference codebase for large transformer models at scale.

FreshScore 87

Awesome Production Machine Learning

Section: Industry Strength Natural Language Processing · Megatron-LM is a highly optimized and efficient library for training large language models.

FreshScore 98

awesome-python

Section: Other · Ongoing research training transformer models at scale

FreshScore 79

Awesome Transformer & Transfer Learning in NLP

Section: PyTorch · Ongoing research training transformer language models at scale, including: BERT.

StaleScore 52

Awesome Machine Learning

The definitive curated list of machine learning frameworks, libraries and software organized by language. Covers Python, C++, Java, JavaScript, and more with comprehensive coverage of the ML ecosystem. CC0-1.0 licensed.

In 16 listsDetails

Free Programming Books

In multiple languages – Free programming books organized into language-specific collections.

In 8 listsDetails

LangChain

Langchain integrates various providers like Anthropic, AWS, and OpenAI, and offers tools for components such as LLMs, chat models, and data analysis, supporting functionalities from Alpha Vantage to YouTube github | docs

In 22 listsDetails

Opik

Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…

In 18 listsDetails

Awesome Artificial Intelligence

Curated list of artificial intelligence courses, books, video lectures, and papers for developers and researchers. MIT licensed.

In 8 listsDetails

transformers

(formerly known as pytorch-transformers and pytorch-pretrained-bert) provides state-of-the-art general-purpose architectures (BERT, GPT-2, RoBERTa, XLM, DistilBert, XLNet, CTRL...) for Natural Language Understanding (NLU) and Natural Language Generation (NLG) with over 32+ pretrained models in…

In 14 listsDetails

Ray

A fast and simple framework for building and running distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library. ray.io

In 14 listsDetails

LlamaIndex

(MIT) provides modules for structured outputs at different levels of abstraction, including output parsers for text completion endpoints, Pydantic programs for mapping prompts to structured outputs using function calling or output parsing, and pre-defined Pydantic programs for specific output types.

In 14 listsDetails