Skip to content
49

Awesome Software Engineering for Machine Learning

A curated list of articles that cover the software engineering best practices for building machine learning applications.

1.4k stars122 forks84 entriesLast push Mar 26, 2024 (2 years ago)License CC0-1.0

This page lists names, links and short descriptions. The original list on GitHub is the source and belongs to its authors.

Broad Overviews

AI Engineering: 11 Foundational Practices

Best Practices for Machine Learning Applications

Engineering Best Practices for Machine Learning

Hidden Technical Debt in Machine Learning Systems

πŸŽ“

Rules of Machine Learning: Best Practices for ML Engineering

(Google)

In 3 lists

Software Engineering for Machine Learning: A Case Study

πŸŽ“

Data Management

A Survey on Data Collection for Machine Learning A Big Data - AI Integration Perspective_2019

πŸŽ“

Automating Large-Scale Data Quality Verification

πŸŽ“

Data management challenges in production machine learning

Data Validation for Machine Learning

πŸŽ“

How to organize data labelling for ML

The curse of big data labeling and three ways to solve it

The Data Linter: Lightweight, Automated Sanity Checking for ML Data Sets

πŸŽ“

The ultimate guide to data labeling for ML

Model Training

10 Best Practices for Deep Learning

Apples-to-apples in cross-validation studies: pitfalls in classifier performance measurement

πŸŽ“

Link may be dead

Fairness On The Ground: Applying Algorithmic FairnessApproaches To Production Systems

πŸŽ“

Link may be dead

How do you manage your Machine Learning Experiments?

Link may be dead

Machine Learning Testing: Survey, Landscapes and Horizons

πŸŽ“

Nitpicking Machine Learning Technical Debt

On Comparing Classifiers: Pitfalls to Avoid and a Recommended Approach

πŸŽ“

On human intellect and machine failures: Troubleshooting integrative machine learning systems

πŸŽ“

Pitfalls and Best Practices in Algorithm Configuration

πŸŽ“

Pitfalls of supervised feature selection

πŸŽ“

Link may be dead

Preparing and Architecting for Machine Learning

Link may be dead

Preliminary Systematic Literature Review of Machine Learning System Development Process

πŸŽ“

Software development best practices in a deep learning environment

Link may be dead

Testing and Debugging in Machine Learning

What Went Wrong and Why? Diagnosing Situated Interaction Failures in the Wild

πŸŽ“

Deployment and Operation

Best Practices in Machine Learning Infrastructure

Building Continuous Integration Services for Machine Learning

πŸŽ“

Continuous Delivery for Machine Learning

(Martin Fowler)

In 2 lists

Continuous Training for Production ML in the TensorFlow Extended (TFX) Platform

πŸŽ“

Fairness Indicators: Scalable Infrastructure for Fair ML Systems

πŸŽ“

Machine Learning Logistics

Link may be dead

Machine learning: Moving from experiments to production

ML Ops: Machine Learning as an engineered disciplined

(Medium)

In 2 listsLink may be dead

Model Governance Reducing the Anarchy of Production

πŸŽ“

ModelOps: Cloud-based lifecycle management for reliable and trusted AI

Operational Machine Learning

Scaling Machine Learning as a Service

πŸŽ“

TFX: A tensorflow-based Production-Scale ML Platform

πŸŽ“

Link may be dead

The ML Test Score: A Rubric for ML Production Readiness and Technical Debt Reduction

πŸŽ“

Underspecification Presents Challenges for Credibility in Modern Machine Learning

πŸŽ“

Versioning for end-to-end machine learning pipelines

πŸŽ“

Link may be dead

Social Aspects

Data Scientists in Software Teams: State of the Art and Challenges

πŸŽ“

Machine Learning Interviews

Managing Machine Learning Projects

Link may be dead

Principled Machine Learning: Practices and Tools for Efficient Collaboration

Governance

A Human-Centered Interpretability Framework Based on Weight of Evidence

πŸŽ“

An Architectural Risk Analysis Of Machine Learning Systems

Beyond Debiasing

Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing

πŸŽ“

Link may be dead

Inherent trade-offs in the fair determination of risk scores

πŸŽ“

Responsible AI practices

Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims

(2020) Arxiv

In 2 lists

Understanding Software-2.0

πŸŽ“

Link may be dead

Tooling

Aim

Aim is an open source experiment tracking tool.

Airflow

Programmatically author, schedule and monitor workflows.

In 9 listsDetails

Alibi Detect

Python library focused on outlier, adversarial and drift detection.

In 6 listsDetails

Archai

Neural architecture search.

In 2 lists

Data Version Control (DVC)

DVC is a data and ML experiments management tool.

In 4 lists

Facets Overview / Facets Dive

Robust visualizations to aid in understanding machine learning datasets.

FairLearn

A toolkit to assess and improve the fairness of machine learning models.

Git Large File System (LFS)

Replaces large files such as datasets with text pointers inside Git.

In 5 listsDetails

Great Expectations

Data validation and testing with integration in pipelines.

In 5 listsDetails

HParams

A thoughtful approach to configuration management for machine learning projects.

Kubeflow

A platform for data scientists who want to build and experiment with ML pipelines.

In 4 lists

Label Studio

A multi-type data labeling and annotation tool with standardized output format.

In 4 lists

LiFT

Linkedin fairness toolkit.

MLFlow

Manage the ML lifecycle, including experimentation, deployment, and a central model registry.

In 6 listsDetails

Model Card Toolkit

Streamlines and automates the generation of model cards; for model documentation.

In 2 lists

Neptune.ai

Experiment tracking tool bringing organization and collaboration to data science projects.

In 6 listsLink may be dead

Neuraxle

Sklearn-like framework for hyperparameter tuning and AutoML in deep learning projects.

In 4 listsDetails

OpenML

An inclusive movement to build an open, organized, online ecosystem for machine learning.

PyTorch Lightning

The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.

In 2 lists

REVISE: REvealing VIsual biaSEs

Automatically detect bias in visual data sets.

Robustness Metrics

Lightweight modules to evaluate the robustness of classification models.

Seldon Core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models on Kubernetes.

In 6 listsDetails

Spark Machine Learning

Spark’s ML library consisting of common learning algorithms and utilities.

In 3 lists

TensorBoard

TensorFlow's Visualization Toolkit.

In 2 lists

Tensorflow Extended (TFX)

An end-to-end platform for deploying production ML pipelines.

Tensorflow Data Validation (TFDV)

Library for exploring and validating machine learning data. Similar to Great Expectations, but for Tensorflow data.

In 4 listsDetails

Weights & Biases

Experiment tracking, model optimization, and dataset versioning.

In 2 lists
See category
100

Table of Contents

hesreallyhim/awesome-claude-code

A hand-picked collection of the finest of resources for the most awesome of agents, Claude Code, the undisputed champion of coding companions, from the unstoppable team…

Freshβ˜… 58k252 entriesPushed today
100

Awesome Agent Skills

VoltAgent/awesome-agent-skills

A curated collection of 1000+ agent skills from official dev teams and the community, compatible with Claude Code, Codex, Gemini CLI, Cursor, and more.

Freshβ˜… 37k965 entriesPushed today
98

Awesome Production Machine Learning

EthicalML/awesome-production-machine-learning

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

Freshβ˜… 21k535 entriesPushed 4 days ago
96

Static Analysis

analysis-tools-dev/static-analysis

βš™οΈ A curated list of static analysis (SAST) tools and linters for all programming languages, config files, build tools, and more. The focus is on tools which improve…

Freshβ˜… 15k532 entriesPushed 3 days ago
96

Awesome Nano Banana Pro Prompts

YouMind-OpenLab/awesome-nano-banana-pro-prompts

🍌 World's largest Nano Banana Pro prompt library β€” 10,000+ curated prompts with preview images, 16 languages. Google Gemini AI image generation. Free & open source.

Freshβ˜… 14k173 entriesPushed today
95

Contents

ossu/computer-science

πŸŽ“ Path to a free self-taught education in Computer Science!

Freshβ˜… 211k65 entriesPushed 7 days ago