MLCommons

All

112 repositories

modelbench
Public
Run safety benchmarks against AI models and view detailed reports showing how well they performed.
Python
•
Apache License 2.0
•24•99•393•8•Updated Aug 7, 2025Aug 7, 2025
inference
Public
Reference implementations of MLPerf™ inference benchmarks
benchmark machine-learning
Python
•
Apache License 2.0
•570•1.4k•230•21•Updated Aug 6, 2025Aug 6, 2025
croissant
Public
Croissant is a high-level format for machine learning datasets that brings together four rich layers.
machine-learning schema-org json-ld datasets
Jupyter Notebook
•
Apache License 2.0
•77•681•161•32•Updated Aug 6, 2025Aug 6, 2025
mlperf_inference_test_submissions_v5.0
Public
Mermaid
•5•0•0•0•Updated Aug 6, 2025Aug 6, 2025
mlperf-automations
Public
This repository contains automation scripts designed to run MLPerf Inference benchmarks. Originally developed for the Collective Mind (CM) automation framework, these scripts have been adapted to leverage the MLC automation framework, maintained by the MLCommons Benchmark Infrastructure Working Group.
automation mlperf mlperf-inference mlcflow mlperf-automations
Python
•
Apache License 2.0
•16•8•77•1•Updated Aug 6, 2025Aug 6, 2025
algorithmic-efficiency
Public
MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvements in both training algorithms and models.
Python
•
Apache License 2.0
•73•389•29•5•Updated Aug 6, 2025Aug 6, 2025
dynabench
Public
Python
•
MIT License
•18•24•10•5•Updated Aug 5, 2025Aug 5, 2025
mlperf_inference_submissions
Public template
Shell
•
Apache License 2.0
•7•0•0•1•Updated Aug 5, 2025Aug 5, 2025
inference_results_visualization_template
Public template
JavaScript
•
Apache License 2.0
•8•0•2•1•Updated Aug 5, 2025Aug 5, 2025
modelplane
Public
Python
•
Apache License 2.0
•0•0•9•0•Updated Aug 5, 2025Aug 5, 2025
mobile_app_open
Public
Mobile App Open
C++
•
Apache License 2.0
•28•59•38•2•Updated Aug 5, 2025Aug 5, 2025
storage_results_v2.0
Public
This repository contains the results and code for the MLPerf™ Storage v2.0 benchmark.
benchmark machine-learning ai ai-benchmark ml-benchmark
Python
•
Apache License 2.0
•1•1•0•0•Updated Aug 4, 2025Aug 4, 2025
mlperf_automotive_submissions
Public template
Shell
•
Apache License 2.0
•0•0•0•0•Updated Aug 4, 2025Aug 4, 2025
automotive_results_visualization_template
Public template
JavaScript
•
Apache License 2.0
•0•0•1•0•Updated Aug 1, 2025Aug 1, 2025
chakra
Public
Repository for MLCommons Chakra schema and tools
Python
•
Apache License 2.0
•55•116•40•7•Updated Aug 1, 2025Aug 1, 2025
GaNDLF
Public
A generalizable application framework for segmentation, regression, and classification using PyTorch
machine-learning framework deep-learning regression pytorch medical-imaging classification segmentation data-augmentation biomedical-image-processing
Python
•
Apache License 2.0
•89•182•7•1•Updated Aug 1, 2025Aug 1, 2025
mlperf_automotive
Public
Python
•
Apache License 2.0
•5•3•2•0•Updated Aug 1, 2025Aug 1, 2025
training_policies
Public
Issues related to MLPerf™ training policies, including rules and suggested changes
Python
•
Apache License 2.0
•67•95•110•2•Updated Jul 31, 2025Jul 31, 2025
logging
Public
MLPerf™ logging library
Python
•
Apache License 2.0
•49•36•42•2•Updated Jul 31, 2025Jul 31, 2025
tiny
Public
MLPerf™ Tiny is an ML benchmark suite for extremely low-power systems such as microcontrollers
C
•
Apache License 2.0
•102•423•14•8•Updated Jul 31, 2025Jul 31, 2025
mlperf_client
Public
MLPerf Client is a benchmark for Windows and macOS, focusing on client form factors in ML inference scenarios.
benchmarking machine-learning ml
C++
•
Apache License 2.0
•2•43•2•0•Updated Jul 30, 2025Jul 30, 2025
mlcflow
Public
MLCFlow: Simplifying MLPerf Automations
automation-framework mlperf mlcflow mlperf-automations
Python
•
Apache License 2.0
•12•7•12•1•Updated Jul 30, 2025Jul 30, 2025
policies
Public
General policies for MLPerf™ including submission rules, coding standards, etc.
Python
•
Apache License 2.0
•60•30•36•41•Updated Jul 29, 2025Jul 29, 2025
inference_policies
Public
Issues related to MLPerf™ Inference policies, including rules and suggested changes
Apache License 2.0
•55•63•19•3•Updated Jul 29, 2025Jul 29, 2025
training
Public
Reference implementations of MLPerf™ training benchmarks
benchmark machine-learning
Python
•
Apache License 2.0
•576•1.7k•9•46•Updated Jul 25, 2025Jul 25, 2025
inference_results_v4.1
Public
This repository contains the results and code for the MLPerf™ Inference v4.1 benchmark.
benchmark machine-learning
Python
•
Apache License 2.0
•2•0•10•0•Updated Jul 24, 2025Jul 24, 2025
inference_results_v4.0
Public
This repository contains the results and code for the MLPerf™ Inference v4.0 benchmark.
C++
•
Apache License 2.0
•17•10•5•5•Updated Jul 24, 2025Jul 24, 2025
inference_results_v3.1
Public
This repository contains the results and code for the MLPerf™ Inference v3.1 benchmark.
C++
•
Apache License 2.0
•13•11•9•2•Updated Jul 24, 2025Jul 24, 2025
inference_results_v3.0
Public
This repository contains the results and code for the MLPerf™ Inference v3.0 benchmark.
C++
•
Apache License 2.0
•15•19•11•3•Updated Jul 24, 2025Jul 24, 2025
inference_results_v2.1
Public
This repository contains the results and code for the MLPerf™ Inference v2.1 benchmark.
Python
•
Apache License 2.0
•23•18•5•3•Updated Jul 24, 2025Jul 24, 2025