mlcommons Goto Github PK

.github

algorithmic-efficiency

MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvements in both training algorithms and models.

cadc_abtf_eval

A devkit for the Canadian Adverse Driving Conditions (CADC) dataset.

chakra

Repository for MLCommons Chakra schema and tools

chakra-old

Repository for MLCommons Chakra schema and tools

ck

Collective Mind (CM) is a small, modular, cross-platform and decentralized workflow automation framework with a human-friendly interface and reusable automation recipes to make it easier to build, run, benchmark and optimize AI, ML and other applications and systems across diverse and continuously changing models, data, software and hardware

ck-mlops

A collection of portable workflows, automation recipes and components for MLOps in a unified CK format. Note that this repository is outdated - please check the 2nd generation of the CK workflow automation meta-framework with portable MLOps and DevOps components here:

ck-venv

CK automation for virtual environments

cla-bot

cla_form

cm-mlops

cm4mlops

A collection of reusable and cross-platform automation recipes (CM scripts) with a human-friendly interface and minimal dependencies to make it easier to build, run, benchmark and optimize AI, ML and other applications and systems across diverse and continuously changing models, data sets, software and hardware (cloud/edge)

cm4mlperf-results

CM interface and automation recipes to analyze MLPerf Inference, Tiny and Training results. The goal is to make it easier for the community to visualize, compare and reproduce MLPerf results and add derived metrics such as Performance/Watt or Performance/$

croissant

Croissant is a high-level format for machine learning datasets that brings together four rich layers.

dataperf

Data Benchmarking

datasets_infra

dynabench

gandlf

A generalizable application framework for segmentation, regression, and classification using PyTorch

github-action

MLCommons CLA bot GitHub Action

hpc

Reference implementations of MLPerf™ HPC training benchmarks

hpc_results_v0.7

This repository contains the results and code for the MLPerf™ HPC Training v0.7 benchmark.

hpc_results_v1.0

This repository contains the results and code for the MLPerf™ HPC Training v1.0 benchmark.

hpc_results_v2.0

This repository contains the results and code for the MLPerf™ HPC Training v2.0 benchmark.

hpc_results_v3.0

This repository contains the results and code for the MLPerf™ HPC Training v3.0 benchmark.

inference

Reference implementations of MLPerf™ inference benchmarks

inference_policies

Issues related to MLPerf™ Inference policies, including rules and suggested changes

inference_results_v0.5

This repository contains the results and code for the MLPerf™ Inference v0.5 benchmark.

inference_results_v0.7

This repository contains the results and code for the MLPerf™ Inference v0.7 benchmark.

inference_results_v1.0

This repository contains the results and code for the MLPerf™ Inference v1.0 benchmark.

inference_results_v1.1

This repository contains the results and code for the MLPerf™ Inference v1.1 benchmark.