MLPerf Storage Benchmark: A User Guide From The Maker
Blocks&Files, Wednesday, October 9th, 2024
The latest version of the MLPerf Storage benchmark requires careful study to compare vendor single and multi-node systems across the three workloads, system characteristics, and two benchmark run types.
MLCommons, the organization behind the benchmark, contacted us with information about the benchmark's background and use. We're reproducing it here to help with the assessment of its results.
Kelly Berschauer, marketing director for MLCommons, told us the benchmark was originally tightly focused on the AI practitioner who thinks in terms of training data samples and samples/second, not in terms of files or MBps or IOPS like storage people do.