MLperf Released First Round of Storage Benchmark Submissions
StorageNewsletter.com, Wednesday, October 11,2023
MLperf released their first round of storage benchmark submissions early last month. There's plenty of interest how much storage is required to keep GPUs busy for AI work. As a result, MLperf has been busy at work with storage vendors to create a benchmark suitable to compare storage systems under a 'simulated' AI workload.
For the v0.5 version, they have released 2 simulated DNN training workloads one for image segmentation (3D-Unet '146MB/sample') and the other for BERT NLP (2.5KB/sample).
The GPU being simulated is a NVIDIA V100. What they showing with their benchmark is a compute system (with GPUs) reading data directly from a storage system.
By using simulated (GPU) compute, the benchmark doesn't need physical GPU hardware to run. However, the veracity of the benchmark is somewhat harder to depend on.