Sharing is caring: How to make the most of your GPUs part 2 - Multi-instance GPU
Red Hat News, Friday, September 6th, 2024
In the part one about fractional GPUs, we talked about time slicing as "carpooling" for your GPU - getting more people (processes) into the same car (GPU) to use it more efficiently.
In this second strategy, called multi-instance GPU (MIG) partitioning, imagine that for the same "carpooling" we get numbered and sized seats for each person so everyone knows where to sit and where they fit. This approach allows for dividing GPUs into isolated and static instances for concurrent usage by different applications.