
An eight-H100 box showed 20 GiB allocated on one card with 0% utilization and 80 W draw out of 350 W. Surveys place real fleet utilization in the single digits to twenty percent. The culprit is infrastructure around the GPU failing to keep it busy.
Tap to vote and see what everyone thinks.