Nvidia NVHBM boosts bandwidth 30%, cuts power 15%

Nvidia expanded NVLink Fusion with NVHBM, a custom high-bandwidth memory integrating its memory controller into the HBM base die. It delivers up to 30% greater bandwidth, 15% lower power, and frees 25% XPU area versus HBM4E. Amazon's Annapurna Labs is the first partner, starting with Trainium4.