Beyond HBM: Breaking the Thermal Wall with Vertical DRAM Stacking

Researchers at imec are exploring vertical DRAM stacking to overcome the thermal limitations of High Bandwidth Memory (HBM) in high-performance GPUs.

Share
Beyond HBM: Breaking the Thermal Wall with Vertical DRAM Stacking

As AI workloads grow, the demand for memory bandwidth is pushing current semiconductor architectures to their breaking point. High Bandwidth Memory (HBM) stacked on GPUs has been the gold standard, but it faces a significant thermal wall. Researchers at imec are now proposing a radical shift: 3D volumetric DRAM integration that rotates DRAM dies vertically.

By stacking DRAM vertically rather than horizontally, engineers can expand the "thermal design space." This architecture allows for better heat dissipation, which is currently the primary limiting factor for stacking more memory layers. As GPUs become more powerful, the heat generated by the processor often throttles the performance of the adjacent HBM. Moving to a volumetric 3D stack could allow for much higher memory density and bandwidth without a corresponding increase in thermal throttling.

This research, combined with advancements in silicon photonics and co-packaged optics, represents the next frontier of semiconductor design. To sustain the AI revolution, the industry must solve the "memory wall" through innovative 3D packaging and new material sciences.


Source: Semiconductor Engineering