Power · Oct 18, 2026, 16:55
AI memory chips can use a third more power than official tests show
Researchers at ETH Zürich and NYU tested 36 real memory chips of the kind used in AI processors. They found the industry's standard worst-case test misses how much power the chips can really draw.
Stacked memory beside a processor die.
Illustration (AI-generated)
Key takeaways
- HBM2 memory drew 23.6% more power on average, and up to 35.4% more, than the toughest official JEDEC test.
- Reading data uses about 3.1 times the current of the chip's routine refresh work, and the data itself changes power use.
- In NVIDIA H200 GPUs, this kind of memory uses about 248 W, roughly 35% of the card's 700 W budget.
- The team released a free power model that is far more accurate than existing ones.
- Next step: testing real HBM4 chips, since the HBM4 figures so far are only estimates.
