Menu
Sign In Pricing Add Podcast

Acquired

Nvidia Part III: The Dawn of the AI Era (2022-2023)

3574.895 - 3592.022 Ben Gilbert

So while memory has scaled up, I mean, we're going to get flashing all the way forward, the H100s, on-chip RAM is like 80 gigabytes. The memory hasn't scaled up nearly as fast as the models have actually scaled in size. The memory requirements for training AI are just obscene.

0
💬 0

Comments

There are no comments yet.

Log in to comment.