Acquired
Nvidia Part III: The Dawn of the AI Era (2022-2023)
Ben Gilbert
Well, NVIDIA knew that these new models coming out would need to run across multiple servers, multiple racks, and they put a huge level of importance on the bandwidth between the machines. And of course, how did they know that? Well, in August of 2019, NVIDIA released what was at the time the largest transformer-based language model called Megatron.
0
💬
0
Comments
Log in to comment.
There are no comments yet.