Benjamin Lee
Appearances
Consider This from NPR
AI and the Environment
So I don't see how you can, under current infrastructure investment plans, you could possibly achieve those net zero goals.
Consider This from NPR
AI and the Environment
And as you can imagine, it's much more efficient because now you're just cooling the surface of whatever the cold plate is covering rather than just blowing air through the entire machine.
Consider This from NPR
AI and the Environment
The whole idea behind a mixture of experts is you don't need a single huge model with a trillion parameters to answer every possible question under the sun. Rather, you would like to have a collection of experts. smaller models, and then you just sort of route the request to the right expert. And because each expert is so much smaller, it's going to cost less energy to invoke.
Consider This from NPR
AI and the Environment
Before generative AI came along in late 2022, there was hope among these data center operators that they could go to net zero.