Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Arm

👤 Person
588 total appearances

Appearances Over Time

Podcast Appearances

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And if you do think, which we do, that AI is going to disrupt all of those different industries, it's a massive opportunity where it's not one player is going to be the only compute platform that all of those things run in over time. And we think that We have an opportunity to build some of that and provide differentiated choice for customers that choose to run AWS.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And if you do think, which we do, that AI is going to disrupt all of those different industries, it's a massive opportunity where it's not one player is going to be the only compute platform that all of those things run in over time. And we think that We have an opportunity to build some of that and provide differentiated choice for customers that choose to run AWS.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

i think people like to talk about scaling laws because again it sounds fun to talk about but i think that it probably just means there has to be more levels of invention like i think if you look over in any technology ramp you kind of see a uh one particular technique ramping like this and then it slows down and then somebody says oh how about you try this and then it goes back up again and then you try something else and and so there's going to have to be software and all algorithmic changes i think it's not a blind

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

i think people like to talk about scaling laws because again it sounds fun to talk about but i think that it probably just means there has to be more levels of invention like i think if you look over in any technology ramp you kind of see a uh one particular technique ramping like this and then it slows down and then somebody says oh how about you try this and then it goes back up again and then you try something else and and so there's going to have to be software and all algorithmic changes i think it's not a blind

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

i think people like to talk about scaling laws because again it sounds fun to talk about but i think that it probably just means there has to be more levels of invention like i think if you look over in any technology ramp you kind of see a uh one particular technique ramping like this and then it slows down and then somebody says oh how about you try this and then it goes back up again and then you try something else and and so there's going to have to be software and all algorithmic changes i think it's not a blind

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

like dump more data and more compute and close your eyes and you'll get a bigger model next year. You're going to have to have smart people looking at it and driving it and figuring out new ways to help that. But that doesn't mean that you've hit a limit. I think it's just, you're going to have to keep innovating on different ways.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

like dump more data and more compute and close your eyes and you'll get a bigger model next year. You're going to have to have smart people looking at it and driving it and figuring out new ways to help that. But that doesn't mean that you've hit a limit. I think it's just, you're going to have to keep innovating on different ways.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

like dump more data and more compute and close your eyes and you'll get a bigger model next year. You're going to have to have smart people looking at it and driving it and figuring out new ways to help that. But that doesn't mean that you've hit a limit. I think it's just, you're going to have to keep innovating on different ways.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And you think about, again, think about number one, how long, and it was longer than a decade that people were saying that we were hitting Moore's law scaling limits. That was just, you know, can you take 17 nanometers and make it 15 nanometers and 13 nanometers? And you're saying, like, okay, there's going to be a limit.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And you think about, again, think about number one, how long, and it was longer than a decade that people were saying that we were hitting Moore's law scaling limits. That was just, you know, can you take 17 nanometers and make it 15 nanometers and 13 nanometers? And you're saying, like, okay, there's going to be a limit.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And you think about, again, think about number one, how long, and it was longer than a decade that people were saying that we were hitting Moore's law scaling limits. That was just, you know, can you take 17 nanometers and make it 15 nanometers and 13 nanometers? And you're saying, like, okay, there's going to be a limit.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

Number one, they had to figure out technology to get past a couple of those, right? I remember somewhere around 10 nanometers, people were like, I don't think you can get past this. And now we're building three nanometer chips, right? And so you keep getting smaller because there's new technologies in there.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

Number one, they had to figure out technology to get past a couple of those, right? I remember somewhere around 10 nanometers, people were like, I don't think you can get past this. And now we're building three nanometer chips, right? And so you keep getting smaller because there's new technologies in there.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

Number one, they had to figure out technology to get past a couple of those, right? I remember somewhere around 10 nanometers, people were like, I don't think you can get past this. And now we're building three nanometer chips, right? And so you keep getting smaller because there's new technologies in there.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

You had to figure out how you deal with interference, and you had to think about how you think about actually stacking the memory and different structures of the chips and other things like that. But you work through those. And In the meantime, you kind of figured out how to do more compute on an accelerator like a GPU that then gave you, you know, a huge step change in compute.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

You had to figure out how you deal with interference, and you had to think about how you think about actually stacking the memory and different structures of the chips and other things like that. But you work through those. And In the meantime, you kind of figured out how to do more compute on an accelerator like a GPU that then gave you, you know, a huge step change in compute.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

You had to figure out how you deal with interference, and you had to think about how you think about actually stacking the memory and different structures of the chips and other things like that. But you work through those. And In the meantime, you kind of figured out how to do more compute on an accelerator like a GPU that then gave you, you know, a huge step change in compute.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And so no longer people are worried about, did you, you know, are we hitting the limits of what a 17 nanometer Intel chip from 10 years ago was doing, right? Now we're orders of magnitude more compute than that.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And so no longer people are worried about, did you, you know, are we hitting the limits of what a 17 nanometer Intel chip from 10 years ago was doing, right? Now we're orders of magnitude more compute than that.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And so no longer people are worried about, did you, you know, are we hitting the limits of what a 17 nanometer Intel chip from 10 years ago was doing, right? Now we're orders of magnitude more compute than that.