Arm
👤 PersonAppearances Over Time
Podcast Appearances
And if you do think, which we do, that AI is going to disrupt all of those different industries, it's a massive opportunity where it's not one player is going to be the only compute platform that all of those things run in over time. And we think that We have an opportunity to build some of that and provide differentiated choice for customers that choose to run AWS.
And if you do think, which we do, that AI is going to disrupt all of those different industries, it's a massive opportunity where it's not one player is going to be the only compute platform that all of those things run in over time. And we think that We have an opportunity to build some of that and provide differentiated choice for customers that choose to run AWS.
i think people like to talk about scaling laws because again it sounds fun to talk about but i think that it probably just means there has to be more levels of invention like i think if you look over in any technology ramp you kind of see a uh one particular technique ramping like this and then it slows down and then somebody says oh how about you try this and then it goes back up again and then you try something else and and so there's going to have to be software and all algorithmic changes i think it's not a blind
i think people like to talk about scaling laws because again it sounds fun to talk about but i think that it probably just means there has to be more levels of invention like i think if you look over in any technology ramp you kind of see a uh one particular technique ramping like this and then it slows down and then somebody says oh how about you try this and then it goes back up again and then you try something else and and so there's going to have to be software and all algorithmic changes i think it's not a blind
i think people like to talk about scaling laws because again it sounds fun to talk about but i think that it probably just means there has to be more levels of invention like i think if you look over in any technology ramp you kind of see a uh one particular technique ramping like this and then it slows down and then somebody says oh how about you try this and then it goes back up again and then you try something else and and so there's going to have to be software and all algorithmic changes i think it's not a blind
like dump more data and more compute and close your eyes and you'll get a bigger model next year. You're going to have to have smart people looking at it and driving it and figuring out new ways to help that. But that doesn't mean that you've hit a limit. I think it's just, you're going to have to keep innovating on different ways.
like dump more data and more compute and close your eyes and you'll get a bigger model next year. You're going to have to have smart people looking at it and driving it and figuring out new ways to help that. But that doesn't mean that you've hit a limit. I think it's just, you're going to have to keep innovating on different ways.
like dump more data and more compute and close your eyes and you'll get a bigger model next year. You're going to have to have smart people looking at it and driving it and figuring out new ways to help that. But that doesn't mean that you've hit a limit. I think it's just, you're going to have to keep innovating on different ways.
And you think about, again, think about number one, how long, and it was longer than a decade that people were saying that we were hitting Moore's law scaling limits. That was just, you know, can you take 17 nanometers and make it 15 nanometers and 13 nanometers? And you're saying, like, okay, there's going to be a limit.
And you think about, again, think about number one, how long, and it was longer than a decade that people were saying that we were hitting Moore's law scaling limits. That was just, you know, can you take 17 nanometers and make it 15 nanometers and 13 nanometers? And you're saying, like, okay, there's going to be a limit.
And you think about, again, think about number one, how long, and it was longer than a decade that people were saying that we were hitting Moore's law scaling limits. That was just, you know, can you take 17 nanometers and make it 15 nanometers and 13 nanometers? And you're saying, like, okay, there's going to be a limit.
Number one, they had to figure out technology to get past a couple of those, right? I remember somewhere around 10 nanometers, people were like, I don't think you can get past this. And now we're building three nanometer chips, right? And so you keep getting smaller because there's new technologies in there.
Number one, they had to figure out technology to get past a couple of those, right? I remember somewhere around 10 nanometers, people were like, I don't think you can get past this. And now we're building three nanometer chips, right? And so you keep getting smaller because there's new technologies in there.
Number one, they had to figure out technology to get past a couple of those, right? I remember somewhere around 10 nanometers, people were like, I don't think you can get past this. And now we're building three nanometer chips, right? And so you keep getting smaller because there's new technologies in there.
You had to figure out how you deal with interference, and you had to think about how you think about actually stacking the memory and different structures of the chips and other things like that. But you work through those. And In the meantime, you kind of figured out how to do more compute on an accelerator like a GPU that then gave you, you know, a huge step change in compute.
You had to figure out how you deal with interference, and you had to think about how you think about actually stacking the memory and different structures of the chips and other things like that. But you work through those. And In the meantime, you kind of figured out how to do more compute on an accelerator like a GPU that then gave you, you know, a huge step change in compute.
You had to figure out how you deal with interference, and you had to think about how you think about actually stacking the memory and different structures of the chips and other things like that. But you work through those. And In the meantime, you kind of figured out how to do more compute on an accelerator like a GPU that then gave you, you know, a huge step change in compute.
And so no longer people are worried about, did you, you know, are we hitting the limits of what a 17 nanometer Intel chip from 10 years ago was doing, right? Now we're orders of magnitude more compute than that.
And so no longer people are worried about, did you, you know, are we hitting the limits of what a 17 nanometer Intel chip from 10 years ago was doing, right? Now we're orders of magnitude more compute than that.
And so no longer people are worried about, did you, you know, are we hitting the limits of what a 17 nanometer Intel chip from 10 years ago was doing, right? Now we're orders of magnitude more compute than that.