Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Arm

👤 Person
588 total appearances

Appearances Over Time

Podcast Appearances

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And so I don't see how you pick one of those. I think you have to do both.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And so I don't see how you pick one of those. I think you have to do both.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And so I don't see how you pick one of those. I think you have to do both.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

Yeah. Well, as I'll tell you, in my keynote in reInvent, I talked about another thing that I like to do in Amazon and we do here, which is we refuse a thing that we call the tyranny of the or, which is forcing someone to pick A or B stifles innovation because it means that you don't go out and invent how to do A and B. And so you can't pick. I'm telling you, it is not an A or a B chance.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

Yeah. Well, as I'll tell you, in my keynote in reInvent, I talked about another thing that I like to do in Amazon and we do here, which is we refuse a thing that we call the tyranny of the or, which is forcing someone to pick A or B stifles innovation because it means that you don't go out and invent how to do A and B. And so you can't pick. I'm telling you, it is not an A or a B chance.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

Yeah. Well, as I'll tell you, in my keynote in reInvent, I talked about another thing that I like to do in Amazon and we do here, which is we refuse a thing that we call the tyranny of the or, which is forcing someone to pick A or B stifles innovation because it means that you don't go out and invent how to do A and B. And so you can't pick. I'm telling you, it is not an A or a B chance.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

It's an A and B. And we have to push our teams to figure out how to do both, which is enable bigger training. And we have to lower the cost of that, by the way. It can't just keep scaling linearly, which is all part of the silicon investments that we're making and networking and things like that, which is how do you make the cost to train these really large models lower?

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

It's an A and B. And we have to push our teams to figure out how to do both, which is enable bigger training. And we have to lower the cost of that, by the way. It can't just keep scaling linearly, which is all part of the silicon investments that we're making and networking and things like that, which is how do you make the cost to train these really large models lower?

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

It's an A and B. And we have to push our teams to figure out how to do both, which is enable bigger training. And we have to lower the cost of that, by the way. It can't just keep scaling linearly, which is all part of the silicon investments that we're making and networking and things like that, which is how do you make the cost to train these really large models lower?

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

lower so that you can train bigger models. And I think we have to make that investment. We are making that investment. It's a huge area of opportunity for us because today it's too expensive to continue to ramp at the rates of the cost of the infrastructure. And so that's a big part of Tranium is investing in how do you get the cost down for training.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

lower so that you can train bigger models. And I think we have to make that investment. We are making that investment. It's a huge area of opportunity for us because today it's too expensive to continue to ramp at the rates of the cost of the infrastructure. And so that's a big part of Tranium is investing in how do you get the cost down for training.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

lower so that you can train bigger models. And I think we have to make that investment. We are making that investment. It's a huge area of opportunity for us because today it's too expensive to continue to ramp at the rates of the cost of the infrastructure. And so that's a big part of Tranium is investing in how do you get the cost down for training.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And I think the inference side has to drive costs down too, which I think is incredibly important for the adoption side of it. So you have to do both. They won't work if you just do one side.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And I think the inference side has to drive costs down too, which I think is incredibly important for the adoption side of it. So you have to do both. They won't work if you just do one side.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

And I think the inference side has to drive costs down too, which I think is incredibly important for the adoption side of it. So you have to do both. They won't work if you just do one side.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

It's less a competition and more an addition of choice because I don't think that it is GPUs.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

It's less a competition and more an addition of choice because I don't think that it is GPUs.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

It's less a competition and more an addition of choice because I don't think that it is GPUs.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

That's right. It turns out we've been making chips now for over a decade. We've been making silicon chips, our own custom silicon for more than a decade. And so we have one of the most experienced teams in the industry doing this. And so it's not a new thing.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

That's right. It turns out we've been making chips now for over a decade. We've been making silicon chips, our own custom silicon for more than a decade. And so we have one of the most experienced teams in the industry doing this. And so it's not a new thing.