Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Arm

👤 Person
588 total appearances

Appearances Over Time

Podcast Appearances

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

So I don't know the details of exactly where they were running into barriers, but it wasn't in their AWS infrastructure. It was in the Netflix controlled part of their infrastructure. Yeah.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

is and i think in particular there's a couple things around that that are challenging right by the way it's like it's a super hard thing that they did number one is their first time doing a lot of big like scaled live stream like that and so the first time is actually what's hard you know there are other people have done that before we will stream thursday night football and other places like that that have figured out how to do things like that but it's not the first time right and so it's the i am very i'm sure that the next time i think they have a christmas day game they'll probably work out some of those kinks and figure that piece out and so

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

is and i think in particular there's a couple things around that that are challenging right by the way it's like it's a super hard thing that they did number one is their first time doing a lot of big like scaled live stream like that and so the first time is actually what's hard you know there are other people have done that before we will stream thursday night football and other places like that that have figured out how to do things like that but it's not the first time right and so it's the i am very i'm sure that the next time i think they have a christmas day game they'll probably work out some of those kinks and figure that piece out and so

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

is and i think in particular there's a couple things around that that are challenging right by the way it's like it's a super hard thing that they did number one is their first time doing a lot of big like scaled live stream like that and so the first time is actually what's hard you know there are other people have done that before we will stream thursday night football and other places like that that have figured out how to do things like that but it's not the first time right and so it's the i am very i'm sure that the next time i think they have a christmas day game they'll probably work out some of those kinks and figure that piece out and so

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

The first time you do it, you'll find those bottlenecks. It's true about any compute system where you have an order of magnitude more and they obviously have shows that have streamed more, but they're spread across more time. It's this single spike up where everybody comes in a 30-minute window. If it's outside of what you plan for, if they plan for

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

The first time you do it, you'll find those bottlenecks. It's true about any compute system where you have an order of magnitude more and they obviously have shows that have streamed more, but they're spread across more time. It's this single spike up where everybody comes in a 30-minute window. If it's outside of what you plan for, if they plan for

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

The first time you do it, you'll find those bottlenecks. It's true about any compute system where you have an order of magnitude more and they obviously have shows that have streamed more, but they're spread across more time. It's this single spike up where everybody comes in a 30-minute window. If it's outside of what you plan for, if they plan for

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

I don't know what their numbers were, but 150 million and they got 180 million. It was outside of what I think they thought their upper limit was. And we've seen this before in AWS and we've seen this in Amazon. The first time we probably did Prime Day, we probably had issues across that too of just people hitting the website and other things.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

I don't know what their numbers were, but 150 million and they got 180 million. It was outside of what I think they thought their upper limit was. And we've seen this before in AWS and we've seen this in Amazon. The first time we probably did Prime Day, we probably had issues across that too of just people hitting the website and other things.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

I don't know what their numbers were, but 150 million and they got 180 million. It was outside of what I think they thought their upper limit was. And we've seen this before in AWS and we've seen this in Amazon. The first time we probably did Prime Day, we probably had issues across that too of just people hitting the website and other things.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

So the first time you do events like this, it's a learning process. And so I think it's probably overstating to say they had to re-architect the whole internet. But it really is that key spike where a lot of applications are just not, particularly when you own the infrastructure,

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

So the first time you do events like this, it's a learning process. And so I think it's probably overstating to say they had to re-architect the whole internet. But it really is that key spike where a lot of applications are just not, particularly when you own the infrastructure,

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

So the first time you do events like this, it's a learning process. And so I think it's probably overstating to say they had to re-architect the whole internet. But it really is that key spike where a lot of applications are just not, particularly when you own the infrastructure,

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

This is one of the benefits of the Cloud, by the way, is you get to ride on the law of large numbers where any one spike doesn't overwhelm everything else. Netflix obviously has a huge number of customers. My guess is they'll be much more prepared for next time. But it's a good learning for anybody, even at much smaller scale, that when you're planning on an event,

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

This is one of the benefits of the Cloud, by the way, is you get to ride on the law of large numbers where any one spike doesn't overwhelm everything else. Netflix obviously has a huge number of customers. My guess is they'll be much more prepared for next time. But it's a good learning for anybody, even at much smaller scale, that when you're planning on an event,

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

This is one of the benefits of the Cloud, by the way, is you get to ride on the law of large numbers where any one spike doesn't overwhelm everything else. Netflix obviously has a huge number of customers. My guess is they'll be much more prepared for next time. But it's a good learning for anybody, even at much smaller scale, that when you're planning on an event,

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

that has the potential to be materially more than your average baseline, there's always risks of that there's some scaling factor that you don't anticipate. So it's not a surprising problem to me. We've seen it over and over again, and it's part of one of those problems that the cloud helps to solve.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

that has the potential to be materially more than your average baseline, there's always risks of that there's some scaling factor that you don't anticipate. So it's not a surprising problem to me. We've seen it over and over again, and it's part of one of those problems that the cloud helps to solve.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

that has the potential to be materially more than your average baseline, there's always risks of that there's some scaling factor that you don't anticipate. So it's not a surprising problem to me. We've seen it over and over again, and it's part of one of those problems that the cloud helps to solve.

Decoder with Nilay Patel
Why CEO Matt Garman is willing to bet AWS on AI

But even in the cloud, planning is required and you have to think about how you scale ahead of it and things like that.