Eiso Kant
Appearances
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Who has earned the right to be in the race to AGI? We're going to look back on this moment 10 years from now, just like we would look back to the moment of mobile, internet, and realize that that was the moment where the table got set. You do not want to look back on that moment and not have given it everything you've got because it's a race.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And then you throw in the mix, the vendors that are putting up the open source models from Meta and such. And I often think about what sits in that stack of costs. Well, what sits in the stack of the cost is a server, a box, the networking around it, a data center, the chips, right, the GPUs, and then the energy that goes into that.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And everything after that is marginal cost or variable cost of the running of the models. So we have to think about who has the lowest cost profile in the space, right? Who has the cheapest first principles capex that they're doing to run these models?
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Well, that's the people who have as much of that vertically integrated and who have as much of that infrastructure already online and brought into the world. And this really is the hyperscalers. This is Amazon in number one, Microsoft in number two, Google in number three. But there's something interesting about all of those.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Each of those at different moments in time understood that they couldn't be reliant on hardware built by NVIDIA or AMD by someone else that also built their own. Furtest along that has been Google with their TPUs. Things currently at their fifth generation. They started early on this and they've been improving it ever since.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Then you have Amazon who's been working on their Tranium and Inferentia chips, their Neuron cores for some time. And Amazon has an incredible background, by the way, in manufacturing chips. And this is something I don't think people take enough credit to because while Google has to work with Broadcom to be able to bring TPUs into the world,
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Amazon is working with the fabs directly and they have an incredible skill, right? They've done an amazing job in the cloud and Microsoft still earlier in their own chip journey.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Now, I know this is again a preamble to your question and I'm sorry for bringing this there all the time, but I think it's an important thing to understand because when you are buying Nvidia hardware and you're putting it in a data center and you're working with an Oracle or you're working with whoever it is in the space or even a Google or an Amazon or Microsoft,
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
you are taking that margin of that chip, right, the H100, the H200, the Blackwell generation coming up, and that has to be baked into your costs. The way that I think about this is that at the extreme end of it, Amazon and Google and Microsoft, as well as they come out with their own silicon, have a lot more margin to play with. And now then it comes down to business decisions.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And right now, since this is a war, and it's a total, you know, like it's an incredible race that's happening. I often refer to it as a drunken bar fight that's happening in our industry. is that we are, you know, all these companies are massively incentivized to drop the cost of their models as quickly as possible. And they do that in two ways.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
They do that by cutting more and more of their margin down to their actual cost, right, their hardware. And then you can see a big difference between, you know, what an Amazon is able to do and a Google and a Microsoft and OpenAI and Anthropic. But they also do it on the intelligence layer. We spoke earlier about large capable models that distill down into smaller models.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
If you have the most intelligent largest model, you can distill it down into a smaller model and you can have advantages at that layer as well. My view is, though, that in the extreme of it, the compute margin, like the hardware margin, really matters as this gets lower and lower in price. And this is what we've seen in cloud computing as well.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
This is my personal view of how the world plays out. It's really easy to stay focused on the tactics and things that matter in this moment. And they're exactly the right questions of what matter right now in the moment. But we are moving towards a place where we are closing this gap between human intelligence and machine intelligence. And I think it's going to be an incredible...
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
incredible amount of problems and challenges and places where we want to apply this intelligence. If I have a view on modern history, and my view on modern history is that if you look at what happened from the printing press onwards, is that what we've done is we've connected more and more people around intelligence.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
We went from, you know, the telephone to personal computer, to the internet, to the mobile phone. Fundamentally, what we've been able to do is we've been able to take hard challenges in the world, that's cancer research, or if that's even building a business, a SaaS company, anything, and we've been able to connect more and more people together to direct resources to those things.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
What we're fundamentally doing is we're bundling intelligence. More and more people got connected together, and I think that's the true underlying thing that has underpinned this technological exponential curve we're on. If you think back about 100 years ago or 50 years ago, you can truly see it's an exponential. I don't think we want to live in any other moment in time.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And the reason I mentioned this to your question is that I think we are now going to go from a world where human intelligence and the amount of humans we had was the entire bottleneck to now we are having machine intelligence.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And so we compare investments in energy and chips and compute together with humans and have an extreme explosion on this exponential of all of the places in the world where we want to direct it to. My point is that I think there is a huge amount of places where this is going to be valuable. We will figure out the compute efficiency along the way.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The hardware will get more efficient because that's capitalism. As the opportunity is big, we'll direct things to make it more efficient.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The way I think about this is there's things in the world that today we consider economically valuable. And that ranges from scientific progress to very mundane things. Office buildings full of things that we look at today and say, why can't that be automated?
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
So if we take what's economically valuable, the next thing we need to ask ourselves, what's the gap between models today and human level capabilities? And how large is that gap? And in some cases, the gap is actually not that large anymore. We were talking earlier about speech recognition. Models today are pretty much there.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Maybe there's a tiny bit left to say, but we've closed that gap into an incredible amount. In other areas, the gap felt like it was going to be impossible to close, but we're making a lot of progress. Come back to full self-driving, if you've been in your latest Tesla FSD update, that gap feels getting closer and closer to be closed. Now, there's other areas where the gap is really large still.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think software development, our domain, we think the gap is still very large, right? What models are able to do is they're massively useful assistants and they drive massive economic value because of that. But between a model working with a developer today, there's a huge, huge gap.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And we want to get to a world where developers can work with models that are as capable as them and potentially even one day more capable. Now, the reason I mentioned this is so we've got the human capability aspect, right? What's the gap that's there? How economically valuable is the domain?
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Then there's a next area I think that you have to ask yourself is how easy is it going to be to close that gap? And that comes down to data. Where can we get extremely large scale web scale data to be able to close that gap in areas where the intelligence gap is really big? Because the bigger the gap in intelligence today, the more data that we need to close it.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
If you kind of use this as a, where can we find the data size related to how large the gap is between human and machine intelligence, and how economically valuable it is in the real world already, I think the intersection between those is the places where companies like us get to exist.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
GitHub today has this incredible data set, almost all of the code in the world. GitLab is a player, but only in the private side, right? What sits behind the accounts of developers. GitHub is massive in public code and it's massive in private code. But private code, no one's allowed to train on. Not us, not open AI. So all of us have access to the same public data and it's the output data.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And so there is an inherent advantage from a capabilities race perspective. Another thing that we frame in our company over and over again is there's a capabilities race in the world. And to your point earlier, we say there's four things that matter. Agree with you on the three, but I'm going to add one. Compute, it's data, it's proprietary applied research, the algorithms, and talent.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Talent is absolutely key in this industry. In the go-to-market race, it's talent first and foremost, but it's also product and distribution. And distribution, Microsoft definitely has an incredible positioning in the world.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
No. $600 million that we've raised till date and the latest $500 million round is translates to us being able to be an entrant into the race.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And what that means is that the 10,000 GPUs that we've now brought online this summer, that came from this capital, allow us to make incredible advancements in model capabilities because of our ability to take reinforcement learning from code execution feedback and generate extremely large amounts of data, and then train very large models with it.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
It is enough for this moment in time, but over time, it won't be enough.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
It's a very good question. There are real physical, real world constraints behind this. We've seen crazy numbers thrown out in our industry of, you know, compute cluster sizes and things like that. But the world actually still needs time to catch up with the real ability to do so. Today, interconnecting more than 32,000 GPUs is extremely challenging.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
We're starting to be able to possibly interconnect 100,000. But right now, a million GPU cluster, a 10 million GPU cluster for training of models has both true algorithmic things that we have to overcome to be able to do this, and also has actual physical limitations still in the world. So we're not living in a world right now where unlimited money can buy you unlimited advantages.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
It's why we get to exist with 10,000 GPUs.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think, again, it depends on how much cash and how much compute. About a year and a half ago when we started as a company, there was a true imbalance between supply and demand in the world that even as a frontier AI company starting, everyone wants you to win. NVIDIA is incentivized to hyperscale. Everyone is incentivized actually to make early stage companies succeed with compute.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
It's a lot easier when you're an early stage AI company to get compute than it is when you're an enterprise because they understand this is where the future is heading towards. But even then, there was a real mismatch between demand and supply, and we had to do an incredible amount of work of understanding the market, building relationships, and having plan A to Z to get there.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
In the last six months, the world has still a huge supply shortage, and we can see this. If you're an early-stage startup, there's lots of paths for you. If you're a frontier AI company, you need to make decisions about who do you partner with, who do you work with, how much do you do yourself? I'm making decisions today that will impact us on compute in 12 or 18 months from now.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
It's very rare to be at early stage companies where you have to make decisions right now that impact you on physical infrastructure a year and a year and a half later. Have we seen that demand supply imbalance change? The world has still far more demand for GPU and GPU-like compute than that supply that's available.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
If you want to become a hyperscaler that is able to put data centers all over the world with GPUs in it that are going to allow you to serve these models to everyone, an infrastructure player, that's probably it. And that's probably just a starting point.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And the latest $500 million round translates to us being able to be an entrant into the race. We don't get the luxury of stumbling on the capabilities race or to go to marketplace.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
If we look at the massive CapEx investments that all of the cloud companies are doing, they're far above $100 billion when you look at them over the course of a couple of years.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Now, in the race towards more and more capable AI, closing that gap between human intelligence and machine intelligence, I think we are all pushing the frontier more and more possible, and we're seeing how that gap closes as we're scaling up our models and scaling up our data. I don't think anyone has a definite answer of how many dollars is it going to take from here to there.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
If we knew that, we knew the outcomes. We're all on the frontier of what's possible right now.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
i think we need to separate spend from getting the world's most possible capable ai by closing this gap getting to agi closing the gap between human intelligence and are they not the same thing they're not the same thing because if you look at these models as investments that we're making to get intelligence out on the other end that needs to be economically valuable to end users right with lots of layers and applications and things in between the model the creation of models is capex
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The operating of them, the inference to running of them, is OPEX. But the OPEX to run them requires extremely large-scale physical footprint in the world. Very simple. If we would spend, you know, $100 making a model and it will ever return $2 or $3 in terms of value to the world, it makes no sense, right? The world will punish it. It won't exist.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The huge scale-out that has to happen in the world for AI to become something that can tackle all of our world's problems and can feed in all of, from our software to our daily lives, requires huge footprint to run these models. It requires massive inference. And that means it requires data centers all over the world, close to end users, latency matters. And that requires a massive build-out.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And I think this is one of the largest build-outs that we've seen in physical infrastructure since, you know, the last couple of decades in the cloud.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
We're in a world today where the amount of data centers that can hold and power and have enough energy to power increasingly magnitude order larges of clusters is a very small number. I think he's absolutely right in this sense.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Now, the data centers from two years ago versus the data centers in terms of size and power requirement that we're going to see in the next two years look radically different, not just because the scale of number of servers and nodes that we're interconnecting,
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
this is the difference between inference right for inference we don't need all of the machines to be connected to each other in the same place for training we need them all to be connected to each other in the same room in the same place and so that massively changes what a data center looks like i think the show has done so well because i ask questions that people think why do you need that for training and not for inference i think it's a good question
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
When we're scaling up the size of these models and we're training them on more and more data and we're using more and more compute for it, at every single step that we're taking in the learning, every set of samples of data that we show the model, we need them to communicate with each other and share what they've learned. across the optimization landscape.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And so this means that if I would, you know, have two data centers that sit far away from each other, the amount of information that they have to share with each other, all of the different servers, and we're talking here thousands and tens of thousands soon of servers, you know, would make it so slow that it wouldn't be economically viable to train these models.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Once I'm running a model, I'm using a lot less servers to run it. So think of it as having lots and lots of copies of the model during training over lots and lots of machines that every time they see data to learn, they need to communicate with each other to continue to improve in their learning.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The dynamic that exists in the world today, we all owe a depth of gratitude to NVIDIA. When I started in this space in 2016, we were stacking 1080 Ti chips in racks of servers at our office. And NVIDIA already back then understood that AI was going to be world-changing. And no other company, the exception of maybe Google, had that deep of a realization.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
But Nvidia had massive conviction on this and continued to double down here and has made more and more incredible hardware. The company that fast followed on that was Google. That's why we're on the fifth generation of TPUs. And the company that fast followed on that was Amazon.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The reason I mentioned those three specifically is that they are all building extremely large volume of chips and constantly iterating on faster and better and better generations of chips for training and for inference. They're for me the three primary players in the race, just from sheer volume of what they're producing in the fabs versus what they're bringing online to end users.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Now, we have some other companies in this space, AMD, competitor to Nvidia, doesn't have their own cloud, is reliant on being in this competitive nature from a price perspective with Nvidia. And so their ramp up is entirely determined by the demand of the world wanting to use their chips.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The demand of the world for AI for a Google and an Amazon with their own silicon is not the demand for chips, it's the demand for AI.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The way I look at this is that we're going to be in a world where those three and possibly new entrants or possibly, you know, AMD maybe catching up, but I think really those three and Microsoft with their own silicon one day are going to be the driving force in this industry.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Why? Because I'm training on H200s. And so the compute that I brought online at the end of August, these 10,000 H200s, mean that the longer the next generation chips is delayed, it helps me in a competitive nature in the world. But also there's a lot of marketing around the next generation of chips. And again, we have to separate training and inference.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Pretty much what we've seen consistently with every two-year generation of training from NVIDIA is about a 2x performance increase. But training is about 2x every two years. On inference, though, I think there's a lot of hope on Blackwell because it looks like for inference, Blackwell might potentially unlock a much, much larger gain.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The way we think about this, and I think the way to think about it, is that these chips, when they come two times more efficient, The operations we're doing on them is still the same. It's matrix multiplications and additions and such. It's math that we're doing on these chips. The Blackwell generation for us from a training perspective doesn't unlock anything new.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
It just means that we have to, we can do more with a certain set of chips. My H200s become less valuable in the world, but it does not necessarily mean I have to go upgrade to the next generation.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
GPT-5, what it won't deliver, isn't a question we're going to look back on in a decade from now.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
in a decade from now we're going to look back to this moment and it's similar i think how we look back to the early days of the computer the early days of the internet the early days of google and others and realize that we didn't fully internalize yet how much the world is going to unlock in value and abundance we wrote this blog post when the fundraising announcement came out we said look probably in this century there's three mountains that humanity is going to climb agi is one of the mountains the other is energy and the other is space
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And so I think as we're going to keep progressing, we're going to keep looking at the next mountain, and from the top of that mountain, we look back, and we're going to realize the ones before were exponentially smaller.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
If we come back to the ingredients of the capabilities race, compute, talent, data, proprietary applied research, what we are going to find is that for compute, dollars have a direct one-on-one effect. But when we look at data, when we look at proprietary applied research and we look at talent, it is not as straightforward as dollars in magic success out on the other end of it.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think we've had lots of examples in technology history already where we have seen these giants that seemed unbeatable. IBM in the early days of the personal computer. And so if we live in a world where we could perfectly translate dollars to successful outcomes, whoever can put more there is going to win. In the race towards AGI, dollars are critical for compute.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And remember, there's still time constraints. There's real-world physical constraints of how large we can make these compute clusters for training.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And it's that time and physical constraint, the constraint of what the chip is able to do, what the networking is able to pass through, that allow companies like us to have time and to do things and build massive advantages on the data, on the talent, and on the proprietary applied research.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think you're fair to say that a lot of knowledge moves around.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Well, thank you, Harry. It's a pleasure to be here. And it's glad that we finally met in person. It's been a minute since we've known each other.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
If you look at our capital raise, our last $500 million round, you'll see that there's none of the big hyperscalers, Google, Microsoft, Amazon were part of the round. Was that deliberate? That was deliberate from us. Because I think right now there's a future we see ahead of us for the world. And right now we see a path towards that future that we can do as a standalone company.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And we have to acknowledge the fact that we're all in the same race. And so to me, you can make strategic decisions along the way where you decide to say, hey, we're partnering up together in one way or another, like you're referring to equity relationships. It wasn't something that we had to do at this point. And it's something that, frankly, we very consciously decided not to do right now.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
There is one corporate that became part of our round, and that was very deliberate, was NVIDIA. And it's because we collaborate really closely with them. I think that the nature of large technology companies choosing to invest in frontier AI companies is, frankly, the game theory optimal thing for them to do.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think there's very few left to be acquired, to be very honest. Who is left?
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Juan? Reka. Reka. R-E-K-A. Small but very capable team from what I can see from the outside.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I believe they're in Europe. Mistral. And I'm hard-pressed to think of more companies. I mean, XAI is very unlikely to be acquired, but they're a very capable player in this space. And I focus, of course, on work in large language models and work towards AGI. So I think there's very few companies that today are sufficiently far along and that are still left.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I would love to spend a day with the current leadership team of every single one of these and then make a decision. They each have inherent advantages to them. XAI has understood that compute mattered and built an incredible team there and did what no one really had done at that speed. They built 100,000 GPU, three 32K interconnected clusters in Tennessee.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
What do you do? Poolside's in the race towards AGI. We think the future is going to play out, that the gap between machine intelligence and human level capabilities is going to continue to decrease. But the path towards that, in our opinion, is by focusing on building the most capable AI for software development.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
In the span of months, XAI showed up with Elon's strength, the ability to build physical infrastructure incredibly fast in the world. OpenAI had the incredible ChatGPT moment and has built this incredible business around both ChatGPT and the usage of their APIs and is clearly ahead in revenue as others, like as publicly stated.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And then I think Anthropic has incredible, thoughtful researchers and a very rigorous approach in what they do, a very rigorous scientific approach in terms of moving things forward. And so while I can see strengths in all three of those, it would really be a day with the with my own money.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think Sam and OpenAI have understood the importance of compute and have understood the importance of data. What I imagine that $6.6 billion is going towards is exactly those two things. Where from the outside, I think it is tricky to be Sam today. I think it's tricky to be Sam today because general purpose models that aim to be everything for everyone is an incredibly competitive market.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And you find yourself with incredible pressures from all sides. And you're building a platform and a consumer product at exactly the same time. And more so than that, you're building a consumer product that from the outside is seeming to be for everyone. And I think that's a really hard thing to do.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
It's one I think about a lot, to be very honest, and you're getting me even with it. It's probably one of the only things you could have said that would have got me a bit emotional, because I think about it a lot. I saw it many years ago, and I think I understand what he means very well. I was earlier today with a founder I really respect.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And we were funny enough talking a little bit about this, is that building what we're building, it's not a choice, it's an obsession. And you bring everything you've got to it. And we were talking about, hey, how do you deal with waking up at three in the morning and your mind doesn't stop racing?
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Going back and forth and sharing each of our techniques and probably going back home tonight and trying them I think Elon is one of the most impressive examples of someone who has done this for such a prolonged amount of time at moments in time when the entire world refused to align around his view.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think there's companies in the world that get built because they were at the right moment at the right time. And there's companies in the world that get built that shouldn't have the right to exist. Everything is against them. And I think Elon has done that not once. He's done it multiple times. And it brings me to another quote that I heard on an interview from him or about him was Peter Thiel.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And all of this comes back to a set of foundational beliefs that we have that I would say are different than some of the other companies in the space in terms of where both research is heading and where capabilities are heading. The term AGI is a loaded term.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And Peter Thiel said, when we all worked with Elon, we thought he was crazy. He would take so much risk. And then he went and started, you know, Tesla and SpaceX. And we thought he was even crazier. And if one of those two companies would have worked out, we would have said he'd gotten lucky. But both of those companies worked out and beyond and to extremes.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
But there's something Elon understands about risk that the rest of us don't. And for me, that's the second quote that's been on my mind most of this year.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
When I was in high school in 2008, my very first startup was a virtual digital currency. My views on crypto have changed a lot over the years. The notion of decentralization and what it can mean for the world is incredible, are incredible ideals.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The problem I think that we've seen in crypto is a quote that I learned, it might have been my high school economics professor, and he said, bad money drives out good money. If you think about this in environments, when bad actors come in, it drives out the good actors because we want to be in environments with other good actors.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
and i think the promise of crypto started from great actors and found itself due to you know the incentives of the ability to make money very quickly in lots of distorted ways to bring a lot of bad actors to it the bad actors have driven out a lot of the good actors over time that are still a true amazing idealist in that space now the thing in ai that we don't have that
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
We have a set of people around the world who all fundamentally might disagree on how to get there, but all see that in 10, 15 years, we're going to look back and realize we had this incredible shift in the world by being able to close the gap between machine and human intelligence. And so while that might
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
drive today some centralization because of the sheer amount of resources required that are scarce, right? Capital is the least scarce part of this, right? The talent is scarce. The proprietary, you know, applied points of view and research, those are scarce. I think that does lead itself to a small number of companies. I think we've seen that over and over in history.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
We look at when the massive boom of automobiles, right? The hundreds of automobile companies that started and how many actually survived. We've had this over and over again. And so I don't think this is something new. What I would like to see is that it's not just Google, Amazon, and Microsoft.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And the way that I like to kind of take the definition that is most commonly used is that at some point we are going to be in a world where across all sets of capabilities that we have as human beings, machine intelligence is going to be as capable and if not more capable than us and surpass us.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
It's going to be an open AI, an anthropic, a poolside, and a set of companies who are able to get that massive escape velocity needed to sit alongside those companies and build the next generational businesses.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
So I think it depends on the use case. There's lots of experimental use cases still, and there's use cases that are far past the experimental side. AI for software developers, I don't think anyone in the world anymore questions that software development moving forward is going to be, for the foreseeable future, a developer-led AI-assisted world and an increasingly AI-assisted world.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think there are use cases that are commoditizing very quickly. Speech recognition, I think, is one of them. Image generation is one already where we're seeing more and more commoditization over time.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I want to set the record straight. We're an American company, and we've got incredible people from all the way from San Francisco to Israel. But a decision that we made early on, Jason and I, my co-founder and I, we were planning on building this company in the Bay Area. And we did the work in the first days of the company.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And the work was let's make a list of everyone we think from both that we knew and also like externally, like, you know, on research papers and GitHub repos that we think potentially could be great for us. And the list ended up with about 3,300 people. A lot of work done.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
3,300 people that we saw ranged from having experience on distributed training, to GPU optimizations, to work on data, to reinforcement learning, experience with large language models. So the whole breadth of what it takes to build what we're building from a model perspective. In that list was a location column.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Now, our point of view is that that world is still quite a bit out and that we are actually going to end up in a place before that where we see human level capabilities in areas that are massively economically valuable and can drive abundance in the world for all of us that are not going to be equally distributed, not for every single thing.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And as you can expect, the number one represented geo in that was the Bay Area, not even the United States, just purely the Bay Area. But what really was striking for us is that there was a huge part of that list that was not in the Bay Area. It was spread out across Europe and Israel, from the UK to Switzerland to Tel Aviv to Amsterdam, you know.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
harris like all of these different places well we couldn't see a clear deep talent concentration in one place probably uk actually being the one with the largest talent concentration we didn't realize that it was probably worth spending some time talking to people there and so i went and had conversations and and we realized one thing we said there's incredibly capable people here who want to stay here geographically they don't want to move to the bay area to join some of the other companies in the space
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
But they're not finding massively ambitious, you know, young companies that have huge visions to join. And so we saw that as an advantage, right? To the four things in that, you know, capabilities race, we need to build unfair advantages for every single one of those. And so we said, great, let's build up talent, you know, here on this continent in Europe, as we will in the United States.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And frankly, I'm very grateful that we did.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
London for us is about 15 people.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The way to think about it is where has talent historically been, even pre-ChatGP team moment, and talent in AI, and who helped build that talent in the space? The number one company we have to give credit to is DeepMind. DeepMind built an incredible talent base. They built it out of London. Meta did some work in building a very incredible talent base, and it did it between London and Paris.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
But in terms of when you look at it from a numbers perspective and sheer size of people, Google separately and DeepMind as part of Google had made much larger investments. And then there's another talent pool that we do often talk about publicly that is just absolutely extraordinary, which is Yandex.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Yandex built an incredible company in Russia with some of the world's most capable researchers and engineers, many of which have since left Russia and have kind of become a diaspora all over Europe.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
There was a tweet, and if I recall correctly, it's from Aaron Levi from Box, early on in post-ChatGPT moment. And he wrote something along the lines of, if you feel like you're working extremely hard on reasonable hours as AI is now booming, you're probably right to do so.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Because it's in these first years, and I'm probably going beyond what the tweet said, but I think it's in these first years, it's where the table gets set. Who has earned the right to be in the race to AGI?
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The way that I've always looked at this is my personal perspective, and so is my co-founder, and so is Margarita, has put us in a place where we're going to look back on this moment 10 years from now, just like we would look back to the moment of mobile, internet, and realize that that was the moment where the table got set.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And what I mean by that is that if you think about foundation models today, and I have a kind of simple mental model about them, which is that we are taking large web skill data and we're compressing it into a neural net and we're forcing generalization and learning. And this has led to things like incredible language understanding in these models.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And you do not want to look back on that moment and not have given it everything you've got. Because it's a race. And look, most startups are not racist. Most startups are against yourself. But AGI is a race. And so our view always has been the team that we build is a team that is deeply passionate to be in that race.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And frankly, when you decide to join a race and you're upfront about it, you decide to try to become the gold medalist in swimming, that means that there are sacrifices that come with that. You don't get to have it all.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
and so that's something that we've been super open about with people from day zero it's on our first intro call we talk about like do you want to join a race and frankly i have found no shortage of people in europe that want to do that i think there's a there's a stereotype about europe but the fact of the matter is that people who want to join races and do truly their life's work they're built differently and you can find them all over the world in every single country you just got to do the work to find them
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
You know, history doesn't repeat itself, it rhymes. I think it was Mark Twain. I think that might be the mistake that we're possibly making looking at the past. And the reason that is, is because we're on an exponential in terms of technological progress.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think in 1996, with Netscape, if I'm getting the year right, there wasn't this amount of people and capital that understood what the future might look like in the next 10 years. And it took some time to get there. Now, I could be wrong about this.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Another thing that I could see as a possible avenue of why I tend to disagree is there's a big difference between what was required to be built in 1996 versus what's required to be built today. bring it all the way back and try to steel man the opposite side of the argument is maybe it's exactly that.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And that the next couple of years are about these massive capabilities that we're moving the world closer towards AGI. And then when you look at the following five or 10 years, it's true. The huge economic value that's going to come from that will of course surpass the economic value that we have. I think the economic value is going to continue to surpass on the exponential that we're on.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
But what I don't agree with, the companies that are being built today will not have a set of companies amongst them that will become the giants of the future that have helped enable this.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
So if we take the battery analogy, I would actually think a little bit about BYD. Started as a battery company. Today is the largest volume of electric car sold in the world. And I do think there is a lot to be said about deep vertical integration. Look at Poolside. We're building foundation models.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
But it's also led to things where we look at and we say, these models are kind of dumb. Why aren't they able to do X, Y, or Z? And our point of view is that the reason why they're not able to do X, Y, or Z has to do with how they learn. The most important part, I think, of what I said is the scale of data. When we have web-scale data, we can get language understanding.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
with a mission towards AGI, right now in the world focused on bringing more and more capabilities of AI to software development, building a truly N10 business. Because I agree with you that the value is not going to only accumulate at the model layer. It's going to accumulate all the way to the end user.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And so in our point of view, the way that we kind of, I think, get to avoid, you know, what the future plays out in your hypothetical scenario is just by truly doing it end to end. But I still actually look at this thinking that there will be more value built on top of us in the future than what we can possibly unlock only ourselves.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
No, they're not. There's a couple of interesting things that might not be as obvious unless you're in our industry. The research that still gets published openly, that doesn't get held back, that is most interesting, is all coming out of China in vast spades and majorities, something that wouldn't necessarily be obvious. But if you think about the game theory optimal thing to do,
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Because they're not on the forefront of the world scene of AI. Actually opening up some of that research is the game theory optional, you know, optimal thing to do to be able to continue to attract talent. Because that's really what opening up your research does, right? It attracts talent to you.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think China is at an incredible level of capabilities and in no way could be discarded or thought of as years behind on AI or AGI progress. We're working on technologies that we can see have massive societal impact. I think it's really important to be good stewards of that technology and that progress. And I think part of that is acknowledging that what we know about is the technology.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
What we know about is our users, our customers. But we should be careful in terms of trying to know what's best for the world and how to think about massive geopolitical conflicts and things like that. And so what I have said in the past is that the best thing that we can do is the West.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
is to keep making it as attractive as possible for talent from china we consider as a competitor right on a very large skill to come to our countries the easier we make it for one of those four major ingredients in the capability race and frankly one of the most important ones to you know help us accelerate i think is probably the the most practical advice i can give
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think in the last 12 months, it's a continued realization of the importance of scale of data and not only computing. Do you regret not selling Source to GitHub? It was probably the dumbest financial decision of my life, considering it was an all-stock offer and GitHub sold to Microsoft, I think, less than a year later. And it would have 3x the price. Far higher than that.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
But I'm really grateful I didn't.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I'm sitting here.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think the question is, what could I have been able to do continuing on Source's mission? Because Source's mission was the mission we're talking about today with Poolside. And back in 2016, there were very few people who believed it was ever possible for AI to write code. But no, I don't think there's really no regrets there. I wouldn't be sitting where I am today.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And I don't think I would have become the person that allows me to go build Poolside today. And frankly, I'm really grateful that that event did happen because that's how I met my co-founder. That's how I met Jason. He was the CTO at GitHub at the time, and it started this many-year conversation on what the progress in AI looks like and its applicability to software development.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
But when we have areas where we have very little data, models really struggle to learn truly more capable areas. And I mean improvements in reasoning, improvements in planning capabilities, improvement in deep understanding of things. While as humans we don't require so much data, the way to think about models is that they require magnitudes order more data to learn the same thing.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
That progress is going to halt. What would cause progress to halt? Global conflict that disrupts the supply chain of chips. That is fucking meaty for a quick fire round.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Mark Zuckerberg.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
i think we all should give a lot of credit to mark zuckerberg in terms of having built an incredible company with a lot of conviction on what the future would look like when most people didn't agree with him if you look at what he's done on ar and vr in the last decade right from buying oculus to where it is today when most of the world just wanted him to stop
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
That required an incredible ability to have conviction for a future that's going to massively change the world. To get to AGI requires an incredible conviction for a technology to change the world. He's one of the people who has done that and someone very different than the people I have currently on our board.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Regulation that fundamentally halts progress for small companies. The reality of regulation in many cases is that it becomes an expensive bureaucratic overhead and that harms the most young startups. It doesn't harm companies that have raised massive amounts of capital.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The world is finding a balance and the balance that I'd like to see that the world is, and I think it's moving towards it, is to regulate the end user application of AI. Just like we've regulated the end user applications of any type of technology before. It's not the database that does harm, you know, how it's used.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And so for me, I would love us for us to continue to hold companies massively accountable for the end use of their technology to users, to consumers. Less so trying to put limitations on how much compute you're allowed to train on. We're building tools that are closing this gap between human capabilities and machine intelligence. We are not building the Terminator.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
So what do you think of DST's Yuri Milner? I really like Yuri. I got to know him through several occasions over the last year, but I never got to understand him until I read his book. Most people don't realize that Yuri has a book or a manifesto. You can find it online for free. And earlier you heard me reference to looking from one top of the mountain to the next.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And that's actually, it's a metaphor that I took from Yuri. And because I think what Yuri has stated and said is that the sheer importance of scientific progress, what he often refers to as humanity's story, right? We have this incredibly special thing on this tiny little blue marble in the universe that is so immensely large.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And I think he really embodied, you know, the notion of we cannot let that flame die out. To him and to Elon's credit, you know, sharing the fact that the world is that one of the ways of doing that is to become a spacefaring civilization.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Our focus is on software development and coding, and it's for a very specific reason. The world has already generated an incredibly large data set of code. To put a little bit into context, like usable code for training, what we refer to as about 3 trillion tokens.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
his whole view is that progress that's happening towards agi helps us to be able to take this special thing that we have you know humanity and and spread it across the universe and there is people who say this and there's people who believe it and who who understand how special this is and what it can mean and yuri's one of those people but at the same time he's been an incredible capitalist
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
He's been an investor that, from what I can see from the outside, that understood that huge technology waves were happening all over the world in different places. And he was a truly global investor. What he saw was happening in the US, he would invest in India, he would invest in Indonesia and across Asia and in all of these different places.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And I think very few people from the investment landscape have taken strong conviction on what technology is going to bring in the next 10 years and then found a way to place bets all over the globe.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
have people tried to buy poolside no comment boat living biggest pro biggest con so i think we have to put some context here several years ago me and my better half and our golden retriever we were living in a fancy apartment we decided to get an old sailing boat to fix up together we put this old sailing boat in the harbor ceiling was falling apart something we did together we were passionate about and we love being on the water i love being on open ocean in particular
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
At some point, we were spending more evenings and nights on the boat where the ceiling was falling apart than the fancy apartment. And we looked at each other and we said, why do we still have the fancy apartment? Now, we got a slightly nicer boat after that and home became a sailboat. And I've gotten this question from friends, never, I don't even know how you know this, by the way.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I've gotten a question from friends. For me, I think the same thing about living on a boat is exactly the same thing of wanting to move the world, you know, forward. And I think part of it is the drive of freedom, right? The freedom of options, the freedom of like, what can adventure in the future hold?
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And then the simplicity of not, of just being with, you know, the person you love and your dog in a small space and you've got your good internet connection and you do your work. You know, all the other stuff doesn't matter. The watches, the cars, the houses, none of this stuff is ever going to be the things you think back on. It's the journey. And for me, a boat kind of allows for all of that.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
It keeps life simple and it gets me, allows me to, you know, fully immerse myself in poolside. And I have to admit, since I started this company, I've been home less than a month. And so it's been a lot of travel, but it's the journey that matters. It's not the material stuff.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And if you look at kind of usable language in English on the internet for training, we're talking about anywhere between 10 and 15 trillion tokens. There's a massive amount of code that the world has developed. Over 400 million code bases are publicly on the internet. So why don't we have this incredible AI that's able to already do everything in coding?
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I did. I was lucky. I went through it in my early 20s. I got a lot of stuff. And then I got rid of all of it. For me, the sheer realization is that it's the journey with the people. The outcomes that we want to see in the world, they're part of the obsession. If you can see a future that looks like one that ends up being this incredible future, you want to build it.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
But that moment, once you reach that, which will always be an ever moving goal, is not the interesting moment. The interesting moment is every single day with the people. And I think for me, I just learned more and more over the years is that I love people and I love the people I work with on my team. I think in every single person, there's something incredible.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And if you cut all the stuff, you cut all the money and you pick the hardest, biggest thing you could possibly, you know, focus your life on and then do it with amazing people, you get to have this incredible experience.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
We're in a race. If we stumble, we put our foot off the gas pedal, we lose. And I think in any race, there's 101 places you can stumble. We don't get the luxury of stumbling on the capabilities race or to go to market race. We have to be excellent in both. If we make a misstep on either of those, we can fall behind. And if we fall too much behind, we're no longer in the race and we don't matter.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I'm surprised how I usually don't know what motivates you. And people ask about the business, they ask about the outcomes, they ask about the future you see. Very, very few people ask you about your why. And I think that's probably the most important question.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
When we talked about earlier about looking at those three companies, my first question to all of them, you know, and I have asked some of them is the why.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
you why do you want the eventual outcome that you are pursuing so vociferously why do you do what you do i think that says a lot about a person and i think and at the end of the day in any race in any ambitious endeavor it's the people that make it happen it's not the dollars in the account those are the resources and inputs that you need and it's the people and so for me the why is a really important question to ask people and then i think it goes back to the toyota's five wise why do you do what you do iso
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I realized that I'm not calm or at peace when I'm not working on the hardest possible problem that lends to what I care about in the world.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Because my brain's never going to turn off. I'm always going to wake up at four in the morning. It's always going to be this constant going over and over of like what you care about. And when I've done that in the past or things that weren't the hardest possible
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
the most ambitious possible thing in terms of like what mattered in the world, the thing that mattered the most, I just didn't feel at ease. And now probably never worked. I've always worked hard, but I've never worked as hard as I have at Poolside. While it's intense and it's stressful, I feel at peace.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
It's because coding is not just about the output of the work. The code that we have online represents the final product, but it doesn't represent all of the thinking and actions that we took to get there. And that's the missing data set. The missing data set in the world to go from where models are today to being as capable as humans at building software
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I really appreciate it.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
is the data set that represents being given the task, all of your intermediate reasoning and thinking, the steps that you do, the code that you write and try to run, and then it fills and you learn from those interactions, and all the way to kind of getting that final product. And that intermediate data set, that's what Poolside exists on creating.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
This is the right question. The way I think about the world is that there are problems that we cannot simulate. The real world is impossible to perfectly simulate. It's messy. It's multivariable. How do we deal with the real world when we're trying to close the gap between human capabilities and AI? We have to gather data. The best example of this is Elon and Tesla.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Elon has put millions of cars on the road that are actually capturing every single engagement and disengagement with autopilot and every single scenario and extending that back to Tesla to train increasingly more capable AI.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And if you look at how full self-driving got more capable over the years, it's directly relational to it becoming more and more learning from the data instead of rule-based and more and more cars on the road. And so to me, Elon has won full self-driving. It's inevitable that
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The most capable AI for full self-driving is coming out of Tesla because they've been gathering and building up this data set. And he needs to gather data because it's non-simulatable. Now, this is the head fake behind Poolside. You think about AlphaGo being deterministic. You think about the other end, the real world being non-deterministic. Where does code sit?
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Code sits a lot closer to being deterministic. Follows a set of rules. Every time it runs, it runs in exactly the same way. And so this is what we call execution feedback. What we're really known for is our work in reinforcement learning from code execution feedback.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
It's the way where we then take a model that we've trained from the ground up, we put it in an environment, say it's an environment with 130,000 real world code bases, several orders of magnitude, the largest environment in the world, And we sent the model off to explore different solutions to sets of tasks and learn from when it passes the tests versus when it doesn't.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
There's a lot more details behind this, but the way to think about it is if you can simulate it, you can actually build an extremely large data set. And part of the things that we synthetically generate is not just the output code, but it's the intermediate thinking and reasoning to get to that output code.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Because models today, and you can try this yourself by going online and chatting to any model, can actually produce their thinking. They're not very good at it yet. So what do you do when your thinking is not very good? You need feedback. In our case, deterministic feedback, code execution feedback.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
We are making in our space, especially I think post the ChatGPT moment, like incredible advancements in the algorithms that are making learning more efficient. Internally, I have this thing that I say to the team, and they're probably tired of me hearing because I say it every single day.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I say, all the work we do on foundation models, on one hand, is improving their compute efficiency for training or running them, or on the other hand, improving data. Now, the way to think about the algorithms and the improvement of compute efficiencies, that's table stakes. All of us, OpenAI, Anthropy, Google, et cetera, are doing this, and we're just constantly improving here.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And it's engineering and research combined. But the real differentiation between two models is the data. compute matters tremendously for data. Because if you think about poolside, and we spoke about how do we get this data, and I mentioned the word synthetic, it means that we're generating it.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
It means that we're using models to generate data, to then actually use models to evaluate it, to then run it. And so compute usually matters on the side of the generation of data. But once we have all of this data, where we started today, we spoke about neural nets essentially being compression of data that forces and generalizes learning. Now, when we have small models,
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
We are taking huge amounts of data and we're forcing this generalization of learning to happen in a very small space. And this is why we essentially see these difference in capabilities. Larger models require, essentially, it's easier for them to generalize because we're not forcing so much data into such a small compression space.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And so my personal mental model of this is that the scale of your models, this has been shown over and over again, by the way, we owe a depth of gratitude to Google, to OpenAI, proving out the scaling laws, which essentially say as we provide more data and more parameters, more skill, hence more compute for these models, we get more and more capable models.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Now there is a limit to that most likely. If you think about it as the analogy to compression, your image that you had, you know, at high resolution compressed down to small resolution. The small models are the small resolution. We have generalization, but you're losing things. But in the infinite extreme, an infinitely large model wouldn't be doing any compression.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
So there is definitely a limit at some point to model size. But what underpins all of this, to directly answer your question, is the compute. And the compute really, really matters. Your own proprietary advantages in your applied research to get great data or to gather it matter equally as much. But if you don't have the compute, you're not in the race.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
We are horribly inefficient at learning today. If you think about what drives efficiency of learning, it's the algorithms and it's the hardware itself. We've got probably decades, if not hundreds of years of improvements still left there and different forms of it over time. If we look very practically in the coming years, we are going to see increasing advantages on the hardware.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I'm going to see increasing advantages on the algorithms. But I hope everyone takes away that this is table stakes. This is something that you have to do to be in this space and you have to be excellent at it. It's not what differentiates you, it's what allows you to keep up with everyone else.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
I think the biggest cognitive dissonance that people have around synthetic data is a model is generating data to then actually become smarter itself, right? It feels like a snake eating itself. There's something that doesn't make sense in it. Now, the way that you need to look at that is that there's actually another step in that loop.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
There's something that determines if from all the data that the model generated in my domain and software development, I have a task in a code base and the model generates 100 different solutions. If I would just feed those hundred different solutions back to the model in its training, the model won't get smarter. That's the snake eating itself.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
But if you have something that can determine an oracle of truth that can help say, this is better and this is worse, or this is correct and this is wrong, that's when you can actually use synthetic data.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
We are starting to understand that the scaling, the first version of the scaling laws that came out spoke about the amount of data we provided during training and the size of the model. More data, longer training and size of the model larger requires more compute. And so we often say the scaling laws are about applying more compute. And it's actually more correct than we initially realized because
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
The importance of synthetic data for models to get better is another form of using compute, but we're using it at inference time. We're running these models to generate these 100 solutions, generate 1,000 or 100 or 50. I think we have a lot of room still for scaling up models. We can do this by scaling up data, and we can do this by scaling up the size of the model.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
Now, our opinion is that there's a lot of room to scale the number of parameters and size of models still. But there's something that we don't really talk about in our industry as much. We're training extremely large models. And by the way, we until very recently weren't even capable of doing so because we didn't have the compute and the capital.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
This is why our fundraise has been so important to us so that we can have the capital to scale up. But what everyone does is that extremely large models, we can run cost efficiently for our end users.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
You have a multi-trillion parameter model that is what we often, you know, often architected as an MOE, meaning that not all of those parameters activate during inference time, but they're still very large. It's too expensive. Every request that you make to that model is not a couple of cents. And so you have to find a way to actually build models that you can actually run for customers.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And so what happens in our industry, and this is our path as well, is you train a very large model. where you can clearly see that there's more capabilities in the model. And then what we call, we distill it down to a smaller model.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
And because this is the thing, learning from data models are really inefficient, but learning from data in combination with learning from a smarter, larger model is actually quite efficient. We make really big things that become really smart.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
We then teach the smaller models to try to match as much of that intelligence as possible, which we can then economically viable, put in the market and make revenue from.
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CTO @ Poolside
We should separate the price and the cost of models. If you look at what's happening in the world of general purpose LLMs, LLMs for everything, it's an incredibly competitive price war that's happening. And it's happening between the large hyperscalers, and it's happening between kind of referred to as the escape velocity AI companies, anthropic and open AI.