Menu
Sign In Pricing Add Podcast

George Sivulka

Appearances

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

0.069

You can bucket great founders into three backgrounds. I think probably the most common is that you had kind of a messed up childhood. The second most common would be you're gay. And the third most common would be you were adopted. Look at like a list of all time greats. Elon Musk kind of messed up childhood, Jeff Bezos, Steve Jobs adopted, Peter Thiel, Sam Altman, you know, like publicly gay.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1007.262

And so Volpe is like, there'll be a few partners on this call. What round is this for? This is for a seed. So there's a follow on to the pre-seed in like November of, I think, 2020.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1015.885

And I get on the Zoom call and I've literally got clothes hanging behind me and they're like all of a sudden Mike shows up and then four other partners and then 80 partners and like the Zoom screen tessellates with, you know, hundreds of faces. And I'm like horrified at the fact. And Mike's like, look, he's living in a closet. And everyone's like, ah, great founder. And I was so embarrassed.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1048.659

Well, so I was saying two months prior, again, I think it was at Stanford or just about to leave Stanford. And one of my friends had interned at Founders Fund. And he's like, hey, I hear you're raising financing. You should talk to Peter. And It's like, well, I'm not going to say no to that. And so he introduces me on an email thread with me and Peter.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1066.365

And I'm like, hey, Peter would love to do a lunch or dinner. I'm not a morning person. So I was like, Peter would love to do a lunch or dinner anytime soon. And Peter was like, I can do a breakfast. I was like, I really want to do a lunch or dinner. You know, like, can we do a brunch? You know, he's like, I'm going to do a breakfast. And so I said, well, that's fine.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1082.353

And he gave me a slot on a Saturday. And so got in my car. It was an old beat up 2006 Audi convertible that I had fixed up from Craigslist and bought for $4,000 at three in the morning and drank a bunch of coffee, like 18 cups of coffee, like a five hour energy, like all the disgusting stuff and drove from three to eight to his house to go and pitch this guy.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1102.719

And I think he showed up 45 minutes to an hour late. He's like just waking up and I'm wired. I'm like sitting in my chair, you know, like ready to go. And it was supposed to be a 30 or 45 minute breakfast. I was like, it's kind of already shot.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1115.607

But we ended up talking for, I think like four or five hours about not only the company and all of the flaws that I had in my business model, but then also math and deep esoteric philosophy and like just the world. And he said, you know, I'm not investing at the time because it was coronavirus and a variety of other factors, but I'd love to put in a check.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1135.74

I got out of this conversation thinking I had just made a friend or was seen from someone who's incredibly, incredibly, incredibly bright. And I'm leaving his house and I felt like I was inducted into the Illuminati. I was like my whole body, drop top, the sun's shining. I was playing Kanye West. I drove out as my first offer from a venture investor. How much did he invest?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1159.789

But what do you think makes Peter so incredible? There's two things. He is incredibly ontologically smart. And so he can build this worldview or this perspective of the world where like he actually just like knows how to pattern match to a variety of other things.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1175.574

But then he's also, I think, phenomenologically smart, which is the idea of like he understands processes and how humans behave really well. And so he's always thinking like, hey, you know, ex ante or like, you know, if I'm looking at something that's about to unfold, could I have predicted this ahead of time? And he always just asks himself that question.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1192.661

So he's built up a really rich perspective of the fallacies that human society has, mimetic behavior that people kind of go out and copy each other with, etc.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1209.088

I mean, I think we were in late discussions with a lot of investors and then everyone else was like, yeah, let's like, you know, let's pile on in here. It's, you know, it's some of the best money that you can get. And that was a game changer for us.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1228.336

We've got a million. And then two months later, Mike actually hears about heavy from his daughter, who was a Stanford student. And I think I'd seen the product was friends. And and then Mike actually comes in. It's like, hey, this is completely different than Elastic or all these other search technologies that I've seen invested. Obviously, he's on the board of Elastic today.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1246.054

So he's like, well, let's just go add some fuel to the fire. How much did he invest in? He, I think, invested like an additional $2 or $2.5 million at the time. So where did the $130 come from? Well, that was years later. This was years later? So this is all in 2020. We end up building a product studio, which is the first to productionize RAG, Retrieval Augmented Generation, also in 2020.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1272.492

We build the first semantic search engine. We actually go out and start to- Can you just help us understand what is RAG? RAG is an acronym that stands for Retrieval Augmented Generation. If you look at large language models today, they're really good at maybe thinking if you give it the right context, but they hardly ever have the right context.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1292.971

And so RAG was the first real attempt to give them the data to answer questions correctly. Okay. And so we are building on RAG to start. We were one of the first people to productionize the idea of putting a search engine behind an LLM. So you'd ask a question and then instead of it just replying from its memory, it would actually go and do a search and then reply with that context.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1313.728

So in an enterprise where you have a lot of offline data, we were really the first people to hook up that offline data to large language models to answer that question.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1325.777

That's a bit of a plot twist over here. I actually don't think RAG works at all. It's one of the most used AI architectures in the world, pioneered at Hebbia in a very meaningful way. I think every enterprise is experimenting with it, but it has a lot of different failures where a lot of the time, the questions that people ask these systems aren't ever explicitly in the data.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1346.423

They're never explicitly stated. They're actually about the data. So for example, if you're asking an AI system, is this company a good investment? which is actually a very common thing that people ask Hebbia over marketing materials. Maybe it'll say in a pitch deck, yeah, this company is a great investment as something that the CEO says or like a recording, et cetera.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1365.078

But what you actually want from that system isn't a search in the data, it's an answer about the data. Hey, what's the customer concentration? What's the strength of the management team? What are X, Y, or Z criteria that are fundamental to our specific investing process? And that's a process. That's not ever explicitly stated. Actually, the marketing materials are often like a load of crap.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1385.193

You have to actually distill what's true out of them. That's what Hevia does. So it's not actually finding something that exists already. It's taking all the things that exist already and starting to answer questions about that information.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1408.247

Yeah. So we actually deploy at some of the largest finance firms in the world. We ended up going from zero to a million dollars of revenue sometime in 2021 or 2022 and raise our series a also from from index from my index, which is 30 million bucks. And we start to see that all these customers, okay, now they know what ChatGPT is. They know what LLMs are.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1428.062

Hebi has this really mature enterprise product in the market, and we're by far the first to actually get there. And we just looked at all the queries that people were asking. And the questions that people were asking weren't ever, okay, find me the quote or find me the command F questions.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1442.736

They were actually more, okay, read all the documents and then tell me all the times they mentioned AI or what our exposure to Silicon Valley Bank is during the regional banking crisis.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1453.624

And so all of these questions, it was actually almost 90% of the questions that people were asking these systems weren't answerable by search through the documents, but rather they had to be work done on top of the documents and then answered.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1477.078

I don't think they're loving Ragnar. What makes you say that? I think like 90% of enterprise AI right now is almost like this vapor where we swear it works. Like, look at this amazing demo where we ask, what does the CEO say about the investment? And the minute that they actually go to, you know, try to use it in a real world example, completely just fails.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1497.792

And so I actually think that the majority of AI usage, a lot of these usage statistics are all kind of one of my favorite phrases. It's fugazi fugazi. And one of the things that Hebbia really tries to put forth in the market is to say, hey, change will take time. But we have a system that is actually starting to drive real measurable value over very specifically defined use cases.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1518.803

And our tagline is always, hey, stop experimenting with AI, which everyone's experimenting. They're all really excited about it. Start driving value, like getting value out of it.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1529.87

I actually am not a big believer in RPA. I think RPA is almost not an AI application in the new sense of AI. It's like AI in the old 10 years ago sense of AI, where RPA is effectively like very simple computation. But some of the things that people are asking Hebbia are over 800 page credit agreements or 230 page SIMs. Confidential information memorandums, this marketing material.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1553.63

They're not actually asking for things like copying numbers. They're saying, hey, tell me what are inconsistencies in this document. Tell me where there's an event of default that we can trigger. There's almost this open-endedness or this new level of computation that people can do.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1586.56

And I think that we very much are capturing the agent, the high level, ambiguous decision making and trying to trace it all the way down back to individual citations or individual characters that led the model to that decision.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1611.772

I actually don't agree with that at all. I think he's completely wrong. I think it depends on how you define business apps. But I actually think that if the new business apps are platforms, you'll actually start to see those platforms really take hold. Like Hebbia is a platform. It lets you build whatever agent that you'd like. And so here's a bit of a mindfuck.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1631.566

When building Hebbia or when building all of these foundational primitives for how people use AI over the last four and a half years, Hebbia has always asked ourselves, what are the apps that AGI would want to use? Or what are the apps that agents would want to use themselves? I.e.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1645.697

what are the tools, because these AI applications are really good at using tools, that we could build that would assist LLMs or these really smart foundation models, whatever they are in the future, to get to an answer more quickly. It's quite interesting, you know, Hebbia Matrix orchestrates lots of smaller LLM calls. It's actually scaling at inference, i.e.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1665.005

it's running massive amounts of compute at the orchestration layer. And we think that, you know, an AGI system would prefer to use heavy a matrix to diligence a company or to look through thousands of documents versus to read them all by hand. And they're in a really long context window.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1688.715

I ultimately think that it will be a mix of all three. History doesn't repeat itself, but it often rhymes. 60 years ago, or even longer, the foundational unit of compute, i.e. doing a calculation on a computer, was effectively introduced to the enterprise.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1704.6

There were plenty of people that were tallying things or bookkeeping in actual books, and their jobs changed, and there were apps for bookkeeping, and then there were platforms like Excel that let people build better apps for bookkeeping, and then Excel was unraveled again into better apps for bookkeeping.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1718.444

And I think that there's opportunity not only in verticals, but there's also opportunity in the entire industry in terms of building platforms, in terms of building cooperatives, in terms of even building new types of quote-unquote agent employees. And I think that that opportunity is the exact same size.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1734.18

If there was $100 trillion of value that was created in the stock market from the introduction of the computer or the fundamental unit of compute. I actually think $100 trillion of value will be created in the next 60 years from the introduction of inference or of AI compute.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1757.228

And maybe I'm too techno-optimist, but I actually think the S&P 500 is completely- $100 trillion of additional.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1773.3

I ultimately genuinely believe that more than 50% of the GDP will be contributed by what you can call agentic applications in the next few decades. Yeah. I actually think it'll happen faster than the next few decades. Do you?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1811.718

It's a good point if you're cutting cost, which I think Daniel and UiPath are one of the best examples of using AI to make companies more efficient. If you look at finance and how fast Excel went to 90% market penetration in finance, 1985 to 1986, literally 18 months to 24 months, Excel took over all of finance. Everyone switched from using a calculator, the HP-12C, to using Excel.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1837.595

And if you look at how fast finance actually ended up, you know, using credit card data to value public companies ahead of their earnings, that was, again, a two year period more recently. And so finance is the slowest moving, most lethargic, you know, leviath. It's the worst possible customer base to go after unless you're providing outsized alpha or real value.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1856.872

In which case, the minute that there's something real, finance moves faster than any other industry. And so I'm actually making a bit of a bet by going into finance and starting to go out and try to get to my own. You know what I worry about? I worry that we lose the education process.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1893.536

Yeah, I'm less worried about that. I think ultimately one of the best things about having the years of experience is actually having the depth of knowledge about investing. So for example, if I'm a junior trying to price an asset, I haven't seen that many other companies that look like this company.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1911.047

And so I might say, hey, I think it should be priced at X, Y, or Z. And then someone in the IC meeting will be like, hey, no, I've seen 20 other companies in my 40 years of career that look exactly like this. And they all went nowhere. And I'm leaning on my prior experience.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1924.976

With Hebbia, now juniors who are really smart themselves can say, okay, you might have remembered 20 deals, but I'm looking through every deal in our company's history in a giant matrix that anyone has ever seen. that when a company is performing here, it's 90th percentile across all of this investing criteria, we should actually pay 90% premium to market.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1949.97

And I'm actually using more deals than you've ever seen because I know your name is on this many IC memos. And that type of structured thinking or that type of additional information that you can now give juniors in their career, I actually think makes better investors. I don't think that that takes away.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1975.798

I think that it will change the way that people do work, but I genuinely believe that it'll actually increase the AUM of the firms that use it. I think it will actually drive more employment. I think there will be some jobs that change. Hey, there's no more bookkeepers that do tabulations in spreadsheets on two sheets of paper. What changes most and what stays the same?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

1995.803

The cognitive tasks that are lower in cognition, like more back office, kind of middle office, maybe even some of the more junior front office tasks, I think will start to move into, okay, how can we manage AI juniors rather than actually do this ourselves by hand?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2016.319

But I don't think that just as Excel didn't end up taking away jobs from people, it just changed people to having to learn Excel, the exact same thing will happen with AI.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2031.071

You know, there's, there's all these stories and you know, you have like Klarna that's positioning for investors that they're firing half their staff and no one really wants. And I think that's BS. I think it's BS. Yeah. There might be some reality to it, but I think that it's an amazing marketing story.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2045.965

And so anytime that I ever hear something that's put out as a marketing story, I almost negate it in my head. to actually think about what the implications are. When you're saying something and screaming it from the rooftops, that almost always means that internally you're freaking out about something. I look at that really loud behavior and I think that behavior itself really negates the content.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2064.976

That's maybe my positioning on this sort of stuff. How do you feel about competition? What are your lessons on competition?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2075.02

I think that if $100 trillion of economic value will be created by AI and agentic applications, that there will be so much room and so much opportunity for a ton of different players. I don't think that when Excel came out and then Mark released Salesforce and then people created TurboTax, all these unravelings of Excel actually were produced later, that that made Excel any less valuable.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2099.27

I actually think it made Excel more valuable. I view Hebia as this platform as something that will actually get better the more people get inspired by it and build increasingly verticalized applications. What models do you use? You sit on top of what? We are completely model agnostic. We use all of the major model providers, some of our own models.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2118.709

But ultimately, the foundational difference that Hebia is capitalizing on right now is fundamentally new and very important difference, which is I actually think on the order of creating rag and creating agents and decomposition is this idea of us in the last year or so having pioneered scaling at inference. Talk to me about this.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2136.9

Right now, you actually, so OpenAI is starting to do this with O1, where they'll have a model recursively think about a question over and over and over again before it produces an answer. And so instead of training a larger model, they're using effectively a similarly sized model and just telling you to run multiple cycles, i.e. compute more before answering.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2157.148

Hebbia has actually pioneered something different where a year, almost 18 months ago, we said, hey, we can't wait for these models to catch up. What we'll do is infer simple, single question. Let's actually run hundreds or even thousands of submodels of the best models in the world to compute over every single document to answer the same question.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2176.747

And so ultimately, if you can't train larger and larger models fast enough, you could take whatever state of the art or cutting edge and run it more times to get more compute, i.e. more computational power, better decision making for the same user right now. And so this is an idea that we pioneered. It doesn't matter if you're using Claude 3.5 or if you're using O1 itself, i.e.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2197.479

scaling at inference at the orchestration layer with something that was scaled at inference with the training layer, but you get way better results. And it's a way to

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2213.668

We've seen that for certain types of documents, like the dense legalese or more colloquial documents, Anthropic works better. But for other types of documents, like OWAN or OpenAI 4.0 works better. And it's always trade-offs between accuracy and speed and all kinds of things. Actually, a lot of the time when we're decomposing a task, we'll use mixes of OpenAI, Anthropic, even Gemini.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2250.666

This makes me think of the story of Bloomberg, which has the best financial services training set of all time. And they trained a GPT 3.5 class model. It was called a Bloomberg GPT. And they released an archive paper and everyone on LinkedIn was like, wow, Bloomberg is, you know, cutting edge and they're going to steal finance. Why did they not?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2269.317

They did have all they've got the best data in finance. So then GPT-4 was released, I think, like a few weeks later. I don't know exactly the right timeline, but it just destroyed Bloomberg GPT at every single finance task. And so you saw the idea of post-training or kind of like this refined, verticalized model creation just always would lose to scaling loss.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2290.612

And maybe we're at the end of scaling law as a training. But I actually think, you know, Hebbia and now OpenAI and a variety of other companies are starting to pioneer the idea of scaling laws and inference. And I actually think that it will make nothing that that other players can do to fine tune models will ever catch up.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

23.002

And I think that all of these early life experiences end up giving you some desire, some deeper passion to go out and prove yourself.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2330.365

Yeah, I think it's a bit of a marketing distinction. But ultimately, the idea is that the way that we got here over the last five, seven years of training models has been, let's build a bigger and bigger model, and let's give it more and more data, more and more clean data. And then maybe we'll do some RLHF or some reinforcement training to fine tune it after pre-training.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2353.673

And that worked great to get us here. But we're running up against the amount of good data that exists in the world. We're running up against. Are we?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2372.776

You know, I think that we're starting to run up against the constraints of it. That's a gut feel. I'm not, you know, I'm not looking at particularly in data collection myself, but I think we're starting to run up against the limits of really good data. What's then the problem? So ultimately, that might mean that. hey, we're training larger and larger models.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2391.162

XAI, again, just created the largest GPU cluster of all time, and they're going to try to train larger and larger models.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2397.007

But regardless of how the scaling laws for training larger models or parameter count and accuracy or performance carry out, I'm starting to believe that you could still get better compute not by building a larger engine, to use a metaphor, but by actually putting a bunch of smaller engines together.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2414.199

Hebbia, by orchestrating large amounts of inference to answer one single question, ends up kind of building like a Tesla, where Tesla is made of a bunch of smaller engines or a bunch of smaller electromechanical motors that make a lot of torque and a really, really amazing larger engine. Does it not make it incredibly capital inefficient?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2433.722

I think the one thing that people in my position will always tell you is that the cost of intelligence will go to zero. The cost of intelligence will go to zero. I think that since Hebbia started, the cost of inference over a fixed number of parameters has decreased by seven orders of magnitude in four years. And so I genuinely believe that scaling compute is like a no brainer.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2458.432

And yes, we run more large language model calls than anyone might even say would ever be necessary. But we have the best accuracy in the business. We can answer much more complex problems. We're driving real value for enterprises. And I actually think that every single quarter, like our margin goes, we're not spending money fast enough.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2484.171

Ultimately, the model layer, and I think this is not a hot take anymore. I've been saying it for a few years, but I think it will become commoditized. I think that a lot of value will accrue at the hardware layer. And we could talk about what that means for NVIDIA, especially as NVIDIA has a stranglehold on training, but not as much stranglehold on inference.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2500.787

And so you might actually see other chip makers actually start to their chips start to be used in a more meaningful way because CUDA is what all ML scientists were trained on in their PhDs. But then inference doesn't matter kind of what you're using. And I think it will be the infrastructure layer and then actually the application or agent layer that will accrue the most value.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2532.426

I think it might. There's probably fewer players and more entrenched players in cloud. And ultimately, I think those players honestly kind of have like an OPEC oligopoly where they can control pricing. I just think that ultimately cloud is actually more complex than training larger and larger models.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2562.963

Absolutely. Whoever has the best models will continue to attract the right amount of investment. The different thing about clouds too, though, is that the cost of switching is much higher. So to refine my earlier point, I can switch models readily. I think there's even entire businesses now.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2579.918

There will be an entire industry of being able to switch models from open AI to anthropic when open AI goes down. But to switch clouds is like for... any substantially sized startup, like a $10 million to $20 million investment just to switch. It's almost always never worth it. It's much, much, much stickier. Whereas here, it's a very simple API key. It's very simple to switch models.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2610.942

I think XAI is the most undervalued company and a really spicy take. I actually think XAI might overtake OpenAI and Anthropic in value over the next 12 to 24 months, which is crazy, but I think they're all undervalued. What leads your thinking? I think Elon is very well positioned in the geopolitical sense.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2628.753

I think Elon can run a more efficient business and not have to deal with as much administrative bloat or as much friction from employees. How important is geopolitics in winning this game? I think geopolitics is actually very important.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2642.421

I think that governments will be some of the largest users of AI, especially with some of the recent things that the new administration in the United States has been talking about with increasing government efficiency. I think that ultimately energy is a very big bottleneck.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

265.109

And I mean, it sounds like you did a lot of research. So thank you for diving deep and really excited to meet you as well.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2657.185

It's a very common thing in Silicon Valley to talk about, hey, we need nuclear reactors to flatten the duck curve so that we can continue to drive to larger and larger data centers, et cetera, et cetera, et cetera. And those are ultimately geopolitical resources. And so I think all of these things end up being very important. And then Elon's just operationally so talented, right?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2676.899

So I think that ultimately, if this becomes commoditized and whoever can really operationalize model creation and serving models the fastest, I think it might start to work.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2689.007

I would, but ultimately I think all of them are undervalued. I genuinely believe all AI companies and the S&P 500 are all undervalued, which is a very hot take. If we're about to create $100 trillion of value, I think this is a real tangible technological shift. It's a massive unlock on the order of what computing did for the entire economy over the last 60 to 80 years.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2710.656

I think this will do for the next 60 to 80 years. I think all of these companies are massively undervalued, including the non-AI companies are

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2715.658

unpack the last bit including the non-ai companies i genuinely believe that computers made legacy businesses better if you use them correctly uh and so it's a massive disrupting force but if you can ride the wave of change a ai agents and this new fundamental paradigm that is a massive unlock for you do you think there is a slight difference everyone talks about kind of different uh technological transitions when you look at you know the agricultural transition or the kind of agricultural dependency on human labor and movement to machinery

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2767.222

Yeah, I actually always liken technological revolutions to what Hedby is doing right now, where people invented or we discovered the technology of fire and then someone invented the torch. I don't know how many years later we invented the engine and someone invented the car or the wheel and then the chariot. And so this idea of encapsulating and building a useful product.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2787.974

on top of a technology change is actually the thing that takes more time. And I think that Hebbia has built, if Excel was that product for compute, I actually think Hebbia has built that product for AI. And I think that when you have a good product, that transition will be very, very, very quick.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2802.141

Right now we have these chatbots or these surface level search engines that give you facetious surface level value. Yeah, it'll help your kids cheat on their homework, but to drive to whether or not something's a good investment is a much, much more rich problem. Is chat the right interface for many of these applications? I ultimately do not think so. I think that chat was always a useful feature.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2822.81

It's a useful interface. It's like a single cell in Excel. It's like asking if the TI-84 was the right interface for computers or the terminal was the right interface for computers. We have not even started to explore the opportunities for interfaces. What do you think they are? I think that Hebbia is the Bell Labs, and I conceive of ourselves as the Bell Labs of defining AI interfaces.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2845.517

I think that RAG was one of them, i.e. this idea you could find things in the data really fast. Decomposition in agents are another. This idea of scaling at inference with our matrix product is another.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2855.999

You can look at a lot of the other things where agents are controlling four screens at once, and you're actually looking at someone use a computer, or computer use where AI models are moving cursors are others.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

286.568

It is fair. And I think the first time I met with Sangin, who's one of our investors at the Series B, it was like a 30-minute lunch that turned into almost two hours of us talking in depth about the dynamics that I think made me have a chip on my shoulder. But In short, I was born in Staten Island, New York City, which, you know, you already have a chip on your shoulder from that.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2870.486

I actually think that the better agents are, the more work that they do, the more important it will be that they are easily understood by humans. The idea would be, okay, let's say we have a bunch of employees, 10,000 employees or 10,000 AI agents drop at a company. They're all experts. at doing something.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2887.741

That ends up not becoming a problem of giving them the right tasks, but actually it becomes a management problem, right? There's this whole infrastructure orchestration layer, the thing I always come back to of making these things work together. And that's actually going to be a challenge. And that's going to require a very human first, ultimately a product. And that's what we're trying to build.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2908.283

Do you think Elon will be successful with Doge? I think it will be his greatest challenge. There's a lot of self-protecting mechanisms in the largest organization in the world, which is kind of a US government by spend. It's just this massive, unruly organization. It's not going to be as simple as Twitter.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

2928.63

I think the thing that I care most about in the world is that we as an industry have very clear guardrails that we can follow and understand to build the best possible tools, to get our tools out to the economy, to make sure that everyone transitions in the best possible way.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3005.757

So NVIDIA has, you know, I think that the best moats aren't technological moats. They're not data moats. They're actually people moats. People and networks have the most friction to change. One of the things that NVIDIA does best is the fact that they made this early bet on machine learning.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3023.282

They created CUDA, which is the way that, as I mentioned before, almost everyone learns how to train models. Like they learn how to, you know, how to interface with NVIDIA chips for training.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3033.007

As you're starting to see, maybe that prediction that I made earlier, the shift away from training to inference as a fundamental, almost macro shift in how people deploy AI, I actually think that will destabilize slightly the dominance of NVIDIA chips.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3047.558

You can start to actually use AMD chips or even custom architectures, which all the major model providers are also currently exploring to do inference So you have your academics and your researchers, you know, training large models on NVIDIA chips. But the minute they deploy them, they can deploy them on cheaper infrastructure. And that actually I think it will be a big change.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3066.491

So I'm actually still bullish on NVIDIA, but I'm even more bullish on other chip makers and custom ASICs to do inference because I think there will be a larger shift to inference moving forward.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

307.209

Grew up kind of around New York City in New Jersey primarily, which a second ship. But my mom is probably like a mafia child born and raised Staten Island. And my dad is an immigrant from Slovakia who grew up under the Iron Curtain and then immigrated, really escaped to the United States. They both of them actually fully intended to be professional athletes.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3085.284

probably be large tech providers and AMD. I don't know about Intel, right? I would probably bet on them. There's definitely an opportunity in the market, but chips are hard.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3103.072

I think that 90% of the market is still in experimental budget phase, but we're starting to see early promises of actual value. And my entire business is focused on just those repeatable use cases.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3123.01

I think ultimately the people in the enterprise that are most excited about AI and positioning it so strongly are CTOs and information technology people. And maybe the thing that Hebby has always said is that the CTO or the IT folks are actually the people that know the least about the business.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3138.52

The people that actually understand how to use AI in a business context are those that are closest to the business. And so we're jumping the gun a little bit with the CTOs trying to build the CRM before it's been invented. And you actually need business people to build the CRM in Excel first in that order of operations.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3155.151

And so there's a lot of unbundling of AI applications or CTOs trying to go out and build a very specific vertical application. But I actually think that building this platform, Heavy Matrix, is the thing that will unlock users' ability to discover what they can use AI agents for.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3177.145

It's a good question. There's like four canonical prices. There's like consumption-based pricing. There's per seat pricing. There's like, hey, rent a salary, so pay a salary for an employee, which seems a little bit ridiculous, but will be less so. And then maybe there's like flat pricing. And I think it ultimately depends on how you're driving value.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3194.477

Because Hebbia is building human-centric AI, the human layer to how you orchestrate an AI agent's staff, that scaling at inference. We do per seat because it's ultimately always back to the human. I think you'll see all of these new business models and pricing mechanisms.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3214.193

I actually think that we are human first. We're business user first to the point where CTOs like to pay for consumption or API, et cetera, and business users like to pay per seat because it's how they map back to value. But also we want to incentivize change. Tech is not the hard part of all of this.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3231.44

It's hard, but the hardest part of AI change management, no matter what company you are, are people and actually getting people to use the software. When you charge for consumption or API pricing, you're disincentivizing the change. You're saying, okay, well, I'm going to penalize you in a monetary way for every time you use an AI application. What the heck? Versus here's a per seat fee.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3252.939

It might be expensive, but use it more. You could run more LLM calls on Hebbia effectively for free than any other platform if you actually are driving real change. And that's what I love to see.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

328.138

They had four children, of which only one was a boy. And so, you know, you can imagine their dismay when I was, you know, chasing butterflies on the soccer pitch or like falling on my head many times, which I have plenty of stories of me literally like falling over while trying to dribble a basketball ball.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3292.767

It's somewhere between, you know, Peter talking to me about anything but the business and deeply academic things and Mike taking me on a walk around the Woodside Horse Park.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3319.825

Oh, crazy one. I believe that UFOs are real. I think a little bit more on the nose right now, but I actually believe there's fundamentally different propulsion technology and that I think the US government has access to it. Wow. Conspiracy theory. I have a lot of spicy takes as a specialist. Bring that out.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3343.437

I don't think I'm ashamed of it per se. But one thing that I always hid was the fact that I'm deeply religious in an industry that's very atheistic or agnostic. It was like something that was very personal to me. And I think it's been massively contributing to. How has it contributed?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3361.425

I think that ultimately when you're doing hard things or when you're chewing the glass or working all those really late hours, believing in something larger than yourself or believing in what you do as a vocation or something that's deeply purposeful and deeply meaningful is actually, it's additional fuel. It helps you in a way that is, I think, good for the soul. It really charges you up.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3384.671

Do you pray? I do. I pray for an hour every morning. What? Yeah. I wake up, I sit on a meditation cushion and I used to meditate. I think meditation is also great. Praying and then putting something out into the universe or actually having a dialogue with whatever you believe, I actually think is even more powerful. It's almost- Can you talk out loud?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3408.144

I live by myself sometimes, but sometimes it's all in my head. I think it's incredibly good for the human mind. I think it's almost an antivirus for the human mind. For an hour? For an hour, yeah.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3422.094

yeah it's you know people meditate well why is it so weird to pray i think it's uh i didn't know what i would say when you when you dive into the human psyche and and you're not looking at your phone and and you're a lot of the time it's also a really great channel to think i think a lot of the a lot of the best ideas that i've had at hebia have come from from moments of silence yeah

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

345.097

And I think, you know, my whole childhood, I was really just a math kid, like not very out there, wasn't really talkative, only really good at math. And my parents barely even knew what Stanford was. So growing up, you know, you kind of have this whole misalignment of of who I was and who I wanted to be with who they wanted me to be.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3462.01

You're a fit dude. I try to try to work out every day. I actually end up mostly channeling the the startup pressures and anger and anxiety into heavier and heavier things and lifting heavier and heavier things. So it's nothing that's like in particular.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3482.211

Hebbia, I think, there was a podcast that actually recently came out where everyone's like, if you're going to build an AI company, you've got to build it in Silicon Valley. But there is one company in New York that is doing a really amazing thing. That company is Hebbia, and it seems like they're actually doing something interesting.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3497.92

And I do think we are the exception rather than the rule, unfortunately. So I'm a big believer in Silicon Valley.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3505.315

I think that we are a Silicon Valley company in terms of our style of work, in terms of how hard we work, in terms of how we actually pursue new technology and invest in technology. And we started in Silicon Valley and we have almost only Silicon Valley investors.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3522.925

longer than 12 months probably like 18 months ago it was the scaling at inference thing like the belief in like a new set of scaling laws that they would be really really really important service now yeah salesforce or ui path okay shag marry or kill um yeah uh i wouldn't i wouldn't shag any of them i i don't think that traditional shag is like short-term excitement

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3550.4

I mean, I don't think that- In case you needed the context. I know exactly what you're getting at here. I really, you know, I'd probably kill them all. I don't think that traditional enterprise B2B applications are sexy. We're an enterprise AI company.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3572.959

I don't think they are. I think that Salesforce has built, again, a very, very, very sticky network effect with people. And people are the shifting function at the end of the day. It's not a technology problem. Claude can build a Salesforce. I think Klarna, again, had another Fugazi story about going off Salesforce because Claude had built them a CRM.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3594.551

I just think that the switching costs, the network effect of changing human beings' habits is too high. Salesforce is one of those monopolies in that they have so much stickiness, habitual stickiness.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

361.486

That gave me this drive and desire and passion to go out and prove myself in a way that was really tangible, maybe not only to them, but like hopefully to my own kids one day. Did you have friends? I had a lot of friends who were incredibly nerdy. So we went to a public school. I was the type of kid that would hack the school tablets to put StarCraft on everyone's computer.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3614.1

I would probably buy Nvidia. It's a lame answer, or AMD rather. I think AMD, because I believe that they will benefit from the shift to inference scaling more than in an outsized way.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3629.498

Not a company. I'd love to be mayor of New York, believe it or not. I just think that's like a fascinating job. I think it would be really, really interesting and would love to make some change there.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3647.819

I think that one of the most interesting questions is where does creativity stem from or where do you get inspiration from or kind of like how do you come up with new ideas? Like, I don't believe that people come up with new ideas by brainstorming or in conversation. I just think that's, again, fugazi fugazi. But I think that ultimately, you know, that question of where creativity comes from.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3666.632

I'm also a very big painter. I'm a very big, so I do large scale, like 10 foot plus oil canvas, oil painting.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3676.456

Where did that come from? I just, I think. Are you a poet as well? I love to write and probably not as good a poet, but I actually think that other creative outlets are really, really good.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3700.327

good for you. I think it's one of those activities where you can channel emotion or intuition or latent thoughts that are somewhere in your subconscious and connect things in a really meaningful way.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3710.509

And so in a world where there's all the stimulus or you're always thinking or churning through something or all this distraction, you're standing in front of a canvas for 10 hours with some nicotine and you're just lost in this art. I think great artists will tell you that they don't even know where paintings come from. It just is this channeling something. It's one of the best places to think.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3732.273

It just gives you connections. It brings up these parts of your subconscious, these connections that I think you can't really access without being creative. Whether you're making music or writing or painting, I actually think that's one of the best ways to process it.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3750.094

Yeah, I think so. I think they've heard about it. There was one moment where I think my father's boss ended up calling him and was like, your son's kicking ass. And I was like, well, that was a very happy moment for me. That's a special moment. The chip remains, though. It's not going anywhere.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

3772.122

Yeah, I've loved it and appreciate all the research that you've done and all the crazy lines of questioning. So thank you, Harry. I appreciate a lot.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

384.724

And then we'd all not be paying attention in public school playing StarCraft. So there was a large enough contingent of kids that were also not athletes. Before, when we were chatting, you said there are three archetypes.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

404.376

I'm happy to. I always joke around and say that you can bucket great founders into three backgrounds. I think probably the most common is that you had kind of a messed up childhood. The second most common would be you're gay. And the third most common would be you were adopted. look at a list of the all-time greats.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

424.209

Elon Musk kind of messed up childhood, Jeff Bezos, Steve Jobs adopted, Peter Thiel, Sam Altman, publicly gay. And I think that all of these early life experiences end up giving you some desire, some deeper passion to go out and prove yourself.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

461.186

What does your brother do now? He works for me upstairs. That's what I'm talking about. There we go. Did you feel like a disappointment? I think the answer is yes, I did. I felt like actually physically unable to do the things that I was wanted to do. Or I thought that I was good at things that weren't valued or weren't as important. All of my sisters are amazing athletes.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

482.702

They're all like, you know, six feet tall and they're incredible athletes. And I was just not. And so it's kind of like the ugly duckling in many ways. Yeah.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

501.838

There's completely separate stories there, but I think... How do you cold-cool NASA? This is actually a very good story. I wanted to be an astronaut. That was my number one goal, and I was hell-bent on that. And so by the time I was, I think, around 15 years old, I was going to high school in New York City, an all-scholarship school where the alumni paid for everything.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

522.543

I was kind of tracking academically really strong, and I wanted a NASA internship. And they were offering them to college undergrads or graduate students. And so obviously, I applied and got rejected five times. And then there was a snow day in February where my school was closed. I commuted into the city.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

539.56

I actually showed up in front of their New York City office, the NASA Goddard Institute for Space Studies. And I demanded that they let me in. And the front door security guard was like, you know, kid, get the heck out. Like, what are you doing? You don't have an appointment. Like, you know. I printed my resume out on the nicest paper. I'm wearing a suit. You've got to let me up.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

555.941

And he kicked me to the curb. And so I actually sat outside. It's like 110th Street, Manhattan. And it was snowing. It was like so, so, so cold. And I didn't know what to do. I started crying. And I actually called my mother because I was like, well, I'm going to come home. And she's a salesperson. She works in medical sales. She picked up the phone and said, listen, no, you're not going anywhere.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

577.463

You sit your ass down and you call every single number that you can get into the building. And so I sat on the curb and I cold called every number on Google from my old phone. And finally, someone picked up. I was one of the only people in the office that day. And they came down, met me in the lobby, and I basically pitched them on myself for two hours. Gave me an interview.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

598.556

I interviewed, botched the interview because I didn't know anything about linear algebra. I didn't know anything about physics. But I memorized all of the titles of the posters on this professor's wall. Came back the next day, so showed up again cold, and told them basically everything that I could possibly know about his specific research.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

616.052

And he was impressed enough to let me work for him for free. And then they paid me the next year. And then I published internationally recognized research the next year. And by that time, I think that was impressive enough to let Stanford let me in, which was a life-changing moment.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

649.953

I think I have an unhealthy obsession with driving really hard. Yeah, I think you just can never give up. Like, I just don't think that's an option. You can look at every company ever and some get to a hundred million dollars in revenue in whatever, like some span of time, which they probably, their marketing team has hacked. And some, you know, end up taking really, really long periods of time.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

668.865

The only thing that actually changes is the rate at which you get there. And so sometimes things go in your favor. Sometimes they don't. But if you're so persistent that you just continue, like you can, you can bring a lemonade stand to a hundred million dollars in ARR. Like there's nothing that's actually stopped. You can brute force your way as a founder. You screw product market.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

684.553

You can literally brute force anything in the world. You just have to have that ship. You have to continue to just pound away at whatever is in your way.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

702.192

On to the next one, you know, it's like okay, you know that's done and like the next day I was like, okay Well, how do I become the youngest PhD student in my school's history is like he has not even a moment I I think you know, I was excited for a moment, but you know, it faded very very quick I spoke to Corey before the show someone who's known you since you were 18 Probably even earlier take me to the founding of heavier than we're at Stanford.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

730.525

I'm one of the youngest PhD students in the history of my school, and I actually believe that I was working on, you know, at the time, one of the areas of research that was most interesting to me was meta-learning, this idea of teaching machines to learn to learn. And June of 2020, Sam Altman, OpenAI came out with GPT-3.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

747.653

And if you remember the title of that paper, it was large language models are multitask or meta learners. And I'm sitting in my lab one day and playing around with this new technology. And I'm like, wow, they just stole the most important thing I could work out right under from my hands. And I said, well, if I can't build the most important technology, how can I build the most important product?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

768.522

And I think those are two very separate things. Obviously, at the time, GPT-3 was not a product. And I don't even think chat GPT is a really good product. It's like a calculator. It's got the technology in there encapsulated in very simple form. But it's not a product that, like in Excel, that lets you just build whatever you'd like with it. That's very human-versed.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

785.018

And Stanford always pounds into your head the idea, hey, you've got to start a company where there's a lot of pain. And I had a lot of my students or a lot of my friends would go into investment banking or private equity if they were really lucky. And they would come back and basically be the least happy versions of themselves. They've lost 50, they just hated their lives.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

804.082

It seemed like there was more pain in financial services around processing unstructured data than anything I'd ever seen. And it's like, well, there's a great company to be had here. Let's give it a shot.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

849.11

So I was on a PhD salary. You're making, what, $38,000 a year. I think $42,000 at the time if you had the Stanford Graduate Fellowship, which I had. And I said I was going to go on leave. And I actually originally went on leave and told my advisor, I'll be back in a year. It's coronavirus. Just give me some time. And I didn't have anywhere to go. There was a logical next step.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

871.159

And I wanted to work on this company. So I asked my friends who were renting out a house in East Palo Alto to let me rent a room, the cheapest room they could possibly find. and they were all fully booked and it was like, I think over $1,000 of rent.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

883.628

And they said, I think it was actually, you know, 500 or $600, not $300 to give my my broke self some credit here for not being able to afford the rent. But they said you could rent out the master bedroom closet. And so I bought

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

894.861

brought in like a mattress from the dorms and i had a folding table from home depot nearby and i would basically rotate whether the mattress was on the floor or the folding tables on the floor and that was i just sat there and worked all day 16 18 hours a day go to sleep wake up do it again no weekends you know it's kind of like i turned into almost a monk where i was just obsessively building happy i was training models at the time i should wake up in the middle of night check on them you know continue to use my gpu because i didn't want to spend any money

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

946.897

Yeah. Ultimately, I probably went too hard. Like hindsight's 20-20. I think I definitely left nothing on the table to a point where it was detrimental to my health. But at the same time, I think that was like a crucible where it helped form me. It's very hard to be a founder. And those are the moments where you're just like, you're eating microwave meals every single day.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

966.332

And you're just like losing weight and you're trying to will something into existence. I actually was trying to pitch one of my former bosses at a professional services firm. And he looked at me on the Zoom call, and he almost cried. And he was like, just come work here. What are you doing to yourself? Just don't. Come back. We'll give you a proper salary. You don't have to do this.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

986.028

There's so many low points like that. And I think I just kept on chewing through it. And yeah, raising money in the closet. I actually got on with, we raised a pre-seed from Peter Thiel and Floodgate, and then our seed from Mike Volpe at Index. And Mike was like, Hey, we're going to do a partner call just as a formality with a few partners, just to clear it up. This is Volpe. Yeah.