Menu
Sign In Pricing Add Podcast
Podcast Image

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

Wed, 22 Jan 2025

Description

George Sivulka is the founder and CEO of Hebbia, is one of the fastest-growing gen AI companies and they recently raised a $130M series B. Investors include the company include hailed names such as a16z, Peter Thiel, Index, GV and others.  In Today’s Episode with George Sivulka We Discuss: 04:47 Three Traits The Best Founders All Share? 08:11 How Cold Calling NASA Changed My Life 12:01 From Stealing Food From Stanford to Pitching Peter Thiel 17:22 Lessons working with Peter Thiel 26:39 The Future of AI and Business Applications 33:03 The Future of Employment with AI 33:45 Debunking the Myths of AI Job Displacement 35:09 The Future of Models: Many specialised or few generalised? 35:56 Scaling at Inference: A New Frontier 38:10 The Impact of Scaling Laws on Foundation Models 40:40 The Future of AI and Enterprise Value 43:43 The Geopolitical Influence on AI 45:03 The Commoditization of AI Models 47:47 Why Foundation Models Will Not Follow the Same Path of Cloud 52:53 Why All Companies, Both AI and Non-AI Are Undervalued  

Audio
Transcription

0.069 - 22.762 George Sivulka

You can bucket great founders into three backgrounds. I think probably the most common is that you had kind of a messed up childhood. The second most common would be you're gay. And the third most common would be you were adopted. Look at like a list of all time greats. Elon Musk kind of messed up childhood, Jeff Bezos, Steve Jobs adopted, Peter Thiel, Sam Altman, you know, like publicly gay.

0
💬 0

23.002 - 30.588 George Sivulka

And I think that all of these early life experiences end up giving you some desire, some deeper passion to go out and prove yourself.

0
💬 0

30.984 - 55.196 Harry Stebbings

This is 20VC with me, Harry Stebbings, and today we have one of the most wild stories in AI, Hebbia. Three years ago, George Sivulka couldn't make his rent of $300 a month for a mattress on the floor. He snuck into Stanford dining room halls for meals after dropping out. He raised his first two rounds of financing with clothes hanging behind him on Zoom.

0
💬 0

55.717 - 79.762 Harry Stebbings

Most recently, the company raised a whopping $130 million and has investors including Peter Thiel, Index, GV, and Andreessen. This is one of the most remarkable stories of the last few years. But before we dive in today, here are two fun facts about our newest brand sponsor, Kajabi. First, their customers just crossed a collective $8 billion in total revenue. Wow.

0
💬 0

80.263 - 101.061 Harry Stebbings

Second, Kajabi's users keep 100% of their earnings, with the average Kajabi creator bringing in over $30,000 per year. In case you didn't know, Kajabi is the leading creator commerce platform with an all-in-one suite of tools including websites, email marketing, digital products, payment processing, and analytics for as low as $69 per month.

0
💬 0

101.182 - 125.987 Harry Stebbings

Whether you are looking to build a private community, write a paid newsletter, or launch a course, Kajabi is the only platform that will enable you to build and grow your online business without taking a cut of your revenue. 20 VC listeners can try Kajabi for free for 30 days by going to Kajabi.com forward slash 20VC. That's Kajabi.com K-A-J-A-B-I.com forward slash 20VC.

0
💬 0

126.207 - 140.562 Harry Stebbings

And after building your online empire with Kajabi, it's time to scale your global team with remote seamless hiring solutions. So every business is a global business in 2025. But how do you do payroll for your global business and team and comply with international labor laws?

0
💬 0

140.682 - 162.699 Harry Stebbings

Well, Remote handles payroll, benefits, taxes, stock options, and compliance to help companies of all sizes pay and manage full-time and contract workers all over the world. Remote's global employment solutions keep your team, your finances, and your intellectual property secure, Remote never charges hidden fees, just best-in-class global employment solutions for a low flat rate.

0
💬 0

162.859 - 186.113 Harry Stebbings

The world's top remote companies love Remote. GitLab, the world's largest all-remote organization, trusts Remote to run their global team. Remote is funded by Index Ventures, Sequoia Capital, and the host of the greatest podcast ever, Harry Stebbings and 20VC. Ready to learn more? Head over to remote.com forward slash 20VC, that's 20VC, and begin hiring within minutes.

0
💬 0

186.273 - 207.46 Harry Stebbings

Enjoy 10% off your first three months by using the promo code 20VC at checkout. Now that your team is up and running worldwide, make sure your finances work just as hard with Brex, the ultimate financial stack for startups. Let's be honest, building something from the ground up is hard enough without dealing with clunky, outdated banks that pile on fees and leave your cash idle.

0
💬 0

207.6 - 227.687 Harry Stebbings

Brex was designed with founders in mind to make every dollar go further so you can focus on building. And here's what really stands out to me. Brex combines the best of checking, treasury, and FDIC insurance in one powerhouse account. You can send and receive money globally at lightning speed, earn yield from day one, and still access your funds whenever you need.

0
💬 0

227.867 - 245.697 Harry Stebbings

Plus, with 20x the standard protection through program banks, your cash is not just working harder, it's working safer too. It's no surprise that one in three venture-backed startups in the US, with companies like Anthropic, Coinbase and Robinhood, I mean, my God, these companies are incredible. Trust Brex to help them grow.

0
💬 0

245.837 - 264.769 Harry Stebbings

If you want to join the smartest startups on the planet, head over to brex.com forward slash startups and see what they can do for you. You have now arrived at your destination. George, I am so excited for this, dude. I've been really looking forward to this one. I spoke to Kevin Hart, Sangeen, Corey. I found out all the shit there is to know. So thank you for joining us.

0
💬 0

265.109 - 270.134 George Sivulka

And I mean, it sounds like you did a lot of research. So thank you for diving deep and really excited to meet you as well.

0
💬 0

270.374 - 286.188 Harry Stebbings

As a venture capitalist, it's amazing the amount of free time you have. It's going to be a fun show. Talk to me about your childhood. I spoke to Sangin and he was like, this was a really interesting part of me getting to know George. So talk to me about your childhood. And I'm leaving that deliberately open for you.

0
💬 0

286.568 - 306.569 George Sivulka

It is fair. And I think the first time I met with Sangin, who's one of our investors at the Series B, it was like a 30-minute lunch that turned into almost two hours of us talking in depth about the dynamics that I think made me have a chip on my shoulder. But In short, I was born in Staten Island, New York City, which, you know, you already have a chip on your shoulder from that.

0
💬 0

307.209 - 327.618 George Sivulka

Grew up kind of around New York City in New Jersey primarily, which a second ship. But my mom is probably like a mafia child born and raised Staten Island. And my dad is an immigrant from Slovakia who grew up under the Iron Curtain and then immigrated, really escaped to the United States. They both of them actually fully intended to be professional athletes.

0
💬 0

328.138 - 344.897 George Sivulka

They had four children, of which only one was a boy. And so, you know, you can imagine their dismay when I was, you know, chasing butterflies on the soccer pitch or like falling on my head many times, which I have plenty of stories of me literally like falling over while trying to dribble a basketball ball.

0
💬 0

345.097 - 361.066 George Sivulka

And I think, you know, my whole childhood, I was really just a math kid, like not very out there, wasn't really talkative, only really good at math. And my parents barely even knew what Stanford was. So growing up, you know, you kind of have this whole misalignment of of who I was and who I wanted to be with who they wanted me to be.

0
💬 0

361.486 - 384.604 George Sivulka

That gave me this drive and desire and passion to go out and prove myself in a way that was really tangible, maybe not only to them, but like hopefully to my own kids one day. Did you have friends? I had a lot of friends who were incredibly nerdy. So we went to a public school. I was the type of kid that would hack the school tablets to put StarCraft on everyone's computer.

0
💬 0

384.724 - 395.97 George Sivulka

And then we'd all not be paying attention in public school playing StarCraft. So there was a large enough contingent of kids that were also not athletes. Before, when we were chatting, you said there are three archetypes.

0
💬 0

396.15 - 403.855 Harry Stebbings

I don't know if you're willing to go into it. Yeah. But of successful founders that you found as a trend. Can you talk to me about the different profiles?

0
💬 0

404.376 - 423.789 George Sivulka

I'm happy to. I always joke around and say that you can bucket great founders into three backgrounds. I think probably the most common is that you had kind of a messed up childhood. The second most common would be you're gay. And the third most common would be you were adopted. look at a list of the all-time greats.

0
💬 0

424.209 - 439.698 George Sivulka

Elon Musk kind of messed up childhood, Jeff Bezos, Steve Jobs adopted, Peter Thiel, Sam Altman, publicly gay. And I think that all of these early life experiences end up giving you some desire, some deeper passion to go out and prove yourself.

0
💬 0

440.878 - 457.285 Harry Stebbings

I actually very much agree with you. I always very much felt like a disappointment. My brother was always No, I'm being serious. My brother was always incredibly talented and good looking and tall and smart. And I was kind of just pretty average and I was fat. And my dad didn't really hang out with me. He hung out with my brother. And so I always just felt like a disappointment.

0
💬 0

458.205 - 459.546 Harry Stebbings

What an mistake that was, Papa.

0
💬 0

461.186 - 482.682 George Sivulka

What does your brother do now? He works for me upstairs. That's what I'm talking about. There we go. Did you feel like a disappointment? I think the answer is yes, I did. I felt like actually physically unable to do the things that I was wanted to do. Or I thought that I was good at things that weren't valued or weren't as important. All of my sisters are amazing athletes.

0
💬 0

482.702 - 490.829 George Sivulka

They're all like, you know, six feet tall and they're incredible athletes. And I was just not. And so it's kind of like the ugly duckling in many ways. Yeah.

0
💬 0

491.109 - 501.497 Harry Stebbings

I heard that you built lasers, you cold-cooled NASA. Can you talk to me about these kind of very cool early influences in your life and how it shaped you?

0
💬 0

501.838 - 522.503 George Sivulka

There's completely separate stories there, but I think... How do you cold-cool NASA? This is actually a very good story. I wanted to be an astronaut. That was my number one goal, and I was hell-bent on that. And so by the time I was, I think, around 15 years old, I was going to high school in New York City, an all-scholarship school where the alumni paid for everything.

0
💬 0

522.543 - 539.54 George Sivulka

I was kind of tracking academically really strong, and I wanted a NASA internship. And they were offering them to college undergrads or graduate students. And so obviously, I applied and got rejected five times. And then there was a snow day in February where my school was closed. I commuted into the city.

0
💬 0

539.56 - 555.381 George Sivulka

I actually showed up in front of their New York City office, the NASA Goddard Institute for Space Studies. And I demanded that they let me in. And the front door security guard was like, you know, kid, get the heck out. Like, what are you doing? You don't have an appointment. Like, you know. I printed my resume out on the nicest paper. I'm wearing a suit. You've got to let me up.

0
💬 0

555.941 - 577.042 George Sivulka

And he kicked me to the curb. And so I actually sat outside. It's like 110th Street, Manhattan. And it was snowing. It was like so, so, so cold. And I didn't know what to do. I started crying. And I actually called my mother because I was like, well, I'm going to come home. And she's a salesperson. She works in medical sales. She picked up the phone and said, listen, no, you're not going anywhere.

0
💬 0

577.463 - 598.096 George Sivulka

You sit your ass down and you call every single number that you can get into the building. And so I sat on the curb and I cold called every number on Google from my old phone. And finally, someone picked up. I was one of the only people in the office that day. And they came down, met me in the lobby, and I basically pitched them on myself for two hours. Gave me an interview.

0
💬 0

598.556 - 616.032 George Sivulka

I interviewed, botched the interview because I didn't know anything about linear algebra. I didn't know anything about physics. But I memorized all of the titles of the posters on this professor's wall. Came back the next day, so showed up again cold, and told them basically everything that I could possibly know about his specific research.

0
💬 0

616.052 - 629.659 George Sivulka

And he was impressed enough to let me work for him for free. And then they paid me the next year. And then I published internationally recognized research the next year. And by that time, I think that was impressive enough to let Stanford let me in, which was a life-changing moment.

0
💬 0

629.959 - 649.352 Harry Stebbings

That is incredible. That is also an incredibly heart-wrenching moment thinking of a little boy on the street crying. The advice of when to give up. Versus when to persist and fucking relentless. Me and you are both young. We've been taught you win by persistence and going for it. When is that true and when is it not?

0
💬 0

649.953 - 668.505 George Sivulka

I think I have an unhealthy obsession with driving really hard. Yeah, I think you just can never give up. Like, I just don't think that's an option. You can look at every company ever and some get to a hundred million dollars in revenue in whatever, like some span of time, which they probably, their marketing team has hacked. And some, you know, end up taking really, really long periods of time.

0
💬 0

668.865 - 684.533 George Sivulka

The only thing that actually changes is the rate at which you get there. And so sometimes things go in your favor. Sometimes they don't. But if you're so persistent that you just continue, like you can, you can bring a lemonade stand to a hundred million dollars in ARR. Like there's nothing that's actually stopped. You can brute force your way as a founder. You screw product market.

0
💬 0

684.553 - 693.742 George Sivulka

You can literally brute force anything in the world. You just have to have that ship. You have to continue to just pound away at whatever is in your way.

0
💬 0

693.963 - 701.171 Harry Stebbings

Stanford was a big one for you, I imagine. It was a really big personal validation to get in, correct? Yes. Yes. How did it feel when you got in?

0
💬 0

702.192 - 724.262 George Sivulka

On to the next one, you know, it's like okay, you know that's done and like the next day I was like, okay Well, how do I become the youngest PhD student in my school's history is like he has not even a moment I I think you know, I was excited for a moment, but you know, it faded very very quick I spoke to Corey before the show someone who's known you since you were 18 Probably even earlier take me to the founding of heavier than we're at Stanford.

0
💬 0

724.382 - 730.184 Harry Stebbings

We're doing incredibly well We are the wonder child How does Hebbier come to be in that situation?

0
💬 0

730.525 - 747.273 George Sivulka

I'm one of the youngest PhD students in the history of my school, and I actually believe that I was working on, you know, at the time, one of the areas of research that was most interesting to me was meta-learning, this idea of teaching machines to learn to learn. And June of 2020, Sam Altman, OpenAI came out with GPT-3.

0
💬 0

747.653 - 768.022 George Sivulka

And if you remember the title of that paper, it was large language models are multitask or meta learners. And I'm sitting in my lab one day and playing around with this new technology. And I'm like, wow, they just stole the most important thing I could work out right under from my hands. And I said, well, if I can't build the most important technology, how can I build the most important product?

0
💬 0

768.522 - 784.238 George Sivulka

And I think those are two very separate things. Obviously, at the time, GPT-3 was not a product. And I don't even think chat GPT is a really good product. It's like a calculator. It's got the technology in there encapsulated in very simple form. But it's not a product that, like in Excel, that lets you just build whatever you'd like with it. That's very human-versed.

0
💬 0

785.018 - 803.582 George Sivulka

And Stanford always pounds into your head the idea, hey, you've got to start a company where there's a lot of pain. And I had a lot of my students or a lot of my friends would go into investment banking or private equity if they were really lucky. And they would come back and basically be the least happy versions of themselves. They've lost 50, they just hated their lives.

0
💬 0

804.082 - 813.224 George Sivulka

It seemed like there was more pain in financial services around processing unstructured data than anything I'd ever seen. And it's like, well, there's a great company to be had here. Let's give it a shot.

0
💬 0

813.544 - 829.6 Harry Stebbings

So we're sitting in that lab. We're like, hey, there's a great company to be had here. Let's give it a shot. What now? Because I heard, I mean, and I saw pictures of this wonderful bedroom. So this was Four Seasons Finest. Unable to make, right? You made me feel like such a diva when I saw that bedroom.

0
💬 0

830.121 - 838.888 Harry Stebbings

But unable to make $300 rent, sneaking into Stanford Dining Halls for meals when you weren't studying there. Yep. I have no comment.

0
💬 0

838.988 - 840.028 George Sivulka

Off the record.

0
💬 0

840.608 - 848.59 Harry Stebbings

Raised two rounds of financing with clothes hanging behind him on Zoom. Take me to the next step post that. I'm going to do this in the lab.

0
💬 0

849.11 - 870.959 George Sivulka

So I was on a PhD salary. You're making, what, $38,000 a year. I think $42,000 at the time if you had the Stanford Graduate Fellowship, which I had. And I said I was going to go on leave. And I actually originally went on leave and told my advisor, I'll be back in a year. It's coronavirus. Just give me some time. And I didn't have anywhere to go. There was a logical next step.

0
💬 0

871.159 - 883.548 George Sivulka

And I wanted to work on this company. So I asked my friends who were renting out a house in East Palo Alto to let me rent a room, the cheapest room they could possibly find. and they were all fully booked and it was like, I think over $1,000 of rent.

0
💬 0

883.628 - 894.341 George Sivulka

And they said, I think it was actually, you know, 500 or $600, not $300 to give my my broke self some credit here for not being able to afford the rent. But they said you could rent out the master bedroom closet. And so I bought

0
💬 0

894.861 - 921.23 George Sivulka

brought in like a mattress from the dorms and i had a folding table from home depot nearby and i would basically rotate whether the mattress was on the floor or the folding tables on the floor and that was i just sat there and worked all day 16 18 hours a day go to sleep wake up do it again no weekends you know it's kind of like i turned into almost a monk where i was just obsessively building happy i was training models at the time i should wake up in the middle of night check on them you know continue to use my gpu because i didn't want to spend any money

0
💬 0

921.63 - 946.617 Harry Stebbings

is there a period where more work is not effective like when i think about 16 to 18 hour days in that environment dude i'm masochistic to the extreme where it's unhealthy alcoholic bulimic tortured child i mean fuck i'm like lindsey lohan adventure um but but like when i think of even like me in that i would not function well there i need fresh air exercise i'd have to

0
💬 0

946.897 - 966.272 George Sivulka

Yeah. Ultimately, I probably went too hard. Like hindsight's 20-20. I think I definitely left nothing on the table to a point where it was detrimental to my health. But at the same time, I think that was like a crucible where it helped form me. It's very hard to be a founder. And those are the moments where you're just like, you're eating microwave meals every single day.

0
💬 0

966.332 - 985.668 George Sivulka

And you're just like losing weight and you're trying to will something into existence. I actually was trying to pitch one of my former bosses at a professional services firm. And he looked at me on the Zoom call, and he almost cried. And he was like, just come work here. What are you doing to yourself? Just don't. Come back. We'll give you a proper salary. You don't have to do this.

0
💬 0

986.028 - 1006.982 George Sivulka

There's so many low points like that. And I think I just kept on chewing through it. And yeah, raising money in the closet. I actually got on with, we raised a pre-seed from Peter Thiel and Floodgate, and then our seed from Mike Volpe at Index. And Mike was like, Hey, we're going to do a partner call just as a formality with a few partners, just to clear it up. This is Volpe. Yeah.

0
💬 0

1007.262 - 1015.005 George Sivulka

And so Volpe is like, there'll be a few partners on this call. What round is this for? This is for a seed. So there's a follow on to the pre-seed in like November of, I think, 2020.

0
💬 0

1015.885 - 1036.815 George Sivulka

And I get on the Zoom call and I've literally got clothes hanging behind me and they're like all of a sudden Mike shows up and then four other partners and then 80 partners and like the Zoom screen tessellates with, you know, hundreds of faces. And I'm like horrified at the fact. And Mike's like, look, he's living in a closet. And everyone's like, ah, great founder. And I was so embarrassed.

0
💬 0

1036.915 - 1038.235 George Sivulka

And then I pitched my company.

0
💬 0

1038.375 - 1048.138 Harry Stebbings

Honestly, hilarious. Yeah. So I just want to unpack that element there because I said, I can't remember who it was who told me I had to ask, but they said I had to ask about driving to Peter Thiel's house.

0
💬 0

1048.659 - 1066.325 George Sivulka

Well, so I was saying two months prior, again, I think it was at Stanford or just about to leave Stanford. And one of my friends had interned at Founders Fund. And he's like, hey, I hear you're raising financing. You should talk to Peter. And It's like, well, I'm not going to say no to that. And so he introduces me on an email thread with me and Peter.

0
💬 0

1066.365 - 1082.092 George Sivulka

And I'm like, hey, Peter would love to do a lunch or dinner. I'm not a morning person. So I was like, Peter would love to do a lunch or dinner anytime soon. And Peter was like, I can do a breakfast. I was like, I really want to do a lunch or dinner. You know, like, can we do a brunch? You know, he's like, I'm going to do a breakfast. And so I said, well, that's fine.

0
💬 0

1082.353 - 1102.399 George Sivulka

And he gave me a slot on a Saturday. And so got in my car. It was an old beat up 2006 Audi convertible that I had fixed up from Craigslist and bought for $4,000 at three in the morning and drank a bunch of coffee, like 18 cups of coffee, like a five hour energy, like all the disgusting stuff and drove from three to eight to his house to go and pitch this guy.

0
💬 0

1102.719 - 1115.246 George Sivulka

And I think he showed up 45 minutes to an hour late. He's like just waking up and I'm wired. I'm like sitting in my chair, you know, like ready to go. And it was supposed to be a 30 or 45 minute breakfast. I was like, it's kind of already shot.

0
💬 0

1115.607 - 1135.16 George Sivulka

But we ended up talking for, I think like four or five hours about not only the company and all of the flaws that I had in my business model, but then also math and deep esoteric philosophy and like just the world. And he said, you know, I'm not investing at the time because it was coronavirus and a variety of other factors, but I'd love to put in a check.

0
💬 0

1135.74 - 1154.568 George Sivulka

I got out of this conversation thinking I had just made a friend or was seen from someone who's incredibly, incredibly, incredibly bright. And I'm leaving his house and I felt like I was inducted into the Illuminati. I was like my whole body, drop top, the sun's shining. I was playing Kanye West. I drove out as my first offer from a venture investor. How much did he invest?

0
💬 0

1155.248 - 1159.269 George Sivulka

I think the total round was like a million dollars. So it's like nothing.

0
💬 0

1159.409 - 1159.589 Peter Thiel

Yeah.

0
💬 0

1159.789 - 1175.114 George Sivulka

But what do you think makes Peter so incredible? There's two things. He is incredibly ontologically smart. And so he can build this worldview or this perspective of the world where like he actually just like knows how to pattern match to a variety of other things.

0
💬 0

1175.574 - 1192.621 George Sivulka

But then he's also, I think, phenomenologically smart, which is the idea of like he understands processes and how humans behave really well. And so he's always thinking like, hey, you know, ex ante or like, you know, if I'm looking at something that's about to unfold, could I have predicted this ahead of time? And he always just asks himself that question.

0
💬 0

1192.661 - 1202.326 George Sivulka

So he's built up a really rich perspective of the fallacies that human society has, mimetic behavior that people kind of go out and copy each other with, etc.

0
💬 0

1203.306 - 1208.668 Harry Stebbings

So we then have money from Peter and we have the Peter Thiel stamp of approval. Yeah. Does that open every door in the valley?

0
💬 0

1209.088 - 1219.151 George Sivulka

I mean, I think we were in late discussions with a lot of investors and then everyone else was like, yeah, let's like, you know, let's pile on in here. It's, you know, it's some of the best money that you can get. And that was a game changer for us.

0
💬 0

1219.291 - 1221.272 Harry Stebbings

So then we closed with Maples and Floodgate.

0
💬 0

1221.512 - 1222.733 George Sivulka

Yeah, it was Anne at Floodgate.

0
💬 0

1222.773 - 1227.915 Harry Stebbings

Okay, Anne and Floodgate and Thiel. And then we get back to work. Mm-hmm. And we've got a million or so.

0
💬 0

1228.336 - 1246.014 George Sivulka

We've got a million. And then two months later, Mike actually hears about heavy from his daughter, who was a Stanford student. And I think I'd seen the product was friends. And and then Mike actually comes in. It's like, hey, this is completely different than Elastic or all these other search technologies that I've seen invested. Obviously, he's on the board of Elastic today.

0
💬 0

1246.054 - 1271.852 George Sivulka

So he's like, well, let's just go add some fuel to the fire. How much did he invest in? He, I think, invested like an additional $2 or $2.5 million at the time. So where did the $130 come from? Well, that was years later. This was years later? So this is all in 2020. We end up building a product studio, which is the first to productionize RAG, Retrieval Augmented Generation, also in 2020.

0
💬 0

1272.492 - 1292.471 George Sivulka

We build the first semantic search engine. We actually go out and start to- Can you just help us understand what is RAG? RAG is an acronym that stands for Retrieval Augmented Generation. If you look at large language models today, they're really good at maybe thinking if you give it the right context, but they hardly ever have the right context.

0
💬 0

1292.971 - 1313.288 George Sivulka

And so RAG was the first real attempt to give them the data to answer questions correctly. Okay. And so we are building on RAG to start. We were one of the first people to productionize the idea of putting a search engine behind an LLM. So you'd ask a question and then instead of it just replying from its memory, it would actually go and do a search and then reply with that context.

0
💬 0

1313.728 - 1321.134 George Sivulka

So in an enterprise where you have a lot of offline data, we were really the first people to hook up that offline data to large language models to answer that question.

0
💬 0

1321.394 - 1325.577 Harry Stebbings

So you're one of the first and we're seeing that now in action and it's working? Yeah.

0
💬 0

1325.777 - 1346.383 George Sivulka

That's a bit of a plot twist over here. I actually don't think RAG works at all. It's one of the most used AI architectures in the world, pioneered at Hebbia in a very meaningful way. I think every enterprise is experimenting with it, but it has a lot of different failures where a lot of the time, the questions that people ask these systems aren't ever explicitly in the data.

0
💬 0

1346.423 - 1364.677 George Sivulka

They're never explicitly stated. They're actually about the data. So for example, if you're asking an AI system, is this company a good investment? which is actually a very common thing that people ask Hebbia over marketing materials. Maybe it'll say in a pitch deck, yeah, this company is a great investment as something that the CEO says or like a recording, et cetera.

0
💬 0

1365.078 - 1385.033 George Sivulka

But what you actually want from that system isn't a search in the data, it's an answer about the data. Hey, what's the customer concentration? What's the strength of the management team? What are X, Y, or Z criteria that are fundamental to our specific investing process? And that's a process. That's not ever explicitly stated. Actually, the marketing materials are often like a load of crap.

0
💬 0

1385.193 - 1396.018 George Sivulka

You have to actually distill what's true out of them. That's what Hevia does. So it's not actually finding something that exists already. It's taking all the things that exist already and starting to answer questions about that information.

0
💬 0

1396.218 - 1407.466 Harry Stebbings

Take me to that transition then, because we were building on RAC and we're like, great, we're going to productionize this and then we move off. Yeah. And you realize that actually it's bullshit and it's not as good. Yes. Take me to that realization.

0
💬 0

1408.247 - 1427.942 George Sivulka

Yeah. So we actually deploy at some of the largest finance firms in the world. We ended up going from zero to a million dollars of revenue sometime in 2021 or 2022 and raise our series a also from from index from my index, which is 30 million bucks. And we start to see that all these customers, okay, now they know what ChatGPT is. They know what LLMs are.

0
💬 0

1428.062 - 1442.336 George Sivulka

Hebi has this really mature enterprise product in the market, and we're by far the first to actually get there. And we just looked at all the queries that people were asking. And the questions that people were asking weren't ever, okay, find me the quote or find me the command F questions.

0
💬 0

1442.736 - 1453.144 George Sivulka

They were actually more, okay, read all the documents and then tell me all the times they mentioned AI or what our exposure to Silicon Valley Bank is during the regional banking crisis.

0
💬 0

1453.624 - 1464.27 George Sivulka

And so all of these questions, it was actually almost 90% of the questions that people were asking these systems weren't answerable by search through the documents, but rather they had to be work done on top of the documents and then answered.

0
💬 0

1464.67 - 1474.256 Harry Stebbings

My question is like, what the fuck happens to the rest of the landscape if you're like, no, RAG is not actually the right approach and they're all loving RAG. Couldn't be hotter right now.

0
💬 0

1474.736 - 1475.937 George Sivulka

I don't think they're loving RAG.

0
💬 0

1476.437 - 1477.057 Harry Stebbings

You don't think they are?

0
💬 0

1477.078 - 1497.112 George Sivulka

I don't think they're loving Ragnar. What makes you say that? I think like 90% of enterprise AI right now is almost like this vapor where we swear it works. Like, look at this amazing demo where we ask, what does the CEO say about the investment? And the minute that they actually go to, you know, try to use it in a real world example, completely just fails.

0
💬 0

1497.792 - 1518.323 George Sivulka

And so I actually think that the majority of AI usage, a lot of these usage statistics are all kind of one of my favorite phrases. It's fugazi fugazi. And one of the things that Hebbia really tries to put forth in the market is to say, hey, change will take time. But we have a system that is actually starting to drive real measurable value over very specifically defined use cases.

0
💬 0

1518.803 - 1526.287 George Sivulka

And our tagline is always, hey, stop experimenting with AI, which everyone's experimenting. They're all really excited about it. Start driving value, like getting value out of it.

0
💬 0

1526.607 - 1529.309 Harry Stebbings

To what extent is this RPA versus Ajanti?

0
💬 0

1529.87 - 1553.27 George Sivulka

I actually am not a big believer in RPA. I think RPA is almost not an AI application in the new sense of AI. It's like AI in the old 10 years ago sense of AI, where RPA is effectively like very simple computation. But some of the things that people are asking Hebbia are over 800 page credit agreements or 230 page SIMs. Confidential information memorandums, this marketing material.

0
💬 0

1553.63 - 1570.111 George Sivulka

They're not actually asking for things like copying numbers. They're saying, hey, tell me what are inconsistencies in this document. Tell me where there's an event of default that we can trigger. There's almost this open-endedness or this new level of computation that people can do.

0
💬 0

1570.231 - 1586.3 Harry Stebbings

I think Daniel Dines, we had on the show, it comes out on Wednesday. He said it very well. He said, like, listen, RPA is low skilled, low level cognitive processes and agencies, high skilled, ambiguous decisions. Yes. I think that's a nice phrasing. I think it's incredibly clear. Yeah.

0
💬 0

1586.56 - 1598.927 George Sivulka

And I think that we very much are capturing the agent, the high level, ambiguous decision making and trying to trace it all the way down back to individual citations or individual characters that led the model to that decision.

0
💬 0

1599.187 - 1611.212 Harry Stebbings

I thought about actually Satya's statement the other day that he made, which is the notion that business apps that exist today will all just collapse into agents. Do you agree with that? And will apps be the predecessor to agents?

0
💬 0

1611.772 - 1631.486 George Sivulka

I actually don't agree with that at all. I think he's completely wrong. I think it depends on how you define business apps. But I actually think that if the new business apps are platforms, you'll actually start to see those platforms really take hold. Like Hebbia is a platform. It lets you build whatever agent that you'd like. And so here's a bit of a mindfuck.

0
💬 0

1631.566 - 1645.656 George Sivulka

When building Hebbia or when building all of these foundational primitives for how people use AI over the last four and a half years, Hebbia has always asked ourselves, what are the apps that AGI would want to use? Or what are the apps that agents would want to use themselves? I.e.

0
💬 0

1645.697 - 1664.945 George Sivulka

what are the tools, because these AI applications are really good at using tools, that we could build that would assist LLMs or these really smart foundation models, whatever they are in the future, to get to an answer more quickly. It's quite interesting, you know, Hebbia Matrix orchestrates lots of smaller LLM calls. It's actually scaling at inference, i.e.

0
💬 0

1665.005 - 1678.691 George Sivulka

it's running massive amounts of compute at the orchestration layer. And we think that, you know, an AGI system would prefer to use heavy a matrix to diligence a company or to look through thousands of documents versus to read them all by hand. And they're in a really long context window.

0
💬 0

1678.931 - 1688.315 Harry Stebbings

So is the future of business apps, not business apps, but business platforms? We've got platforms, agents or apps. Yeah. What is the future?

0
💬 0

1688.715 - 1704.24 George Sivulka

I ultimately think that it will be a mix of all three. History doesn't repeat itself, but it often rhymes. 60 years ago, or even longer, the foundational unit of compute, i.e. doing a calculation on a computer, was effectively introduced to the enterprise.

0
💬 0

1704.6 - 1718.145 George Sivulka

There were plenty of people that were tallying things or bookkeeping in actual books, and their jobs changed, and there were apps for bookkeeping, and then there were platforms like Excel that let people build better apps for bookkeeping, and then Excel was unraveled again into better apps for bookkeeping.

0
💬 0

1718.444 - 1733.879 George Sivulka

And I think that there's opportunity not only in verticals, but there's also opportunity in the entire industry in terms of building platforms, in terms of building cooperatives, in terms of even building new types of quote-unquote agent employees. And I think that that opportunity is the exact same size.

0
💬 0

1734.18 - 1749.818 George Sivulka

If there was $100 trillion of value that was created in the stock market from the introduction of the computer or the fundamental unit of compute. I actually think $100 trillion of value will be created in the next 60 years from the introduction of inference or of AI compute.

0
💬 0

1749.958 - 1756.968 Harry Stebbings

Will that be additional value? Or will that be value that denigrates from the existing value of alternatives? I believe it will be additional value.

0
💬 0

1757.228 - 1763.413 George Sivulka

And maybe I'm too techno-optimist, but I actually think the S&P 500 is completely- $100 trillion of additional.

0
💬 0

1763.433 - 1772.88 Harry Stebbings

I can't quite get my head around that. How does that even exist? Adding in that $100 trillion of value, is that just because we will see GDP and productivity grow so much that takes place?

0
💬 0

1773.3 - 1785.748 George Sivulka

I ultimately genuinely believe that more than 50% of the GDP will be contributed by what you can call agentic applications in the next few decades. Yeah. I actually think it'll happen faster than the next few decades. Do you?

0
💬 0

1785.908 - 1811.258 Harry Stebbings

Because again, Daniel on the show was like, put me up against Daniel. He's my neighbor, so he's literally next door. So we can arrange that. But he said that we consistently underestimate how long it takes for enterprises to adopt new technologies, to get comfortable with data security, to get comfortable with processes. Is that right? Or do you think actually we are past the tipping point?

0
💬 0

1811.718 - 1837.235 George Sivulka

It's a good point if you're cutting cost, which I think Daniel and UiPath are one of the best examples of using AI to make companies more efficient. If you look at finance and how fast Excel went to 90% market penetration in finance, 1985 to 1986, literally 18 months to 24 months, Excel took over all of finance. Everyone switched from using a calculator, the HP-12C, to using Excel.

0
💬 0

1837.595 - 1856.532 George Sivulka

And if you look at how fast finance actually ended up, you know, using credit card data to value public companies ahead of their earnings, that was, again, a two year period more recently. And so finance is the slowest moving, most lethargic, you know, leviath. It's the worst possible customer base to go after unless you're providing outsized alpha or real value.

0
💬 0

1856.872 - 1869.881 George Sivulka

In which case, the minute that there's something real, finance moves faster than any other industry. And so I'm actually making a bit of a bet by going into finance and starting to go out and try to get to my own. You know what I worry about? I worry that we lose the education process.

0
💬 0

1870.101 - 1889.834 Harry Stebbings

What I mean by that is a lot of like GPs or managing partners, or you name the title in a senior firm. They've been through the shit of analyzing companies, staying late, understanding what makes a great business, all of these things. And then we'll just say, well, don't worry about that shit. Happy, we'll do it. And so we have this no graduation pathway for the next generation.

0
💬 0

1890.154 - 1893.296 Harry Stebbings

And so we have decision makers who don't have that graduation.

0
💬 0

1893.536 - 1910.687 George Sivulka

Yeah, I'm less worried about that. I think ultimately one of the best things about having the years of experience is actually having the depth of knowledge about investing. So for example, if I'm a junior trying to price an asset, I haven't seen that many other companies that look like this company.

0
💬 0

1911.047 - 1924.656 George Sivulka

And so I might say, hey, I think it should be priced at X, Y, or Z. And then someone in the IC meeting will be like, hey, no, I've seen 20 other companies in my 40 years of career that look exactly like this. And they all went nowhere. And I'm leaning on my prior experience.

0
💬 0

1924.976 - 1949.67 George Sivulka

With Hebbia, now juniors who are really smart themselves can say, okay, you might have remembered 20 deals, but I'm looking through every deal in our company's history in a giant matrix that anyone has ever seen. that when a company is performing here, it's 90th percentile across all of this investing criteria, we should actually pay 90% premium to market.

0
💬 0

1949.97 - 1964.194 George Sivulka

And I'm actually using more deals than you've ever seen because I know your name is on this many IC memos. And that type of structured thinking or that type of additional information that you can now give juniors in their career, I actually think makes better investors. I don't think that that takes away.

0
💬 0

1964.214 - 1968.676 Harry Stebbings

Do you really think it will be a tool for usage, not a tool for replacement?

0
💬 0

1969.276 - 1972.657 George Sivulka

I genuinely believe it makes humans better. I genuinely believe.

0
💬 0

1972.717 - 1975.358 Harry Stebbings

In five years time, do you not think that is a different story?

0
💬 0

1975.798 - 1995.363 George Sivulka

I think that it will change the way that people do work, but I genuinely believe that it'll actually increase the AUM of the firms that use it. I think it will actually drive more employment. I think there will be some jobs that change. Hey, there's no more bookkeepers that do tabulations in spreadsheets on two sheets of paper. What changes most and what stays the same?

0
💬 0

1995.803 - 2016.019 George Sivulka

The cognitive tasks that are lower in cognition, like more back office, kind of middle office, maybe even some of the more junior front office tasks, I think will start to move into, okay, how can we manage AI juniors rather than actually do this ourselves by hand?

0
💬 0

2016.319 - 2025.206 George Sivulka

But I don't think that just as Excel didn't end up taking away jobs from people, it just changed people to having to learn Excel, the exact same thing will happen with AI.

0
💬 0

2025.626 - 2030.771 Harry Stebbings

So you don't think that we will see team sizes reduce as a result of agent integration into enterprise?

0
💬 0

2031.071 - 2045.825 George Sivulka

You know, there's, there's all these stories and you know, you have like Klarna that's positioning for investors that they're firing half their staff and no one really wants. And I think that's BS. I think it's BS. Yeah. There might be some reality to it, but I think that it's an amazing marketing story.

0
💬 0

2045.965 - 2064.716 George Sivulka

And so anytime that I ever hear something that's put out as a marketing story, I almost negate it in my head. to actually think about what the implications are. When you're saying something and screaming it from the rooftops, that almost always means that internally you're freaking out about something. I look at that really loud behavior and I think that behavior itself really negates the content.

0
💬 0

2064.976 - 2070.579 George Sivulka

That's maybe my positioning on this sort of stuff. How do you feel about competition? What are your lessons on competition?

0
💬 0

2070.599 - 2074.66 Harry Stebbings

There are several players now in the heavier slipstream. How do you feel about that?

0
💬 0

2075.02 - 2099.09 George Sivulka

I think that if $100 trillion of economic value will be created by AI and agentic applications, that there will be so much room and so much opportunity for a ton of different players. I don't think that when Excel came out and then Mark released Salesforce and then people created TurboTax, all these unravelings of Excel actually were produced later, that that made Excel any less valuable.

0
💬 0

2099.27 - 2118.349 George Sivulka

I actually think it made Excel more valuable. I view Hebia as this platform as something that will actually get better the more people get inspired by it and build increasingly verticalized applications. What models do you use? You sit on top of what? We are completely model agnostic. We use all of the major model providers, some of our own models.

0
💬 0

2118.709 - 2136.358 George Sivulka

But ultimately, the foundational difference that Hebia is capitalizing on right now is fundamentally new and very important difference, which is I actually think on the order of creating rag and creating agents and decomposition is this idea of us in the last year or so having pioneered scaling at inference. Talk to me about this.

0
💬 0

2136.9 - 2156.748 George Sivulka

Right now, you actually, so OpenAI is starting to do this with O1, where they'll have a model recursively think about a question over and over and over again before it produces an answer. And so instead of training a larger model, they're using effectively a similarly sized model and just telling you to run multiple cycles, i.e. compute more before answering.

0
💬 0

2157.148 - 2176.467 George Sivulka

Hebbia has actually pioneered something different where a year, almost 18 months ago, we said, hey, we can't wait for these models to catch up. What we'll do is infer simple, single question. Let's actually run hundreds or even thousands of submodels of the best models in the world to compute over every single document to answer the same question.

0
💬 0

2176.747 - 2197.458 George Sivulka

And so ultimately, if you can't train larger and larger models fast enough, you could take whatever state of the art or cutting edge and run it more times to get more compute, i.e. more computational power, better decision making for the same user right now. And so this is an idea that we pioneered. It doesn't matter if you're using Claude 3.5 or if you're using O1 itself, i.e.

0
💬 0

2197.479 - 2204.682 George Sivulka

scaling at inference at the orchestration layer with something that was scaled at inference with the training layer, but you get way better results. And it's a way to

0
💬 0

2205.923 - 2213.087 Harry Stebbings

Right now, what do you find provides the best results? We had Des train on from Intercom recently. He spoke about the movement away from OpenAI to Anthropic.

0
💬 0

2213.668 - 2234.76 George Sivulka

We've seen that for certain types of documents, like the dense legalese or more colloquial documents, Anthropic works better. But for other types of documents, like OWAN or OpenAI 4.0 works better. And it's always trade-offs between accuracy and speed and all kinds of things. Actually, a lot of the time when we're decomposing a task, we'll use mixes of OpenAI, Anthropic, even Gemini.

0
💬 0

2235.22 - 2250.204 Harry Stebbings

Do you think we live in a world moving forwards of many models that are specialized in different things? As you said, some do legal, some do whatever we want to talk about. And that's the world we live in. Or there's generalist monolith models, which really could have owned the whole stack.

0
💬 0

2250.666 - 2268.857 George Sivulka

This makes me think of the story of Bloomberg, which has the best financial services training set of all time. And they trained a GPT 3.5 class model. It was called a Bloomberg GPT. And they released an archive paper and everyone on LinkedIn was like, wow, Bloomberg is, you know, cutting edge and they're going to steal finance. Why did they not?

0
💬 0

2269.317 - 2290.232 George Sivulka

They did have all they've got the best data in finance. So then GPT-4 was released, I think, like a few weeks later. I don't know exactly the right timeline, but it just destroyed Bloomberg GPT at every single finance task. And so you saw the idea of post-training or kind of like this refined, verticalized model creation just always would lose to scaling loss.

0
💬 0

2290.612 - 2305.344 George Sivulka

And maybe we're at the end of scaling law as a training. But I actually think, you know, Hebbia and now OpenAI and a variety of other companies are starting to pioneer the idea of scaling laws and inference. And I actually think that it will make nothing that that other players can do to fine tune models will ever catch up.

0
💬 0

2305.665 - 2329.455 Harry Stebbings

I need to break that down. Yeah. So everyone's like, oh, are we at the end of scaling laws? Oh, yeah. Benioff and Daniel Dines are like, yes, we are. Yes, we are the upper end of LLM. Reid Hoffman is like, no, there's so much more room to run. Can you just break down for me the difference between scaling laws at inference and scaling laws at training?

0
💬 0

2330.365 - 2351.592 George Sivulka

Yeah, I think it's a bit of a marketing distinction. But ultimately, the idea is that the way that we got here over the last five, seven years of training models has been, let's build a bigger and bigger model, and let's give it more and more data, more and more clean data. And then maybe we'll do some RLHF or some reinforcement training to fine tune it after pre-training.

0
💬 0

2353.673 - 2361.102 George Sivulka

And that worked great to get us here. But we're running up against the amount of good data that exists in the world. We're running up against. Are we?

0
💬 0

2361.142 - 2372.596 Harry Stebbings

Because people push back on this and say there's so much data that we haven't used yet, whether it's video data that can't be translated, whether it's synthetic data like we are not at all exhausted in terms of data supply.

0
💬 0

2372.776 - 2391.022 George Sivulka

You know, I think that we're starting to run up against the constraints of it. That's a gut feel. I'm not, you know, I'm not looking at particularly in data collection myself, but I think we're starting to run up against the limits of really good data. What's then the problem? So ultimately, that might mean that. hey, we're training larger and larger models.

0
💬 0

2391.162 - 2396.666 George Sivulka

XAI, again, just created the largest GPU cluster of all time, and they're going to try to train larger and larger models.

0
💬 0

2397.007 - 2413.699 George Sivulka

But regardless of how the scaling laws for training larger models or parameter count and accuracy or performance carry out, I'm starting to believe that you could still get better compute not by building a larger engine, to use a metaphor, but by actually putting a bunch of smaller engines together.

0
💬 0

2414.199 - 2432.962 George Sivulka

Hebbia, by orchestrating large amounts of inference to answer one single question, ends up kind of building like a Tesla, where Tesla is made of a bunch of smaller engines or a bunch of smaller electromechanical motors that make a lot of torque and a really, really amazing larger engine. Does it not make it incredibly capital inefficient?

0
💬 0

2433.722 - 2458.112 George Sivulka

I think the one thing that people in my position will always tell you is that the cost of intelligence will go to zero. The cost of intelligence will go to zero. I think that since Hebbia started, the cost of inference over a fixed number of parameters has decreased by seven orders of magnitude in four years. And so I genuinely believe that scaling compute is like a no brainer.

0
💬 0

2458.432 - 2474.278 George Sivulka

And yes, we run more large language model calls than anyone might even say would ever be necessary. But we have the best accuracy in the business. We can answer much more complex problems. We're driving real value for enterprises. And I actually think that every single quarter, like our margin goes, we're not spending money fast enough.

0
💬 0

2474.798 - 2483.51 Harry Stebbings

You mentioned XSort AI's GPU cluster. Yes. What they've been able to do in such a short amount of time is miraculous. Yeah. What do you think that tells us about the layer itself?

0
💬 0

2484.171 - 2500.747 George Sivulka

Ultimately, the model layer, and I think this is not a hot take anymore. I've been saying it for a few years, but I think it will become commoditized. I think that a lot of value will accrue at the hardware layer. And we could talk about what that means for NVIDIA, especially as NVIDIA has a stranglehold on training, but not as much stranglehold on inference.

0
💬 0

2500.787 - 2519.518 George Sivulka

And so you might actually see other chip makers actually start to their chips start to be used in a more meaningful way because CUDA is what all ML scientists were trained on in their PhDs. But then inference doesn't matter kind of what you're using. And I think it will be the infrastructure layer and then actually the application or agent layer that will accrue the most value.

0
💬 0

2520.599 - 2532.406 Harry Stebbings

Why does it not follow the same vein as cloud? Where cloud is commoditized, but Azure, Google Cloud, AWS, I mean, completely commoditized, to be honest, cloud. But it's great business for them.

0
💬 0

2532.426 - 2549.718 George Sivulka

I think it might. There's probably fewer players and more entrenched players in cloud. And ultimately, I think those players honestly kind of have like an OPEC oligopoly where they can control pricing. I just think that ultimately cloud is actually more complex than training larger and larger models.

0
💬 0

2550.158 - 2562.483 Harry Stebbings

The cloud providers are basically using models as a loss leader happily to build stronger moats in their cloud businesses. And you see this with Anthropic and Amazon. You see this with Microsoft and OpenAI.

0
💬 0

2562.963 - 2579.658 George Sivulka

Absolutely. Whoever has the best models will continue to attract the right amount of investment. The different thing about clouds too, though, is that the cost of switching is much higher. So to refine my earlier point, I can switch models readily. I think there's even entire businesses now.

0
💬 0

2579.918 - 2602.597 George Sivulka

There will be an entire industry of being able to switch models from open AI to anthropic when open AI goes down. But to switch clouds is like for... any substantially sized startup, like a $10 million to $20 million investment just to switch. It's almost always never worth it. It's much, much, much stickier. Whereas here, it's a very simple API key. It's very simple to switch models.

0
💬 0

2603.057 - 2604.758 George Sivulka

And so I think that that's also a differentiator.

0
💬 0

2605.138 - 2610.622 Harry Stebbings

OpenAI at $160, Anthropic at $40, or XAI at $50. Which one do you buy?

0
💬 0

2610.942 - 2628.633 George Sivulka

I think XAI is the most undervalued company and a really spicy take. I actually think XAI might overtake OpenAI and Anthropic in value over the next 12 to 24 months, which is crazy, but I think they're all undervalued. What leads your thinking? I think Elon is very well positioned in the geopolitical sense.

0
💬 0

2628.753 - 2642.401 George Sivulka

I think Elon can run a more efficient business and not have to deal with as much administrative bloat or as much friction from employees. How important is geopolitics in winning this game? I think geopolitics is actually very important.

0
💬 0

2642.421 - 2656.625 George Sivulka

I think that governments will be some of the largest users of AI, especially with some of the recent things that the new administration in the United States has been talking about with increasing government efficiency. I think that ultimately energy is a very big bottleneck.

0
💬 0

2657.185 - 2676.879 George Sivulka

It's a very common thing in Silicon Valley to talk about, hey, we need nuclear reactors to flatten the duck curve so that we can continue to drive to larger and larger data centers, et cetera, et cetera, et cetera. And those are ultimately geopolitical resources. And so I think all of these things end up being very important. And then Elon's just operationally so talented, right?

0
💬 0

2676.899 - 2686.126 George Sivulka

So I think that ultimately, if this becomes commoditized and whoever can really operationalize model creation and serving models the fastest, I think it might start to work.

0
💬 0

2686.386 - 2688.547 Harry Stebbings

So you think XAI and you would invest in them?

0
💬 0

2689.007 - 2710.236 George Sivulka

I would, but ultimately I think all of them are undervalued. I genuinely believe all AI companies and the S&P 500 are all undervalued, which is a very hot take. If we're about to create $100 trillion of value, I think this is a real tangible technological shift. It's a massive unlock on the order of what computing did for the entire economy over the last 60 to 80 years.

0
💬 0

2710.656 - 2715.538 George Sivulka

I think this will do for the next 60 to 80 years. I think all of these companies are massively undervalued, including the non-AI companies are

0
💬 0

2715.658 - 2743.573 George Sivulka

unpack the last bit including the non-ai companies i genuinely believe that computers made legacy businesses better if you use them correctly uh and so it's a massive disrupting force but if you can ride the wave of change a ai agents and this new fundamental paradigm that is a massive unlock for you do you think there is a slight difference everyone talks about kind of different uh technological transitions when you look at you know the agricultural transition or the kind of agricultural dependency on human labor and movement to machinery

0
💬 0

2744.233 - 2766.774 Harry Stebbings

computers in workforces these were at least 10 year transitionary periods at least this is like hey we use ai tools now because we just bought them today yep the transition period is is instant yes much faster does that not change the enterprise value accumulation and whether they're good or bad for businesses because it's like instantly your business will die if you don't have it or not

0
💬 0

2767.222 - 2787.574 George Sivulka

Yeah, I actually always liken technological revolutions to what Hedby is doing right now, where people invented or we discovered the technology of fire and then someone invented the torch. I don't know how many years later we invented the engine and someone invented the car or the wheel and then the chariot. And so this idea of encapsulating and building a useful product.

0
💬 0

2787.974 - 2801.821 George Sivulka

on top of a technology change is actually the thing that takes more time. And I think that Hebbia has built, if Excel was that product for compute, I actually think Hebbia has built that product for AI. And I think that when you have a good product, that transition will be very, very, very quick.

0
💬 0

2802.141 - 2822.09 George Sivulka

Right now we have these chatbots or these surface level search engines that give you facetious surface level value. Yeah, it'll help your kids cheat on their homework, but to drive to whether or not something's a good investment is a much, much more rich problem. Is chat the right interface for many of these applications? I ultimately do not think so. I think that chat was always a useful feature.

0
💬 0

2822.81 - 2845.096 George Sivulka

It's a useful interface. It's like a single cell in Excel. It's like asking if the TI-84 was the right interface for computers or the terminal was the right interface for computers. We have not even started to explore the opportunities for interfaces. What do you think they are? I think that Hebbia is the Bell Labs, and I conceive of ourselves as the Bell Labs of defining AI interfaces.

0
💬 0

2845.517 - 2855.699 George Sivulka

I think that RAG was one of them, i.e. this idea you could find things in the data really fast. Decomposition in agents are another. This idea of scaling at inference with our matrix product is another.

0
💬 0

2855.999 - 2865.482 George Sivulka

You can look at a lot of the other things where agents are controlling four screens at once, and you're actually looking at someone use a computer, or computer use where AI models are moving cursors are others.

0
💬 0

2866.002 - 2870.046 Harry Stebbings

Almost all of them have actually- Ultimately, if agents are efficient, does interface not become irrelevant?

0
💬 0

2870.486 - 2887.441 George Sivulka

I actually think that the better agents are, the more work that they do, the more important it will be that they are easily understood by humans. The idea would be, okay, let's say we have a bunch of employees, 10,000 employees or 10,000 AI agents drop at a company. They're all experts. at doing something.

0
💬 0

2887.741 - 2908.043 George Sivulka

That ends up not becoming a problem of giving them the right tasks, but actually it becomes a management problem, right? There's this whole infrastructure orchestration layer, the thing I always come back to of making these things work together. And that's actually going to be a challenge. And that's going to require a very human first, ultimately a product. And that's what we're trying to build.

0
💬 0

2908.283 - 2926.469 George Sivulka

Do you think Elon will be successful with Doge? I think it will be his greatest challenge. There's a lot of self-protecting mechanisms in the largest organization in the world, which is kind of a US government by spend. It's just this massive, unruly organization. It's not going to be as simple as Twitter.

0
💬 0

2926.709 - 2928.21 Harry Stebbings

Are you more excited in the post-Trump?

0
💬 0

2928.63 - 2943.639 George Sivulka

I think the thing that I care most about in the world is that we as an industry have very clear guardrails that we can follow and understand to build the best possible tools, to get our tools out to the economy, to make sure that everyone transitions in the best possible way.

0
💬 0

2943.659 - 2956.127 Harry Stebbings

So I'm ultimately regardless of- But does your business not thrive on a better financial system? And we're seeing now a financial system in the US from afar that would seem to be thriving. Objectively, it would appear that Trump is good for business.

0
💬 0

2957.08 - 2963.066 George Sivulka

I won't make a comment here. I think that there's a lot. You know what's funny?

0
💬 0

2963.306 - 2987.907 Harry Stebbings

It went very viral before the election because they said it's so interesting. There's 99% of CEOs come on the show and they either shut up or they say they vote for Kamala. And then it ends. And they're like, by the way, I'm so Trump. I am so Trump. But it's fascinating. Yeah, for sure. I totally understand they're not answering. You are not alone. It's okay.

0
💬 0

2988.287 - 3005.437 Harry Stebbings

But the one question I want to ask, you mentioned NVIDIA before. Sure. That's a really big question around their ability to sustain that monopoly. You've seen Google, you've seen Matter, you've seen Amazon all want to move into the chip layer. How do you think about NVIDIA's ability to sustain their pretty unwavering monopoly so far?

0
💬 0

3005.757 - 3022.961 George Sivulka

So NVIDIA has, you know, I think that the best moats aren't technological moats. They're not data moats. They're actually people moats. People and networks have the most friction to change. One of the things that NVIDIA does best is the fact that they made this early bet on machine learning.

0
💬 0

3023.282 - 3032.644 George Sivulka

They created CUDA, which is the way that, as I mentioned before, almost everyone learns how to train models. Like they learn how to, you know, how to interface with NVIDIA chips for training.

0
💬 0

3033.007 - 3047.538 George Sivulka

As you're starting to see, maybe that prediction that I made earlier, the shift away from training to inference as a fundamental, almost macro shift in how people deploy AI, I actually think that will destabilize slightly the dominance of NVIDIA chips.

0
💬 0

3047.558 - 3066.471 George Sivulka

You can start to actually use AMD chips or even custom architectures, which all the major model providers are also currently exploring to do inference So you have your academics and your researchers, you know, training large models on NVIDIA chips. But the minute they deploy them, they can deploy them on cheaper infrastructure. And that actually I think it will be a big change.

0
💬 0

3066.491 - 3075.897 George Sivulka

So I'm actually still bullish on NVIDIA, but I'm even more bullish on other chip makers and custom ASICs to do inference because I think there will be a larger shift to inference moving forward.

0
💬 0

3076.257 - 3084.783 Harry Stebbings

Is that other chip maker paradigm existing incumbents, Google, Meta, Amazon, you name it, or is it a new generation Cerebras style?

0
💬 0

3085.284 - 3095.666 George Sivulka

probably be large tech providers and AMD. I don't know about Intel, right? I would probably bet on them. There's definitely an opportunity in the market, but chips are hard.

0
💬 0

3096.167 - 3102.631 Harry Stebbings

Before we do a quick fire, I do just want to kind of resurface back up to the agent layer. For sure. Are we out of the experimental budget phase?

0
💬 0

3103.072 - 3115.64 George Sivulka

I think that 90% of the market is still in experimental budget phase, but we're starting to see early promises of actual value. And my entire business is focused on just those repeatable use cases.

0
💬 0

3115.961 - 3122.185 Harry Stebbings

Everyone thinks they're a master of agents and agentic workflows. What do they think they know that they actually don't know?

0
💬 0

3123.01 - 3138.2 George Sivulka

I think ultimately the people in the enterprise that are most excited about AI and positioning it so strongly are CTOs and information technology people. And maybe the thing that Hebby has always said is that the CTO or the IT folks are actually the people that know the least about the business.

0
💬 0

3138.52 - 3155.111 George Sivulka

The people that actually understand how to use AI in a business context are those that are closest to the business. And so we're jumping the gun a little bit with the CTOs trying to build the CRM before it's been invented. And you actually need business people to build the CRM in Excel first in that order of operations.

0
💬 0

3155.151 - 3173.162 George Sivulka

And so there's a lot of unbundling of AI applications or CTOs trying to go out and build a very specific vertical application. But I actually think that building this platform, Heavy Matrix, is the thing that will unlock users' ability to discover what they can use AI agents for.

0
💬 0

3173.582 - 3176.504 Harry Stebbings

What will be the pricing mechanism for the future of agents?

0
💬 0

3177.145 - 3194.097 George Sivulka

It's a good question. There's like four canonical prices. There's like consumption-based pricing. There's per seat pricing. There's like, hey, rent a salary, so pay a salary for an employee, which seems a little bit ridiculous, but will be less so. And then maybe there's like flat pricing. And I think it ultimately depends on how you're driving value.

0
💬 0

3194.477 - 3209.068 George Sivulka

Because Hebbia is building human-centric AI, the human layer to how you orchestrate an AI agent's staff, that scaling at inference. We do per seat because it's ultimately always back to the human. I think you'll see all of these new business models and pricing mechanisms.

0
💬 0

3209.088 - 3213.272 Harry Stebbings

Do you do per seat because it's back to the human or just because it's what they know as a buying mechanism?

0
💬 0

3214.193 - 3231.4 George Sivulka

I actually think that we are human first. We're business user first to the point where CTOs like to pay for consumption or API, et cetera, and business users like to pay per seat because it's how they map back to value. But also we want to incentivize change. Tech is not the hard part of all of this.

0
💬 0

3231.44 - 3252.919 George Sivulka

It's hard, but the hardest part of AI change management, no matter what company you are, are people and actually getting people to use the software. When you charge for consumption or API pricing, you're disincentivizing the change. You're saying, okay, well, I'm going to penalize you in a monetary way for every time you use an AI application. What the heck? Versus here's a per seat fee.

0
💬 0

3252.939 - 3261.823 George Sivulka

It might be expensive, but use it more. You could run more LLM calls on Hebbia effectively for free than any other platform if you actually are driving real change. And that's what I love to see.

0
💬 0

3262.563 - 3285.52 Harry Stebbings

are you ready for a spicy round let's give me the spicy round we got the tissues out here too well the tissues in case you cry this is the in case you need them to hide behind so this is a spice round so this is questions from friends of yours okay we got some changing colors up here i love it yeah yeah i know it's a full game show um there we go it's like a david getter concept Perfect.

0
💬 0

3285.92 - 3292.286 Harry Stebbings

Number one question. Would you sell for $2 billion today? Would I sell for? No. What was the single best VC meeting?

0
💬 0

3292.767 - 3301.035 George Sivulka

It's somewhere between, you know, Peter talking to me about anything but the business and deeply academic things and Mike taking me on a walk around the Woodside Horse Park.

0
💬 0

3301.335 - 3319.285 Harry Stebbings

Do you trust Sam Altman? No. Who asked that question? Yeah. I don't reveal my sources. But listen, I want to do a quick fire round. So I say a short statement. You give me your immediate thoughts. That sound okay? Sounds good. Let's do it. What do you believe that most around you disbelieve?

0
💬 0

3319.825 - 3338.815 George Sivulka

Oh, crazy one. I believe that UFOs are real. I think a little bit more on the nose right now, but I actually believe there's fundamentally different propulsion technology and that I think the US government has access to it. Wow. Conspiracy theory. I have a lot of spicy takes as a specialist. Bring that out.

0
💬 0

3339.235 - 3342.977 Harry Stebbings

What trait are you slightly ashamed of, but has contributed to your success?

0
💬 0

3343.437 - 3360.925 George Sivulka

I don't think I'm ashamed of it per se. But one thing that I always hid was the fact that I'm deeply religious in an industry that's very atheistic or agnostic. It was like something that was very personal to me. And I think it's been massively contributing to. How has it contributed?

0
💬 0

3361.425 - 3384.411 George Sivulka

I think that ultimately when you're doing hard things or when you're chewing the glass or working all those really late hours, believing in something larger than yourself or believing in what you do as a vocation or something that's deeply purposeful and deeply meaningful is actually, it's additional fuel. It helps you in a way that is, I think, good for the soul. It really charges you up.

0
💬 0

3384.671 - 3408.064 George Sivulka

Do you pray? I do. I pray for an hour every morning. What? Yeah. I wake up, I sit on a meditation cushion and I used to meditate. I think meditation is also great. Praying and then putting something out into the universe or actually having a dialogue with whatever you believe, I actually think is even more powerful. It's almost- Can you talk out loud?

0
💬 0

3408.144 - 3420.673 George Sivulka

I live by myself sometimes, but sometimes it's all in my head. I think it's incredibly good for the human mind. I think it's almost an antivirus for the human mind. For an hour? For an hour, yeah.

0
💬 0

3422.094 - 3444.604 George Sivulka

yeah it's you know people meditate well why is it so weird to pray i think it's uh i didn't know what i would say when you when you dive into the human psyche and and you're not looking at your phone and and you're a lot of the time it's also a really great channel to think i think a lot of the a lot of the best ideas that i've had at hebia have come from from moments of silence yeah

0
💬 0

3446.092 - 3461.99 Harry Stebbings

I get up at like 8.20. My first meeting is at 8.30. There's like an espresso ready for me. I'm like, oh, fuck. Where are my shorts? Oh, God. Mom texted. Jesus. I'm here. I'm alive. Hi. So we have different morning routines. What's the gym routine?

0
💬 0

3462.01 - 3478.069 George Sivulka

You're a fit dude. I try to try to work out every day. I actually end up mostly channeling the the startup pressures and anger and anxiety into heavier and heavier things and lifting heavier and heavier things. So it's nothing that's like in particular.

0
💬 0

3478.489 - 3481.491 Harry Stebbings

Is Silicon Valley back as the center of all things?

0
💬 0

3482.211 - 3497.68 George Sivulka

Hebbia, I think, there was a podcast that actually recently came out where everyone's like, if you're going to build an AI company, you've got to build it in Silicon Valley. But there is one company in New York that is doing a really amazing thing. That company is Hebbia, and it seems like they're actually doing something interesting.

0
💬 0

3497.92 - 3502.463 George Sivulka

And I do think we are the exception rather than the rule, unfortunately. So I'm a big believer in Silicon Valley.

0
💬 0

3503.274 - 3505.015 Harry Stebbings

Why? Why are you the exception?

0
💬 0

3505.315 - 3519.583 George Sivulka

I think that we are a Silicon Valley company in terms of our style of work, in terms of how hard we work, in terms of how we actually pursue new technology and invest in technology. And we started in Silicon Valley and we have almost only Silicon Valley investors.

0
💬 0

3519.963 - 3522.325 Harry Stebbings

What have you changed your mind on in the last 12 months?

0
💬 0

3522.925 - 3548.536 George Sivulka

longer than 12 months probably like 18 months ago it was the scaling at inference thing like the belief in like a new set of scaling laws that they would be really really really important service now yeah salesforce or ui path okay shag marry or kill um yeah uh i wouldn't i wouldn't shag any of them i i don't think that traditional shag is like short-term excitement

0
💬 0

3550.4 - 3566.153 George Sivulka

I mean, I don't think that- In case you needed the context. I know exactly what you're getting at here. I really, you know, I'd probably kill them all. I don't think that traditional enterprise B2B applications are sexy. We're an enterprise AI company.

0
💬 0

3566.354 - 3567.615 Harry Stebbings

Are you a buyer of Salesforce?

0
💬 0

3567.975 - 3568.255 George Sivulka

We are.

0
💬 0

3568.455 - 3571.358 Harry Stebbings

We are. But everyone says Salesforce is fucked in this next generation.

0
💬 0

3572.959 - 3594.211 George Sivulka

I don't think they are. I think that Salesforce has built, again, a very, very, very sticky network effect with people. And people are the shifting function at the end of the day. It's not a technology problem. Claude can build a Salesforce. I think Klarna, again, had another Fugazi story about going off Salesforce because Claude had built them a CRM.

0
💬 0

3594.551 - 3606.237 George Sivulka

I just think that the switching costs, the network effect of changing human beings' habits is too high. Salesforce is one of those monopolies in that they have so much stickiness, habitual stickiness.

0
💬 0

3606.297 - 3613.92 Harry Stebbings

You can buy one company in the public markets that will be most benefited by the next wave of AI. Which company do you buy? That's a deep question.

0
💬 0

3614.1 - 3625.625 George Sivulka

I would probably buy Nvidia. It's a lame answer, or AMD rather. I think AMD, because I believe that they will benefit from the shift to inference scaling more than in an outsized way.

0
💬 0

3625.936 - 3629.017 Harry Stebbings

You can be CEO of any other company for a day. Which company?

0
💬 0

3629.498 - 3638.002 George Sivulka

Not a company. I'd love to be mayor of New York, believe it or not. I just think that's like a fascinating job. I think it would be really, really interesting and would love to make some change there.

0
💬 0

3638.812 - 3647.338 Harry Stebbings

What question are you never asked by investors, by angels, advisors, employees, journalists that you think you should be asked?

0
💬 0

3647.819 - 3666.512 George Sivulka

I think that one of the most interesting questions is where does creativity stem from or where do you get inspiration from or kind of like how do you come up with new ideas? Like, I don't believe that people come up with new ideas by brainstorming or in conversation. I just think that's, again, fugazi fugazi. But I think that ultimately, you know, that question of where creativity comes from.

0
💬 0

3666.632 - 3674.755 George Sivulka

I'm also a very big painter. I'm a very big, so I do large scale, like 10 foot plus oil canvas, oil painting.

0
💬 0

3674.895 - 3675.795 Harry Stebbings

I heard about this.

0
💬 0

3676.456 - 3688.121 George Sivulka

Where did that come from? I just, I think. Are you a poet as well? I love to write and probably not as good a poet, but I actually think that other creative outlets are really, really good.

0
💬 0

3688.141 - 3691.903 Harry Stebbings

You're like that annoyingly perfect kid at school.

0
💬 0

3691.943 - 3694.204 George Sivulka

If you want me to try to run, I will fall on my head.

0
💬 0

3694.564 - 3698.286 Harry Stebbings

I told you that story at the start. I mean, what do you find about painting?

0
💬 0

3700.327 - 3710.489 George Sivulka

good for you. I think it's one of those activities where you can channel emotion or intuition or latent thoughts that are somewhere in your subconscious and connect things in a really meaningful way.

0
💬 0

3710.509 - 3731.833 George Sivulka

And so in a world where there's all the stimulus or you're always thinking or churning through something or all this distraction, you're standing in front of a canvas for 10 hours with some nicotine and you're just lost in this art. I think great artists will tell you that they don't even know where paintings come from. It just is this channeling something. It's one of the best places to think.

0
💬 0

3732.273 - 3746.14 George Sivulka

It just gives you connections. It brings up these parts of your subconscious, these connections that I think you can't really access without being creative. Whether you're making music or writing or painting, I actually think that's one of the best ways to process it.

0
💬 0

3746.593 - 3749.814 Harry Stebbings

Final one. Do you feel that your parents are proud of you now? I think so.

0
💬 0

3750.094 - 3766.98 George Sivulka

Yeah, I think so. I think they've heard about it. There was one moment where I think my father's boss ended up calling him and was like, your son's kicking ass. And I was like, well, that was a very happy moment for me. That's a special moment. The chip remains, though. It's not going anywhere.

0
💬 0

3767.16 - 3771.822 Harry Stebbings

George, I so appreciate you being so open. I so appreciate the conversation. You've been fantastic to have on.

0
💬 0

3772.122 - 3778.919 George Sivulka

Yeah, I've loved it and appreciate all the research that you've done and all the crazy lines of questioning. So thank you, Harry. I appreciate a lot.

0
💬 0

3780.509 - 3800.345 Harry Stebbings

I have to say, that was such a fun show to do, and I was so, so grateful to George, who flew over from New York for that episode. It was so much better in person. If you want to watch it, you can find it on YouTube by searching for 20VC. That's 2-0-V-C. But before we leave you today, here are two fun facts about our newest brand sponsor, Kajabi.

0
💬 0

3800.585 - 3820.304 Harry Stebbings

First, their customers just crossed a collective 80%. $8 billion in total revenue. Wow! Second, Kajabi's users keep 100% of their earnings, with the average Kajabi creator bringing in over $30,000 per year. In case you didn't know, Kajabi is the leading creator commerce platform with an all-in-one suite of tools, including

0
💬 0

3820.424 - 3838.543 Harry Stebbings

websites, email marketing, digital products, payment processing, and analytics for as low as $69 per month. Whether you are looking to build a private community, write a paid newsletter, or launch a course, Kajabi is the only platform that will enable you to build and grow your online business without taking a cut of your revenue.

0
💬 0

3838.983 - 3859.167 Harry Stebbings

20 VC listeners can try Kajabi for free for 30 days by going to kajabi.com forward slash 20VC. That's kajabi.com, K-A-J-A-B-I.com forward slash 20VC. And after building your online empire with Kajabi, it's time to scale your global team with remote, seamless hiring solutions.

0
💬 0

3859.347 - 3876.721 Harry Stebbings

So every business is a global business in 2025, but how do you do payroll for your global business and team and comply with international labor laws? Well, remote handles payroll, benefits, taxes, stock options and compliance to help companies of all sizes pay and manage full-time and contract workers all over the world.

0
💬 0

3876.881 - 3893.504 Harry Stebbings

Remote's global employment solutions keep your team, your finances and your intellectual property secure. Remote never charges hidden fees, just best-in-class global employment solutions for a low flat rate. The world's top remote companies love remote. GitLab, the world's largest

0
💬 0

3893.704 - 3918.384 Harry Stebbings

all remote organization trust remote to run their global team remote is funded by index ventures sequoia capital and the host of the greatest podcast ever harry stebbings and 20 vc ready to learn more head over to remote.com forward slash 20 vc that's 20 vc and begin hiring within minutes enjoy 10 off your first three months by using the promo code 20 vc at checkout

0
💬 0

3918.624 - 3933.793 Harry Stebbings

Now that your team is up and running worldwide, make sure your finances work just as hard with Brex, the ultimate financial stack for startups. Let's be honest, building something from the ground up is hard enough without dealing with clunky, outdated banks that pile on fees and leave your cash idle.

0
💬 0

3933.933 - 3954.024 Harry Stebbings

Brex was designed with founders in mind to make every dollar go further so you can focus on building. And here's what really stands out to me. Brex combines the best of checking, treasury, and FDIC insurance in one powerhouse account. You can send and receive money globally at lightning speed, earn yield from day one, and still access your funds whenever you need.

0
💬 0

3954.184 - 3974.496 Harry Stebbings

Plus, with 20x the standard protection through program banks, your cash is not just working harder, it's working safer too. It's no surprise that one in three venture-backed startups in the US, with companies like Anthropic, Coinbase, and Robinhood, I mean, my God, these companies are incredible. Trust Brex to help them grow. If you want to join the smartest startups on the planet.

0
💬 0

3974.616 - 3984.902 Harry Stebbings

Head over to brex.com forward slash startups and see what they can do for you. As always, I so appreciate all your support and stay tuned for an incredible 20 sales with Carlos de la Torre on Friday.

0
💬 0
Comments

There are no comments yet.

Please log in to write the first comment.