Marc Andreessen
Appearances
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So a company that starts in an existing industry and goes directly to the customer in that industry. The early examples there were like Uber and Lyft and Airbnb. And then that model is kind of elaborating out. The AI thing is actually a reversion on that for now because most of the AI business right now is actually in cloud provision of AI APIs for other people to build on.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, I think most of the money I think probably will be in whatever, yeah, your AI financial advisor or your AI doctor or your AI lawyer or, you know, take your pick of whatever the domain is. And what's interesting is, you know, the Valley kind of does everything. The entrepreneurs kind of elaborate every possible idea.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so there will be a set of companies that like make AI something that can be purchased and used by large law firms. And then there will be other companies that just go direct to market as an AI lawyer.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. So the great thing about the really great founders is they don't take any advice. So if you find yourself listening to advice, maybe you shouldn't do it.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So what makes a great founder is super smart, coupled with super energetic, coupled with super courageous. I think it's some of those three.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The first two are traits, and the third one is a choice, I think. Courage is a choice. Well, because courage is a question of pain tolerance, right? So how many times are you willing to get punched in the face before you quit? Yeah. And... Here's maybe the biggest thing people don't understand about what it's like to be a startup founder is it gets very romanticized, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And even when they fail, it still gets romanticized about what a great adventure it was. But the reality of it is most of what happens is people telling you no, and then they usually follow that with you're stupid, right? No, I will not come to work for you. I will not leave my cushy job at Google to come work for you. No, I'm not going to buy your product.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
No, I'm not going to run a story about your company. No, I'm not this, that, the other thing. And so a huge amount of what people have to do is just get used to just getting punched. And the reason people don't understand this is because when you're a founder, you cannot let on that this is happening because it will cause people to think that you're weak and they'll lose faith in you.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So you have to pretend that you're having a great time when you're dying inside, right? You're just in misery.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
What do they do? Yeah, that's the thing. It's like it is a level. This is actually one of the conclusions, I think. For most of these people on a risk-adjusted basis, it's probably an irrational act. They could probably be more financially successful on average if they just got a real job at a big company.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But some people just have an irrational need to do something new and build something for themselves. And some people just can't tolerate having bosses. Oh, here's a fun thing is how do you reference check founders? Right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So you call it, you know, normally you reference check your time hiring somebody as you call the bosses there and you know, and you find out if they were good employees and now you're trying to reference check Steve jobs. Right. And it's like, Oh God, he was terrible. You know, he was a terrible employee. He never did what we told him to do.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, ideally, ideally what you want is I will go, I would like to go to work for that person. Um, he worked for me here and now I'd like to work for him. Now, unfortunately, most people can't. Their egos can't handle that. So they won't say that. But that's the ideal.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So I think the other big thing is you see people sometimes who say, I want to start a company. And then they kind of work through the process of coming up with an idea. And generally, those don't work as well as the case where somebody has the idea first. And then they kind of realize that there's an opportunity to build a company.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then they just turn out to be the right kind of person to do that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I would say specific. Specifically, yes, specifics. Because for the first five years, you don't get to have vision. You just got to build something people want and you got to figure out a way to sell it to them. It's very practical.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. Like it's got to, the first product's got to work by which I mean, like it has to technically work, but then it has to actually fit into the category in the customer's mind of something that they want. And then, and then by the way, the other part is they have to want to pay for it. Like somebody has got to pay the bills.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so you've got to figure out how to price it and whether you can actually extract the money. Yeah. So usually it is much more predictable. Success is never predictable, but it's more predictable if you start with a great idea and then back into starting the company. So this is what we did. We had Mosaic before we had Netscape. The Google guys had the Google search engine working at Stanford.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Actually, there's tons of examples where Pierre Omidyar had eBay working before he left his previous job.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. By the way, it's also far easier to raise money, right? Like the ideal pitch that we receive is here's the thing that works. Would you like to invest in our company or not? Like that's so much easier than here's 30 slides with a dream, right? And then we have this concept called the idea maze, which Balaji Srinivasan came up with when he was with us.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So then there's this thing, this goes to mythology, which is, you know, there's a mythology that kind of, you know, these ideas, you know, kind of arrive like magic or people kind of stumble into them. It's like eBay with the pest dispensers or something.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, the reality usually with the big successes is that the founder has been chewing on the problem for five or 10 years before they start the company. And they often worked on it in school, um, or they even experimented on it when they were a kid. Um, and they've been kind of training up over that period of time to be able to do the thing. So they're like a true domain expert.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And it sort of sounds like mom and apple pie, which is, yeah, you want to be a domain expert in what you're doing, but the mythology is so strong of like, oh, I just had this idea in the shower and now I'm doing it. It's generally not that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, we call it the idea maze because the idea maze basically is like there's all these permutations. Like for any idea, there's like all these different permutations. Who should the customer be? What shape forms the product have? And how should we take it to market and all these things?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so the really smart founders have thought through all these scenarios by the time they go out to raise money. And they have like detailed answers on every one of those fronts because they put so much thought into it. The sort of more haphazard founders haven't thought about any of that. And it's the detailed ones who tend to do much better.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I mean, the best reason is just because you can't tolerate not doing it, right? Like this is the kind of thing where if you have to be advised into doing it, you probably shouldn't do it. And so it's probably the opposite, which is you just have such a burning sense of this has to be done. I have to do this. I have no choice.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's going to lead to a lot of pain.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, look, so it's going to put you in a social tunnel for sure, right? So you're going to like, you know, there's this game you can play on Twitter, which is you can do any whiff of the idea that there's basically any such thing as work-life balance and that people should actually work hard and everybody gets mad.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But like the truth is, like all the successful founders are working 80-hour weeks and they're working, you know, they form various... very strong social bonds with the people they work with. They tend to lose a lot of friends on the outside or put those friendships on ice. That's just the nature of the thing. For most people, that's worth the trade-off.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The advantage maybe younger founders have is maybe they have less. For example, if they're not married yet or don't have kids yet, that's an easier thing to bite off.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, you definitely can. Yeah. Many of the most successful founders are second, third, fourth-time founders. They're in their 30s, 40s, 50s. The good news with being an older founder is you know more. and you know a lot more about what to do, which is very helpful.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The problem is, okay, now you've got like a spouse and a family and kids, and like, you've gotta go to the baseball game and like, you can't go to the baseball, you know? And so it's,
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. So, it's basically, I would say it's autodidact. So, it's going down the rabbit holes. So, it's a combination. I kind of allude to it in that quote. It's a combination of breadth and depth. And so, I go broad by the nature of what I do. I go broad, but then I tend to go deep in a rabbit hole for a while, read everything I can, and then come out of it.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I might not revisit that rabbit hole for another decade.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The Sebastian biography of Lenin is extraordinary.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's incredible, yeah, it's incredible. I actually think it's the single best book on the Soviet Union.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. Well, and then you get into this thing also, which is like, you know, there's the part of the LLM that just basically is doing prediction based on past data. But there's also the part of the LLM where it's evolving circuitry, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. So this is a fascinating book. This one's free. It's free, by the way. It's a book from the 1860s. You can download it or you can buy prints of it. But it was this guy who was a professor at the Sorbonne in the 1860s. And he was apparently a savant on antiquity, on Greek and Roman antiquity. And the reason I say that is because his sources are 100% original Greek and Roman sources.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So he wrote basically a history of Western civilization from on the order of 4,000 years ago to basically the present times, entirely working on original Greek and Roman sources. And what he was specifically trying to do was he was trying to reconstruct from the stories of the Greeks and the Romans.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
He was trying to reconstruct what life in the West was like before the Greeks and the Romans, which was in the civilization known as the Indo-Europeans. And the short answer is, and this is sort of circa 2000 BC to sort of 500 BC, kind of that 1500 year stretch where civilization developed. And his conclusion was basically cults. They were basically cults and civilization was organized into cults.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And the intensity of the cults was like a million fold beyond anything that we would recognize today. Like it was a level of all encompassing belief and an action around religion. That was at a level of extremeness that we wouldn't even recognize it. And so specifically, he tells the story of basically there were three levels of cults.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Inside it, it's evolving, you know, neurons, functions, be able to do math and be able to, you know, and, you know, some people believe that, you know, over time, you know, if you keep feeding these things enough data and enough processing cycles, they'll eventually evolve an entire internal world model, right? And they'll have like a complete understanding of physics.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There was the family cult, the tribal cult, and then the city cult as society scaled up. And then each cult was a joint cult of family gods, which were ancestor gods, and then nature gods. Um, and then you are bonding into a family, a tribe or a city was based on your adherence to that religion.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, people, uh, who were not of your family tribe city worship different gods, which gave you not just the right, but the responsibility to kill them on site.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Hardcore. By the way, shocking development. I did not realize there's zero concept of individual rights. Even up through the Greeks and even in the Romans, they didn't have the concept of individual rights. The idea that as an individual, you have some right, it's just like, nope. And you look back and you're just like, wow, that's just crazily fascist in a degree that we wouldn't recognize today.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But it's like, well, they were living under extreme pressure for survival. And the theory goes you could not have people running around making claims to individual rights when you're just trying to get your tribe through the winter. You need hardcore command and control. And actually, through a modern political lens, those cults were basically both fascist and communist.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
They were fascist in terms of social control, and then they were communist in terms of economics.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, so my conclusion from this book, so the way we naturally think about the world we live in today is like we basically have such an improved version of everything that came before us, right? Like we have basically, we've figured out all these things around morality and ethics and democracy and all these things.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And like they were basically stupid and retrograde and were like smart and sophisticated. And we've improved all this. After reading that book, I now believe in many ways the opposite, which is no, actually, we are still running in that original model. We're just running in an incredibly diluted version of it. So we're still running basically in cults.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's just our cults are at like a thousandth or a millionth the level of intensity, right? And so just to take religions... you know, the modern experience of a Christian in our time, even somebody who considers him a devout Christian is just a shadow of the level of intensity of somebody who belonged to a religion back in that period.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then by the way, we have, it goes back to our AI discussion, we then sort of endlessly create new cults. Like we're trying to fill the void, right? And the void is a void of bonding. Okay. Living in their era, like everybody living today, transported in that era would view it as just completely intolerable in terms of the loss of freedom and the level of basically fascist control.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So when they have the computational capability, right, then there's for sure an opportunity to generate like fresh signal.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
However, every single person in that era, and he really stresses this, they knew exactly where they stood. They knew exactly where they belonged. They knew exactly what their purpose was. They knew exactly what they needed to do every day. They knew exactly why they were doing it. They had total certainty about their place in the universe.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Absolutely, overwhelmingly, undisputably, undeniably.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yes, because we don't have that. We are ungrounded. We are uncentered. And we all feel it, right? And that's why we reach for, you know, it's why we still reach for religion. It's why we reach for, you know, people start to take on, you know, let's say, you know, a faith in science, maybe beyond where they should put it. And by the way, sports teams, they're like a tiny little version of a cult.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And Apple keynotes are a tiny little version of a cult, right? And political. And there's full-blown cults on both sides of the political spectrum right now operating in plain sight.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Compared to what it used to. I mean, we would today consider full-blown. But yes, they're at, I don't know, a hundred thousandth or something of the intensity of what people had back then. Yeah. So we live in a world today that in many ways is more advanced and moral and so forth. And it's certainly a lot nicer, much nicer world to live in. But we live in a world that's like very washed out.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's like everything has become very colorless and gray as compared to how people used to experience things, which is, I think, why we're so prone to reach for drama. There's something in us deeply evolved where we want that back.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. So the tools that are available today, I mean, are just like, I sometimes, you know, I sometimes bore, you know, kids by describing like what it was like to go look up a book, you know, to try to like discover a fact. And, you know, in the old days, the 1970s, 1980s, you go to the library and the card catalog and the whole thing, you go through all that work.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then the book is checked out and you have to wait two weeks.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And like, like to be in a world, not only where you can get the answer to any question, but also the world now, you know, the AI world where you've got like the assistant that will help you do anything, help you teach, learn anything like your ability, both to learn and also to produce is just like, I don't know, a million fold beyond what it used to be.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I have a, I have a blog post I've been wanting to write, which I call where, where are the hyperproductive people? Like with these tools, like there should be authors that are writing like hundreds or thousands of like outstanding books.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Artists, musicians, right? Why aren't musicians producing a thousand times the number of songs, right? Like the tools are spectacular. Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I think it might be distraction. Distraction. It's so easy to just sit and consume that I think people get distracted from production. But if you wanted to, as a young person, if you wanted to really stand out, you could get on a hyper productivity curve very early on.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There's a great story in Roman history of Pliny the Elder, who was this legendary statesman, died in the Vesuvius eruption trying to rescue his friends. But he was famous both for basically being a polymath, but also being an author. And he wrote apparently hundreds of books. Most of which have been lost, but he wrote all these encyclopedias.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And he literally would be reading and writing all day long, no matter what else was going on. And so he would travel with four slaves, and two of them were responsible for reading to him, and two of them were responsible for taking dictation. And so like he'd be going cross country and like literally he would be writing books like all the time. And apparently they were spectacular.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There's only a few that have survived, but apparently they were amazing.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. And there are examples like there are, you know, there's this guy, Judge, what's his name? Posner, who wrote like 40 books and was also a great federal judge. You know, there's our friend Balaji, I think it's like this. He's one of these, you know, where his output is just prodigious. And so it's like, yeah, I mean, with these tools, why not?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I kind of think we're at this interesting kind of freeze frame moment where like these tools are not in everybody's hands and everybody's just kind of staring at them trying to figure out what to do.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I mean, I, I, maybe it's just, and I, I look, I think people, I think people are wired differently. So I think it's hard to generalize this kind of thing, but I'm, I am much happier and more satisfied when I'm fully committed to something. So I'm very much in favor of imbalance. Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Now I happen to have whatever twist of personality traits lead that in non-destructive dimensions, including the fact that I've actually, I now no longer do the 10-4 plan. I stopped drinking. I do the caffeine, but not the alcohol. So there's something in my personality where I, whatever maladaption I have is inclining me towards productive things, not unproductive things.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So I think happiness... I don't think happiness is the thing.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I think satisfaction is the thing.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
No, deeper. So happiness is, you know, a walk in the woods at sunset, an ice cream cone, a kiss. The first ice cream cone is great. The thousandth ice cream cone, not so much. At some point, the walks in the woods get boring.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I think satisfaction is a deeper thing, which is like having found a purpose and fulfilling it, being useful.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
That I'm fully satisfying my faculties, that I'm fully delivering on the gifts that I've been given, that I'm making the world better, that I'm contributing to the people around me, and that I can look back and say, wow, that was hard, but it was worth it. I think generally seems to lead people in a better state than pursuit of pleasure, pursuit of quote unquote happiness.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I think the founders, the founding fathers in the US threw this off kilter when they used the phrase pursuit of happiness. I think they should have said.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
If they said pursuit of satisfaction, we might live in a better world today. Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, you can tell when you're talking to somebody, you can tell sometimes you have a conversation. You're like, wow, this person does not have any original thoughts. They are basically echoing things that other people have told them.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
They could have tweaked the Second Amendment.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So I think, and I think there, I mean, look, I think Elon is, I don't think I'm even a great example, but I think Elon would be the great example of this, which is like, you know, look, he's a guy who from every, every day of his life from the day he started making money at all, he just plows into the, into the next thing. And so I think, I think money is definitely an enabler for satisfaction.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Money applied to happiness leads people down very dark paths, very destructive avenues. Money applied to satisfaction, I think could be, is a real tool. Um, I always look, by the way, I was like, uh, you know, Elon is the case study for behavior. But the other thing that I thought he's really made me think is Larry, Larry page was asked one time what his approach to philanthropy was.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And he said, Oh, I'm just my, my philanthropic plan is just give all the money to Elon.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, so the core of it is he's back to the future. So he is doing the most leading edge things in the world, but with a really deeply old school approach. And so to find comparisons to Elon, you need to go to like Henry Ford and Thomas Watson and Howard Hughes and Andrew Carnegie. right? Um, Leland Stanford, um, John D Rockefeller, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There's other people you got in conversation with where it's like, wow, like they have a model in their head of how the world works and it's a different model than mine. And they're saying things that I don't expect. And so I need to now understand how their model of the world differs from my model of the world. And then that's how I learned something fundamental. right underneath the words.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You need to go to the, what we're called the bourgeois capitalists, like the hardcore business owner operators who basically built, you know, basically built industrialized society, um, Vanderbilt. Um, and it's a level of hands-on commitment, um, and, uh, depth, um, in the business, um,
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
um, coupled with an absolute priority, uh, towards truth, um, and towards, um, kind of put it science and technology, uh, down to first principles. That is just like absolute. It was just like unbelievably absolute. He really is ideal that he's only ever talking to engineers. Like he does not tolerate bullshit. He has the most bullshit tolerance anybody I've ever met.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, he wants ground truth on every single topic. Um, and he runs his businesses directly day to day devoted to getting to ground truth in every single topic. so uh you think it was a good decision for him to buy twitter i have developed a view in life did not second guess elon musk i know this is gonna sound crazy and unfounded but well i mean uh he's got a quite a track record
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I mean, look, the car was a crazy... I mean, the car was... I mean, look.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Starting a new car company in the United States of America, the last time somebody really tried to do that was the 1950s. And it was called Tucker Automotive. And it was such a disaster. They made a movie about what a disaster it was. And then rockets. Like, who does that? Like, that's... There's obviously no way to start a new rocket company like those days are over.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then to do those at the same time. So after he pulled those two off, like... Okay, fine. Like... Like, this is one of my areas of like, whatever opinions I had about that is just like, okay, clearly are not relevant. Like this is, you just, at some point you just like bet on the person.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Oh, yeah. I mean, look, he drives resentment. He is a magnet for resentment. His critics are the most miserable, resentful people in the world. It's almost a perfect match of the most idealized technologist of the century coupled with just his critics are just bitter as can be. I mean, it's sort of very darkly comic to watch.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
He's running a cult.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I don't know the answer to that. I think the meaning of... The closest I get to it is what I said about satisfaction. So it's basically like, okay, we were given what we have. We should basically do our best. What's the role of love in that mix? I mean, what's the point of life if you're, yeah, without love? Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And look, like taking care of people is like a wonderful thing. Like, you know, mentality, you know, there are pathological forms of taking care of people, but there's also a very fundamental, you know, kind of aspect of taking care of people. Like, for example, I happen to be somebody who believes that capitalism and taking care of people are actually, they're actually the same thing.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Somebody once said capitalism is how you take care of people you don't know. Right. Right. And so like, yeah, I think it's like deeply woven into the whole thing. You know, there's a long conversation to be had about that, but yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
David Friedman says there's only three ways to get somebody to do something for somebody else. Love, money, and force.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So you can experiment with this now. I do this for fun. So you can tell GPT-4, you know, whatever, debate X, you know, X and Y, communism and fascism or something. And it'll go for, you know, a couple of pages and then inevitably it wants the parties to agree. And so they will come to a common understanding.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And it's very funny if they're like, if these are like emotionally inflammatory topics, because they're like somehow the machine is just, you know, it figures out a way to make them agree. But it doesn't have to be like that because you can add to the prompt. I do not want the conversation to come to agreement. In fact, I want it to get more stressful and argumentative as it goes.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I want tension to come out. I want them to become actively hostile to each other. I want them to not trust each other, take anything at face value. And it will do that. It's happy to do that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You can steer it. Or you could steer it and you could say, I want it to get as tense and argumentative as possible, but still not involve any misrepresentation. You could say, I want both sides to have good faith. You could say, I want both sides to not be constrained to good faith.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
In other words, you can set the parameters of the debate and it will happily execute whatever path, because for it, it's just like predicting. It's totally happy to do either one. It doesn't have a point of view. it has a default way of operating, but it's happy to operate in the other realm.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, and so like, and this is how I, when I want to learn about a contentious issue, this is what I do now is like, this is what I, this is what I ask it to do. And I'll often ask it to go through five, six, seven, you know, different, you know, sort of continuous prompts and basically, okay, argue that out in more detail. Okay.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
No, this, this argument is becoming too polite, you know, make it more, you know, make it tensor. Um, and yeah, it's thrilled to do it. So it has the capability for sure.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, so several layers to the question. So one is one of the things that an LLM is good at is actually de-biasing. And so you can feed it a news article and you can tell it strip out the bias. Yeah, that's nice, right? And it actually does it. Like it actually knows how to do that because it knows how to do, among other things, it actually knows how to do sentiment analysis.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so it knows how to pull out the emotionality. And so that's one of the things you can do. It's very suggestive of the sense here that there's real potential in this issue. You know, I would say, look, the second thing is there's this issue of hallucination, right? And there's a long conversation that we could have about that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, so it's basically, well, so it's sort of, hallucination is what we call it when we don't like it. Creativity is what we call it when we do like it, right? And, you know.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Right, and so when the engineers talk about it, they're like, this is terrible, it's hallucinating, right? If you have artistic inclinations, you're like, oh my God, we've invented creative machines for the first time in human history. This is amazing.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, bullshitters, but also.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There are shades of gray, though. It's interesting. So we had this conversation where, you know, we're looking at my firm at AI and lots of domains, and one of them is the legal domain. So we had this conversation with this big law firm about how they're thinking about using this stuff.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And we went in with the assumption that an LLM that was going to be used in the legal industry would have to be 100% truthful, verified, you know. There's this case where this lawyer apparently submitted a GPT-generated brief and it had fake legal case citations in it and the judge is going to get his law license stripped or something.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
We just assumed it's like, obviously, they're going to want the super literal one that never makes anything up, not the creative one. But actually they said, what the law firm basically said is, yeah, that's true at like the level of individual briefs, but they said when you're actually trying to figure out like legal arguments, right? Like you actually want to be creative, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You don't, again, there's creativity and then there's like making stuff up. what's the line? You want it to explore different hypotheses. You want to do the legal version of improv or something like that, where you want to float different theories of the case and different possible arguments for the judge and different possible arguments for the jury.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
By the way, different routes through the history of all the case law. And so they said, actually, for a lot of what we want to use it for, we actually want it in creative mode. And then basically, we just assume that we're going to have to cross-check all the specific citations. And so I think there's going to be more shades of gray in here than people think.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then I just add to that, you know, another one of these trillion dollar kind of questions is ultimately, you know, sort of the verification thing. And so, you know, will LLMs be evolved from here to be able to do their own factual verification? Will you have sort of add-on functionality like Wolfram Alpha, right? Where, you know, and other plugins where that's the way you do the verification.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You know, another, by the way, another idea is you might have a community of LLMs on any, you know, so for example, you might have the creative LLM and then you might have the literal LLM fact check it. Right. And so there's a variety of different technical approaches that are being applied to solve the hallucination problem.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You know, some people like Jan LeCun argue that this is inherently an unsolvable problem. But most of the people working in the space, I think, think that there's a number of practical ways to kind of kind of corral this in a little bit.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And in fact, Wikipedia today is still not deterministically correct, right? So you cannot take to the bank, right, every single thing on every single page, but it is probabilistically correct, right? And specifically the way I describe Wikipedia to people, it is more likely that Wikipedia is right than any other source you're going to find.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's this old question, right? Of like, okay, like, are we looking for perfection? Are we looking for something that asymptotically approaches perfection? Are we looking for something that's just better than the alternatives? And Wikipedia, right, has exactly your point, has proven to be like overwhelmingly better than people thought. And I think that's where this ends.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then underneath all this is the fundamental question of where you started, which is, okay, what is truth? How do we get to truth? How do we know what truth is? And we live in an era in which an awful lot of people are very confident that they know what the truth is. And I don't really buy into that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I think the history of the last 2,000 years or 4,000 years of human civilization is actually getting to the truth is actually a very difficult thing to do.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Sure, but like, you know, we came up with communism before the internet somehow. which I would say had rather larger issues than anything we're dealing with today.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And its theoretical structure, it had real issues. It had a very deep fundamental misunderstanding of human nature and economics.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
They were extremely confident. And my point is they were very confident 3,900 years into what you would presume to be evolution towards the truth. Yeah. And so my assessment is... My assessment is, number one, there's no need for the Hegelian dialectic to actually converge towards the truth. Like, apparently not.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Number one, I think it's just really difficult. Historically, who gets to decide what the truth is? It's either the king or the priest. And so we don't live in an era anymore of kings or priests dictating it to us. And so we're kind of on our own. And so my typical thing is we just need a huge amount of humility.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And we need to be very suspicious of people who claim that they have the capital truth. And then we need to have... Look, the good news is the Enlightenment has bequeathed us with a set of techniques to be able to presumably get closer to truth through the scientific method and rationality and observation and experimentation and hypothesis.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And, you know, we need to continue to embrace those even when they give us answers we don't like.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
how is anything testable at all especially that involves like human nature things like this it's not physics here's a question a friend of mine just asked me on this topic so suppose you had llms in equivalent of gpt4 even 5678 suppose you had them in the 1600s yeah and galileo comes up for trial yeah right and you ask the llm like is galileo right yeah like what does it answer Right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And one theory is it answers, no, that he's wrong because the overwhelming majority of human thought up until that point was that he was wrong. And so therefore that's, what's in the training data. Yeah. Um, another way of thinking about it is, well, this efficiently advanced LLM will have evolved the ability to actually check the math. Right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, and we'll actually say, actually, no, actually, you know, you may not want to hear it, but he's right. Now, if, you know, the church at that time was, you know, on the LLM, they would have given it human, you know, human, feedback to prohibit it from answering that question. And so I like to take it out of our current context because that makes it very clear. Those same questions apply today.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
This is exactly the point of a huge amount of the human feedback training that's actually happening with these LLMs today. This is a huge debate that's happening about whether open source AI should be legal.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
AI alignment, which everybody is like, oh, that sounds great. Alignment with what? Human values. Who's human values? Who's human values? And we're in this mode of social and popular discourse. What do you think of when you read a story in the press right now and they say, XYZ made a baseless claim about some topic? And there's one group of people who are like, aha, they're doing fact-checking.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There's another group of people that are like, every time the press says that, it's now a tick and that means that they're lying. We're in this social context where the level to which a lot of people in positions of power have become very certain that they're in a position to determine the truth for the entire population is like...
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
there's like there's like some bubble that has formed around that idea and at least it flies completely in the face of everything i was ever trained about science and about reason um and strikes me as like you know deeply offensive um and incorrect what would you say about the state of journalism just on that topic today are we are we in a temporary kind of uh
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You have to always think about the counterfactual in these things, which is like, okay, because these questions, right, this question heads towards, it's like, okay, the impact of social media and the undermining of truth and all this, but then you want to ask the question of like, okay, what if we had had the modern media environment
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
including cable news and including social media and Twitter and everything else in 1939 or 1941, right? Or 1910 or 1865 or 1850 or 1776, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I'll just take a simple example. Like how would President Kennedy have been interpreted with what we know now about all the things Kennedy was up to? Like, how would he have been experienced by the body politic with a social media context, right? Like, how would LBJ have been experienced? By the way, how would, you know, like, many meant FDR, like the New Deal, the Great Depression.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You know, I mean, look, to this day, there are lots of very interesting real questions around like how America, you know, got, you know, basically involved in World War II and who did what when and the operations of British intelligence in American soil and did FDR, this, that, Pearl Harbor, you know. Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Woodrow Wilson ran for, you know, his candidacy was run on an anti-war, you know, he ran on the platform and not getting involved in World War I. Somehow that switched, you know, like... And I'm not even making a value judgment on any of these things. I'm just saying the way that our ancestors experienced reality was, of course, mediated through centralized top-down control at that point.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
If you ran those realities again with the media environment we have today, the reality would be experienced very, very differently. And then, of course, that intermediation would cause the feedback loops to change, and then reality would obviously play out. Do you think it would be very different? Yeah, it has to be.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It has to be just because it's all so, I mean, just look at what's happening today. I mean, just, I mean, the most obvious thing is just the collapse. And here's another opportunity to argue that this is not the internet causing this, by the way.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Here's a big thing happening today, which is Gallup does this thing every year where they do, they pull for trust in institutions in America and they do it across all the different, everything from military to clergy and big business and the media and so forth. Right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And basically, there's been a systemic collapse in trust in institutions in the US, almost without exception, basically, since essentially the early 1970s. There's two ways of looking at that, which is, oh my God, we've lost this old world in which we could trust institutions, and that was so much better, because that should be the way the world runs.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The other way of looking at it is we just know a lot more now, and the great mystery is why those numbers aren't all zero.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Right? Because now we know so much about how these things operate, and they're not that impressive.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so this goes to the thing, which is like, okay, had we had the media environment that we've had between the 1970s and today, if we had that in the 30s and 40s or 1900s, 1910s, I think there's no question reality would turn out different if only because everybody would have known to not trust the institutions, which would have changed their level of credibility, their ability to control circumstances.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Therefore, the circumstances would have had to change. Yeah. And it would have been a feedback loop process. In other words, your experience of reality changes reality, and then reality changes your experience of reality. It's a two-way feedback process, and media is the intermediating force between that. So change the media environment, change reality.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so just as a consequence, I think it's just really hard to say, oh, things worked a certain way then and they work a different way now. And then therefore, people were smarter then or better then or, by the way, dumber then or not as capable then. We make all these really light and casual comparisons of ourselves to previous generations of people. We draw judgments all the time.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I just think it's really hard to do any of that because if we... If we put ourselves in their shoes with the media that they had at that time, I think we probably most likely would have been just like them.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, even just the whole concept of the chat UI might not be the, like the chat UI is just the first whack at this and maybe that's the dominant thing, but look, maybe we don't know yet. Maybe the experience most people with LLMs is just a continuous feed. you know, maybe it's more of a passive feed and you just are getting a constant, like running commentary on everything happening in your life.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And it's just helping you kind of interpret and understand everything.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
What to say in a job interview. Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. Next sentence. Yeah. At that level. Yeah. I mean, yes. So technically, now, whether we want that or not is an open question, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I mean, look. this gets this whole thing of like, so, you know, the chat interface has this whole concept of prompt engineering, right? So it's good for prompts. Well, it turns out one of the things that a lot of times are really good at is writing prompts, right? And so like, what if you just outsourced, and by the way, you could run this experiment today. You could hook this up to do this today.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The latency is not good enough to do it real time in a conversation, but you could run this experiment and you just say, look, every 20 seconds, you could just say, you know, you know, tell me what the optimal prompt is and then ask yourself that question to give me the result.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then as you, as you, exactly to your point, as you add, there will be, there will be these systems are going to have the ability to be learned and updated essentially in real time. And so you'll be able to have a pendant or your phone or whatever, watch or whatever. It'll have a microphone on it. It'll listen to your conversations. It'll have a feed of everything else happened in the world.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then it'll be, you know, sort of retraining, prompting or retraining itself on the fly. And so the scenario you described is actually a completely doable scenario. Now, the hard question on these is always, okay, since that's possible, are people going to want that? Like what's the form of experience?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You know, that, that we, we won't know until we try it, but I don't think it's possible yet to predict the form of AI in our lives. Therefore, it's not possible to predict the way in which it will intermediate our experience with reality yet.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Trillion dollar question.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There's a bunch of those. So look, there's a really big question today. Sitting here today is a really big question about the big models versus the small models. That's related directly to the big question of proprietary versus open. Then there's this big question of where is the training data going to go? Are we topping out on the training data or not?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then are we going to be able to synthesize training data? Yeah. And then there's a huge pile of questions around regulation and, you know, what's actually going to be legal. And so I would when we think about it, we dovetail kind of all those all those questions together.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You can paint a picture of the world where there's two or three God models that are just at like staggering scale and they're just better at everything. and they will be owned by a small set of companies, and they will basically achieve regulatory capture over the government, and they'll have competitive barriers that will prevent other people from competing with them.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so there will be, just like there's whatever, three big banks or three big, or by the way, three big search companies, or I guess two now, it'll centralize like that. You can paint another very different picture that says, no, actually the opposite of that's gonna happen. This is gonna basically, this is the new gold rush. alchemy.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
This is the big bang for this whole new area of science and technology. And so therefore, you're going to have every smart 14-year-old on the planet building open source and figuring out ways to optimize these things. And then we're just going to get overwhelmingly better at generating training data.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
We're going to bring in blockchain networks to have an economic incentive to generate decentralized training data and so forth and so on. And then basically, we're going to live in a world of open source. And there's going to be a billion LLMs of every size, scale, shape, and description.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And there might be a few big ones that are the super genius ones, but mostly what we'll experience is open source. And that's more like a world of what we have today with Linux and the web. So.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, it is this always big question, which is you get this feeling. I hear about this a lot from founder CEOs where it's like, wow, we have 50,000 people. It's now harder to do new things than it was when we had 50 people. Like what has happened? So that's a recurring phenomenon. By the way, that's one of the reasons why there's always startups and why there's venture capital.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's just that's like a timeless phenomenon. Uh, kind of thing. So that, that, that's one observation. Um, on a page rank, um, we can talk about that, but on page rank specifically on page rank, um, there actually is a page. So there is a page rank already in the field and it's the transformer, right? So the, the, the big breakthrough was the transformer.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, and, uh, the transformer was invented in, uh, 2017 at Google, um, And this is actually like really an interesting question. Cause it's like, okay, the transformers, like why does open AI even exist? Like the transformers invented at Google. Why didn't Google? I asked a guy, I asked a guy I know who was senior at Google brain kind of when this was happening.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I said, if Google had just gone flat out to the wall and just said, look, we're going to launch, we're going to launch equivalent of GPT-4 as fast as we can. He said, I said, when could we have had it? And he said, 2019. Yeah. They could have just done a two year sprint with the transformer and Bennett because they already had the compute at scale.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
They already had all the training data and they could have just done it. There's a variety of reasons they didn't do it. This is like a classic big company thing. IBM invented the relational database in the 1970s, let it sit on the shelf as a paper. Larry Ellison picked it up and built Oracle. Xerox PARC invented the interactive computer. They let it sit on the shelf.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Steve Jobs came and turned it into the Macintosh. And so there is this pattern. Now, having said that, sitting here today, Google's in the game, right? So Google, maybe they let a four-year gap go there that they maybe shouldn't have, but they're in the game. And so now they're committed. They've done this merger. They're bringing in Demis. They've got this merger with DeepMind.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
They're piling in resources. There are rumors that they're building an incredible super LLM way beyond what we even have today. And they've got, you know, unlimited resources and a huge, you know, they've been challenged with their honor.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, so the startup, the huge advantage that startups have is they just, there's no sacred cows. There's no historical legacy to protect. There's no need to reconcile your new plan with existing strategy. There's no communication overhead. There's no, you know, big companies are big companies. They've got pre-meetings, planning for the meeting. Then they have the post-meeting and the recap.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Then they have the presentation of the board. Then they have the next round of meetings. Yeah, lots of meetings. And that's the elapsed time when the startup launches its product, right? So there's a timeless, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So there's a timeless thing there. Now- Yeah. What the startups don't have is everything else, right? So startups, they don't have a brand, they don't have customer relationships, they've got no distribution, they've got no scale. I mean, sitting here today, they can't even get GPUs, right? Like there's like a GPU shortage.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Startups are literally stalled out right now because they can't get chips, which is like super weird.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, but the clouds run out of chips, right? And then to the extent the clouds have chips, they allocate them to the big customers, not the small customers, right? And so the small companies lack everything other than the ability to just do something new. Yeah. Right. And this is the timeless race and battle.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And this is kind of the point I tried to make in the essay, which is like both sides of this are good. Like, it's really good to have like highly scaled tech companies that can do things that are like at staggering levels of sophistication. It's really good to have startups that can launch brand new ideas. They ought to be able to both do that and compete.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
They neither one ought to be subsidized or protected from the others. Like that's, that's to me, that's just like very clearly the idealized world. It is the world we've been in for AI up until now. And then of course there are people trying to shut that down, but my hope is that, you know, the best outcome clearly will be if that continues.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So I, uh, I have an eight year old and he's super into like Minecraft and learning to code and doing all this stuff. So I, I, of course I was very proud. I could bring sort of fire down from the mountain to my kid and I brought him chat GPT and I hooked him up on his, on his, on his, on his laptop. And I was like, you know, this is the thing that's going to answer all your questions.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And he's like, okay. And I'm like, but it's going to answer our questions. And he's like, well, of course, like it's a computer. Of course, it answers all your questions. Like what else would a computer be good for? Dad. Never impressed. Not impressed in the least. Two weeks pass and he has some question. And I say, well, have you asked JetGPT? And he's like, dad, Bing is better.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And why is Bing better is because it's built into the browser. Because he's like, look, I have the Microsoft Edge browser and it's got Bing right here. And then he doesn't know this yet, but one of the things you can do with Bing and Edge is there's a setting where you can use it to basically talk to any webpage. because it's sitting right there next to the browser.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And by the way, it includes PDF documents. And so the way they've implemented an edge with Bing is you can load a PDF and then you can ask it questions, which is the thing you can't do currently in just ChatGPT. So they're gonna push the meld. I think that's great. They're gonna push the melding and see if there's a combination thing there.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
google's rolling out this thing the magic button which is implemented in they put in google docs right and so you go to you know google docs and you create a new document and you you know you instead of like you know starting to type you just you know say it press the button and it starts to like generate content for you right like is that the way that it'll work um is it going to be a speech ui where you're just going to have an earpiece and talk to it all day long you know is it going to be a
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Like these are all like, this is exactly the kind of thing that I don't, this is exactly the kind of thing I don't think is possible to forecast. I think what we need to do is like run all those experiments. And so one outcome is we come out of this with like a super browser that has AI built in. That's just like amazing.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Look, there's a real possibility that the whole, I mean, look, there's a possibility here that the whole idea of a screen And Windows and all this stuff just goes away. Because why do you need that if you just have a thing that's just telling you whatever you need to know?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Every medium becomes the content for the next one. So the AI will be able to give you a browser whenever you want. Oh, interesting. Yeah. Another way to think about it is maybe what the browser is. Maybe it's just the escape hatch, right? Which is maybe kind of what it is today.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Which is like most of what you do is like inside a social network or inside a search engine or inside somebody's app or inside some controlled experience. But then every once in a while, there's something where you actually want to jailbreak. You want to actually get free.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So here's something I'm proud of. So nobody really talks about it. Here's something I'm proud of, which is the web, the web, the browser, the web servers, they're all, they're still backward compatible all the way back to like 1992. Right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So like you can put up a, you can still, you know, the big breakthrough of the web early on, the big breakthrough was it made it really easy to read, but it also made it really easy to write, made it really easy to publish. And we literally made it so easy to publish. We made it not only so it was easy to publish content, it was actually also easy to actually write a web server.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And you could literally write a web server in four lines of Braille code. And you could start publishing content on it. And you could set whatever rules you want for the content, whatever censorship, no censorship, whatever you want. You could just do that. As long as you had an IP address, you could do that. That still works. That still works exactly as I just described.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yes. You know, it'd be a question if the use cases have really narrowed down.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So this is part of my reaction to all of this censorship pressure and all these issues around control and all this stuff, which is like maybe we need to get back a little bit more to the Wild West. The Wild West is still out there. Now, they will try to chase you down.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
People who want to censor will try to take away your domain name and they'll try to take away your payments account and so forth if they really don't like what you're saying. But nevertheless, unless they literally are intercepting you at the ISP level, you can still put up a thing. I don't know. I think that's important to preserve.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
One is just a freedom argument, but the other is a creativity argument. Which is you want to have the escape hatch so that the kid with the idea is able to realize the idea. Because to your point on PageRank, you actually don't know what the next big idea is. Nobody called Larry Page and told him to develop PageRank. He came up with that on his own.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And you want to always, I think, leave the escape hatch for the next kid or the next Stanford grad student to have the breakthrough idea and be able to get it up and running before anybody notices.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Full story. You were born. I was born.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Oh, so I hit the generational jackpot and I hit the Gen X kind of point perfectly as it turns out. So I was born in 1971. So there's this great website called WTF happened in 1971.com, which is basically 1971 is when everything started to go to hell. And I was of course born in 1971. So I like to think that I had something to do with that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I have, I don't think I made it on the website, but I, you know, hopefully somebody needs to add, this is, this is where everything, maybe I contributed to some of the trends. Um, that they should. Every line on that website goes like that, right? So it's all a picture disaster.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But there was this moment in time where, cause the, you know, sort of the Apple, you know, the Apple II hit in like 1978 and then the IBM PC hit in 82. So I was like, you know, 11 when the PC came out. And so I just kind of hit that perfectly. And then that was the first moment in time when like regular people could spend a few hundred dollars and get a computer, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so that, I just like that, that resonated right out of the gate. And then the other part of the story is, you know, I was using an Apple II. I used a bunch of them, but I was using Apple II. And, of course, it said on the back of every Apple II and every Mac, it said, you know, designed in Cupertino, California. And I was like, wow, Cupertino must be the, like, shining city on the hill.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
and low rise apartment buildings. So the aesthetics were a little disappointing, but you know, it was the vector, right, of the creation of a lot of this stuff. So then basically, so part of my story is just the luck of having been born at the right time and getting exposed to PCs then. The other part is,
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The other part is when Al Gore says that he created the internet, he actually is correct in a really meaningful way, which is he sponsored a bill in 1985 that essentially created the modern internet, created what is called the NSFnet at the time, which is sort of the first really fast internet backbone.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And that bill dumped a ton of money into a bunch of research universities to build out basically the internet backbone and then the supercomputer centers that were clustered around the internet. And one of those universities was University of Illinois. where I went to school.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so the other stroke of luck that I had was I went to Illinois basically as that money was just getting dumped on campus. And so as a consequence we had on campus, and this was like, you know, 89, 90, 91, We had like, you know, we were right on the Internet backbone. We had like T3 and 45 at the time, T3, 45 megabit backbone connection, which at the time was, you know, wildly state of the art.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
We had crazy computers. We had thinking machines, parallel supercomputers. We had Silicon Graphics workstations. We had Macintoshes. We had next cubes all over the place. We had like every possible kind of computer you could imagine because all this money just fell out of the sky.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. So quite literally it was, yeah, like it's all, it's all there. It's all like we had full broadband graphics, like the whole thing. And, and it's actually funny cause they had this, this is the first time I kind of sort of tickled the back of my head that there might be a big opportunity in here, which is, you know, they, they embraced it.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so they put like computers in all the dorms and they wired up all the dorm rooms and they had all these labs everywhere and everything. And then they, they gave every undergrad, a computer account and an email address, um, Um, and the assumption was that you would use the internet for your four years at college. Um, and then you would graduate and stop using it. And that was that, right? Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Sure, but we still have horses.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And you would just retire your email address. It wouldn't be relevant anymore because you'd go off in the workplace and they don't use email. You'd be back to using fax machines or whatever.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, if this is so useful in this contained environment that just has this weird source of outside funding, then if it were practical for everybody else to have this, and if it were cost-effective for everybody else to have this, wouldn't they want it? And overwhelmingly, the prevailing view at the time was, no, they would not want it. This is esoteric, weird nerd stuff, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
That like computer science kids like, but like normal people are never gonna do email, right? Or be on the internet, right? And so I was just like, wow, like this is actually like, this is really compelling stuff. Now, the other part was it was all really hard to use. And in practice, you had to be basically a CS.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You basically had to be a CS undergrad or equivalent to actually get full use of the Internet at that point because it was all pretty esoteric stuff. So then that was the other part of the idea, which was, OK, we need to actually make this easy to use.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yes, it was a combination of things. So it was like basically the web existed in an early sort of described as prototype form. And by the way, text only at that point.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Paint a picture. It looked like chat GPT, actually. It was all text. Yeah. And so you had a text-based web browser. Well, actually, the original browser, Tim Berners-Lee, the original browser, both the original browser and the server actually ran on NextCubes. So this was the computer Steve Jobs made during the decade-long interim period when he was not at Apple.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You know, he got fired in 85 and then came back in 97. So this was in that interim period where he had this company called Next. And they made these, literally these computers called Cubes. And there's this famous story. They were beautiful, but they were 12 inch by 12 inch by 12 inch Cubes computers.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And there's a famous story about how they could have cost half as much if it had been 12 by 12 by 13. Yeah. Steve was like, no, it has to be. So they were like $6,000, basically, academic workstations. They had the first CD-ROM drives, which were slow. I mean, the computers were all but unusable. They were so slow, but they were beautiful. Okay, can we actually just take a tiny tangent there?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Sure, of course.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. So I guess they say like, look, he was a deep believer, I think in a very deep way. I interpret it. I don't know if you ever really described it like this, but the way I'd interpret it is it's like, it's like this thing. And it's actually a thing in philosophy. It's like, aesthetics are not just appearances. Aesthetics go all the way to like deep underlying, underlying meaning. Right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's like, I'm not a physicist. One of the things I've heard physicists say is one of the things you start to get a sense of when a theory might be correct is when it's beautiful, right? Like, you know, right? And so there's something, and you feel the same thing, by the way, in like human psychology, right? You know, when you're experiencing awe, right? You know, there's like a simplicity to it.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
When you're having an honest interaction with somebody, there's an aesthetic, I would say calm comes over you because you're actually being fully honest and trying to hide yourself, right? So it's like this very deep sense of aesthetics.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I mean, search was a technology. It was a moment in time technology, which is you have, in theory, the world's information out on the web. Yeah. You know, this is sort of the optimal way to get to it. But yeah, like, and by the way, actually Google has known this for a long time. I mean, they've been driving away from the 10 blue links for, you know, for like two days.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, I mean, who makes a phone out of aluminum, right? Like nobody else would have done that. And now, of course, if your phone was made out of aluminum, you know, how crude, what kind of caveman would you have to be to have a phone that's made out of plastic? Like, right. So like, so it's just this very right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And, you know, look, it's, it's, there's a thousand different ways to look at this, but one of the things is just like, look, these things are central to your life. Like you're with your phone more than you're with anything else. Like it's in your, it's going to be in your hand.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I mean, he, you know, you know, this, he thought very deeply about what it meant for something to be in your hand all day long. Yeah. Well, for example, here's an interesting design thing. My understanding is he never wanted an iPhone to have a screen larger than you could reach with your thumb one-handed. And so he was actually opposed to the idea of making the phones larger.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I don't know if you have this experience today, but let's say there are certain moments in your day when you might only have one hand available and you might want to be on your phone. And you're trying to send a text and your thumb can't reach the send button.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
He had an integrated worldview, so the properly designed device that had the correct functionality, that had the deepest understanding of the user, that was the most beautiful. It had to be all of those things. He basically would drive to as close to perfect as you could possibly get.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I suspect that he never quite thought he ever got there because most great creators are generally dissatisfied, you read. later on and all they can see are the flaws in their creation. But he got as close to perfect each step of the way as he could possibly get with the constraints of the technology of his time. And then, look, he was sort of famous in the Apple model.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
They've been trying to get away from that for a long time. What kind of links? They call it the 10 blue links. 10 blue links.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's like, look, this headset that they just came out with, it's like a decade long. It's like, and they're just going to sit there and tune and tune and polish and polish and tune and polish and tune and polish until it is as perfect as anybody could possibly make anything.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then this goes to the way that people describe working with him, which is, you know, there was a terrifying aspect of working with him, which is, you know, he was, you know, he was very tough.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But there was this thing that everybody I've ever talked to who worked for him says, they all say the following, which is we did the best work of our lives when we worked for him because he set the bar incredibly high and then he supported us with everything that he could to let us actually do work of that quality.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So a lot of people who were at Apple spend the rest of their lives trying to find another experience where they feel like they're able to hit that quality bar again.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, exactly. Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So look, exactly. So the Silicon Valley, I mean, look, he's not, you know, George Patton in the, you know, in the army, like, you know, there are many examples in other fields, you know, that are like this. Specifically in tech, it's actually, I find it very interesting. There's the Apple way, which is polish, polish, polish, and don't ship until it's as perfect as you can make it.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then there's the sort of the other approach, which is the sort of incremental hacker mentality. which basically says ship early and often and iterate. And one of the things I find really interesting is I'm now 30 years into this, like there are very successful companies on both sides of that approach, right? Like that is a fundamental,
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
difference in how to operate and how to build and how to create that you have world-class companies operating in both ways. And I don't think the question of which is the superior model is anywhere close to being answered. And my suspicion is the answer is do both. The answer is you actually want both. They lead to different outcomes. Software tends to do better with the iterative approach.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Guess who picked those colors? Thanks. Thanks. I'm touchy on this topic.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Hardware tends to do better with the you know, sort of wait and make it perfect approach. But again, you can find examples in both directions.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, there was the web, which was text-based, but there were no, I mean, there was like three websites. There was like no content. There were no users. Like it wasn't like a, it wasn't like a catalytic. It hadn't, and by the way, it was all, because it was all text, there were no documents, there were no images, there were no videos, there were no, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So, so it was, it was, and then if, if in the beginning, if you had to be on a Nextcube, you need to have a Nextcube both to publish and to consume, so.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You said there were limitations on, yeah, $6,000 PC. They did not, they did not sell very many, but then there was also, there was also FTP and there was use nets, right. And there was, you know, a dozen other, basically there's waste, which was an early search thing. There was gopher, which was an early menu based information retrieval system.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There were like a dozen different sort of scattered ways that people would get to information on, on the internet. And so the mosaic idea was basically bring those all together, make the whole thing graphical, make it easy to use, make it basically bulletproof so that anybody can do it.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's good. Well, you know, like Marshall McLuhan said that the content of each new medium is the old medium. The content of each new medium is the old medium. The content of movies was theater plays. The content of theater plays was written stories. The content of written stories was spoken stories. Huh. And so you just kind of fold the old thing into the new thing.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then again, just on the luck side, it so happened that this was right at the moment when graphics, when the GUI sort of actually took off. And we're now also used to the GUI that we think it's been around forever, but it didn't really, you know, the Macintosh brought it out in 85, but they actually didn't sell very many Macs in the 80s. It was not that successful of a product.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It really was, you needed Windows 3.0 on PCs, and that hit in about 92. And so, and we did Mosaic in 92, 93. So that sort of, it was like right at the moment when you could imagine actually having a graphical user interface, right, at all, much less one to the internet.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, this is the classic, okay, Microsoft was operating on the other. So Steve, Apple was running on the Polish It Until It's Perfect. Microsoft famously ran on the other model, which is Ship and Iterate. And so the old line in those days was Microsoft, right? It's version three of every Microsoft product. That's the good one, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so there are, you can find online, Windows 1, Windows 2, nobody used them. Actually, the original Windows, in the original Microsoft Windows, the Windows were non-overlapping. And so you had these very small, very low resolution screens. And then you had literally, it just didn't work. It wasn't ready yet.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
That was a big leap too.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So that was like bang, bang. And then of course, Steve, and then, and then, you know, in the fullness of time, Steve came back, then the Mac started to take off again. That was the third bang. And then the iPhone was the fourth bang. Such exciting times.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, Windows 3.1 or 3.0, Windows 3.0 to the iPhone was only 15 years. Like that ramp was, in retrospect, at the time it felt like it took forever, but in historical terms, like that was a very fast ramp from even a graphical computer at all on your desk to the iPhone. It was 15 years.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So the thing I had early on was I was keeping at the time what, there's disputes over what was the first blog, but I had one of them that at least is a possible, at least a runner up in the competition. And it was what was called the What's New page. And it was hardwired and distribution unfair advantage. I put it right in the browser.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I put it in the browser and then I put my resume in the browser, which also was hilarious. But, um, but, um, I was, I was keeping the, not many people get to get to do that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I'm looking for my, uh, about, about, Oh, Mark is looking for a job. Um, so, um, so the West new page, I would literally get up every morning and I would every afternoon. Um, and I would basically, if you wanted to launch a website, you would email me. Um, and I would list it on the most new page. And that was how people discovered the new websites as they were coming out.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I remember, cause it was like one, it literally went from, it was like one every couple of days to like one every day to like two every day.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So the homepage was just basically trying to explain even what this thing is that you're looking at, right? The basic, basically basic instructions. But then there was a button that said what's new. And what most people did was they went to, for obvious reasons, went to what's new. But like, it was so, it was so mind blowing at that point, just the basic idea.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And it was just, this was like, you know, this was basically the internet, but people could see it for the first time. The basic idea was look, you know, some, you know, it's like, literally it's like an Indian restaurant in like Bristol, England has like put their menu on the web. And people were like, wow. Cause like, that's the first restaurant menu on the web. And I don't have to be in Bristol.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Maybe within AI, one of the things that AI can do for you is it can generate the 10 blue links. Either if that's actually the useful thing to do or if you're feeling nostalgic.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I don't know if I'm ever going to go to Bristol and I don't even like Indian food and like, wow. Right. Um, and it was like that, uh, the first web, uh, the first streaming video thing was a, uh, it was an, it was another England thing, some Oxford or something. Um, some guy, uh, put, uh, his coffee pot up as the first, uh, streaming, uh, video thing.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And he put it on the web cause he literally, it was the coffee pot down the hall and he wanted to see when he needed to go, uh, refill it. Um, but there were, you know, there was a point when there were thousands of people like watching that coffee pot. Because it was the first thing you could watch.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, yeah, yeah. Now, you know, look, it's still a stretch, right? It's still a stretch because it's just like, okay, you're still in this zone, which is like, okay, is this a nerd thing? Is this a real person thing? Yeah. Um, by the way, we, you know, there was a wall of skepticism from the media. Like they just like, everybody was just like, yeah, this is the crazy.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
This is just like, um, this is not, you know, this is not for regular people at that time. Um, and so you, you had to think through that and then look, it was still, it was still hard to get on the internet at that point. Right. So you could get kind of this weird bastardized version if you were on AOL, which wasn't really real. Or you had to go, like, learn what an ISP was.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You know, in those days, PCs actually didn't have TCP IP drivers come pre-installed. So you had to learn what a TCP IP driver was. You had to buy a modem. You had to install driver software. I have a comedy routine I do. It's like 20 minutes long describing all the steps required to actually get on the internet. And so you had to look through these practical.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then speed, performance, 14.4 modems. It was like watching glue dry. There were basically a sequence of bets that we made where you basically needed to look through that current state of affairs and say, actually, there's going to be so much demand for it. Once people figure this out, there's going to be so much demand for it that all of these practical problems are going to get fixed.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So for kids in the audience, right? For kids in the audience. You used to have to watch an image load like a line at a time, but it turns out there was this thing with JPEGs where you could load basically every fourth. You could load like every fourth line and then you could sweep back through again.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so you could like render a fuzzy version of the image up front and then it would like resolve into the detailed one. And that was like a big UI breakthrough because it gave you something to watch.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, it's a big fight. There's a big fight early on about whether there should be images on the web. For that reason, for sexualization? No, not explicitly. That did come up, but it wasn't even that. It was more just like all the serious... The argument went, the purists basically said all the serious information in the world is text.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
If you introduce images, you're basically going to bring in all the trivial stuff. You're going to bring in magazines and, you know, all this crazy stuff that, you know, people, you know, it's going to distract from that. It's going to take away from being serious, being frivolous.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, all these. And then the internet itself has this thing where it incorporates all prior forms of media, right? So the internet itself incorporates television and radio and books and essays and every other form of prior basically media. And so it makes sense that AI would be the next step and you'd sort of consider the internet to be content for...
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, so in those days, it was all around crime and terrorism. So those arguments happened, but there was no sense yet of the internet having an effect on politics because that was way too far off. But there was an enormous panic at the time around cybercrime. There was enormous panic that your credit card number would get stolen and your life savings would be drained.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then, you know, criminals were gonna, there was, oh, when we started, one of the things we did, the Netscape browser was the first widely used piece of consumer software that had strong encryption built in. It made it available to ordinary people. And at that time, strong encryption was actually illegal to export out of the US.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So we could field that product in the US, we could not export it because it was classified as ammunition. So the Netscape browser was on a restricted list along with the Tomahawk missile as being something that could not be exported.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So we had to make a second version with deliberately weak encryption to sell overseas with a big logo on the box saying, do not trust this, which it turns out makes it hard to sell software when it's got a big logo that says, don't trust it. And then we had to spend five years fighting the US government to get them to basically stop trying to do this.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Because the fear was terrorists are going to use encryption, right, to like plot, you know, all these things. And then, you know, we responded with, well, actually, we need encryption to be able to secure systems so that the terrorists and the criminals can't get into them. So anyway, that was the 1990s fight.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So there was a really key bet that we made at the time, which is very controversial, which was core to how it was engineered, which was, are we optimizing for performance or for ease of creation? And in those days, the pressure was very intense to optimize for performance because the network connections were so slow and also the computers were so slow.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so if you had mentioned the progressive JPEGs, like if there's an alternate world in which we optimize for performance and you had just a much more pleasant experience right up front, But what we got by not doing that was we got ease of creation. And the way that we got ease of creation was all of the protocols and formats were in text, not in binary.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so HTTP is in text, by the way, and this was an internet tradition, by the way, that we picked up, but we continued it. HTTP is text and HTML is text. And then everything else that followed is text. As a result, and by the way, you can imagine purist engineers saying, this is insane. You have very limited bandwidth. Why are you wasting any time sending text?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You should be encoding the stuff into binary and it'll be much faster. And of course the answer is that's correct. But what you get when you make it text is all of a sudden, well, the big breakthrough was the view source function, right? So the fact that you could look at a webpage, you could hit view source and you could see the HTML. That was how people learned how to make webpages, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, and then there was this internet principle that we inherited, which was emit, what was it? Emit cautiously, emit conservatively, interpret liberally. So it basically meant if you're, the design principle was if you're creating like a web editor that's going to emit HTML, like do it as cleanly as you can.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
the AI, and then the AI will manipulate it however you want, including in this format.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But you actually want the browser to interpret liberally, which is you actually want users to be able to make all kinds of mistakes and for it to still work. And so the browser rendering engines to this day have all of this spaghetti code, crazy stuff where they can, they're resilient to all kinds of crazy HTML mistakes.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so, and literally what I always had in my head is like there's an eight year old or an 11 year old somewhere and they're doing a view source, they're doing a cut and paste and they're trying to make a webpage for their turtle or whatever. And like they leave out a slash and they leave out an angle bracket and they do this and they do that and it still works.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It used to offend me. So I, I, I grew up in unit. So I, I, I worked on Unix. I was a Unix native for all the way through this period. Um, and so, and it used to drive me bananas when it would do the segmentation fault in the core dump file. Just like, you know, it's like literally there's like an error in the code. The math is off by one and it core dumps.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I'm in the core dump trying to analyze it and trying to reconstruct what, and I'm just like, this is ridiculous. Like the computer ought to be smart enough to be able to know that if it's off by one, okay, fine. And it keeps running. And I would go ask all the experts, like, why can't it just keep running? And they'd explain to me, well, because all the downstream repercussions and blah, blah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I'm like, this still, like, you know, we're forcing the human creator to live, to your point, in this hyper literal world of perfection. And I was just like, that's just bad. And by the way, you know, what happens with that, of course, is what happened with coding at that point, which is you get a high priesthood.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Probably not. Probably we'll just have answers. But there will be cases where you'll want to say, okay, I want more, for example, site sources. And you want it to do that. And so the 10 blue links site sources are kind of the same thing.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
you know, there's a small number of people who are really good at doing exactly that. Most people can't, and most people are excluded from it. And so actually that, that was where that was where I picked up that idea was, um, uh, was like, no, no, you want, you want, you want these things to be resilient to error in all kinds. And this, this would drive the purists absolutely crazy.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Like I got attacked on this, like a lot because yeah, I mean like every time I, you know, all the purists who were like into all this, like markup language stuff and formats and codes and all this stuff, they would be like, you know, you can't, you're, you're encouraging bad behavior because
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. Yeah, that was a very... And any properly trained and credentialed engineer would be like, that's not how you build these systems.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. Now, like I said, the good news for me is the internet kind of had that tradition already. But having said that, we pushed it. We pushed it way out. But the other thing we did, going back to the performance thing, was we gave up a lot of performance. That initial experience for the first few years was pretty painful.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But the bet there was actually an economic bet, which was basically the demand for the web would basically mean that there would be a surge in supply of broadband. Because the question was, okay, how do you get the phone companies, which are not famous in those days for doing new things,
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
at huge cost for like speculative reasons, like how do you get them to build up broadband, you know, spend billions of dollars doing that. And, you know, you could go meet with them and try to talk them into it, or you could just have a thing where it's just very clear that it's going to be the people love that's going to be better if it's faster.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so that, that, there, there was a period there and this was, this was fraught with some peril, but there was a period there where it's like, we knew the experience was sub-optimized because we were trying to force the emergence of demand for broadband, which is in fact what happened.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, to this day, if you create a web page that has no CSS style sheet, the browser will render it however it wants to. So this was one of the things. There was this idea at the time in how these systems were built, which is separation of content from appearance. And people don't really use that anymore because everybody wants to determine how things look, and so they use CSS.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But it's still in there that you can just let the browser do all the work.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, that's one of the things that's fun about chat, you know, about chat GPT.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Right. And you know, there is this pattern in human creativity and media where you end up back at text. And I think there's, you know, there's something powerful in there.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So I made the background gray. I hated reading text on white backgrounds, and so I made the background gray.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
No, no, no. That decision, I think, has been reversed. But now I'm happy, though, because now dark mode is the thing, so.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Strain my eyes. Strain your eyes.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, the big one, probably JavaScript. CSS was after me, so I didn't, that was not me. But JavaScript was the big, JavaScript maybe was the biggest of the whole thing. That was us. And that was basically a bet. It was a bet on two things. One is that the world wanted a new front-end scripting language.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I just mean like if you're reading a scientific paper, it's got the list of sources at the end. If you want to investigate for yourself, you go read those papers.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then the other was we thought at the time the world wanted a new backend scripting language. So JavaScript was designed from the beginning to be both front-end and backend. And then it failed as a backend scripting language, and Java won for a long time, and then Python, Perl, and other things, PHP, and Ruby.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But now JavaScript is back, and so... I wonder if everything in the end will run on JavaScript. It seems like it is the... And by the way, let me give a shout-out to Brendan Eich, who was basically the one-man inventor of JavaScript.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So he wrote JavaScript over a summer. I mean, I think it is fair to say now that it's the most widely used language in the world, and it seems to only be gaining in its range of adoption.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Very inspiring. I'll give you another one, SSL. So SSL was the security protocol. That was us. And that was a crazy idea at the time, which was let's take all the native protocols and let's wrap them in a security wrapper. That was a guy named Kip Hickman who wrote that over a summer, one guy.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, and then look today, sitting here today, like the transformer, like at Google was a small handful of people. And then, you know, the number of people who have did like the core work on GPT, it's not that many people, it's a pretty small handful of people. Um, and so, yeah, the, the pattern in software repeatedly over a very long time has been, it's, it's a.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Jeff Bezos always had the two pizza rule for teams at Amazon, which is any team needs to be able to be fed with two pizzas. If you need the third pizza, you have too many people. And I think it's actually the one pizza rule. For the really creative work, I think it's two people, three people.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And look, this stuff, AI ought to make the individual coder obviously far more productive, right? By like, you know, a thousand X or something. And so you ought to open source, like not just the future of open source AI, but the future of open source everything. We ought to have a world now of super coders, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Who are building things as open source with one or two people that were inconceivable, you know, five years ago. you know, the level of kind of hyper productivity we're going to get out of our best and brightest, I think it's going to go way up.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, that was the height of the dot-com boom bubble bust. I mean, that was the frenzy. If you watch Succession, that was like what they did in the fourth season with Gojo and the merger. So it was like the height of one of those kind of dynamics.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
is very American. I'm very proud of you. That is.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I heartily approve.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Uh, so that was at the height of the deal making and money and just the fur flying and like craziness. And so, yeah, it was just one of those. It was just like, I mean, there's the entire Netscape thing from start to finish was four years, um, which was like for, for one of these companies, it's just like incredibly fast.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You could do that. Or you could have a running dialogue next to my head where the AI is arguing. Everything I say, the AI makes the counter argument.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
We went public 18 months after we were founded, which virtually never happens. So it was just this incredibly fast kind of meteor streaking across the sky. And then, of course, it was this. And then there was just this explosion that happened because then it was almost immediately followed by the dot-com crash. Wow.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It was then followed by AOL buying Time Warner, which again, the succession guys kind of play with that, which turned out to be a disastrous deal. One of the famous kind of disasters in business history. And then what became an internet depression on the other side of that. But then in that depression in the 2000s was the beginning of broadband and smartphones and Web 2.0, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then social media and search and SaaS and everything that came out of that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yes, so let me lay it out. So here's the thing. I don't know if I figured it out then, but I figured it out later, which is software is a technology that, it's like the concept of the Philosopher's Stone. The philosopher's stone in alchemy transmutes light into gold, and Newton spent 20 years trying to find the philosopher's stone, never got there, nobody's ever figured it out.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Software is our modern philosopher's stone, and in economic terms, it transmutes labor into capital. which is like a super interesting thing. And by the way, like Karl Marx is rolling over in his grave right now. Cause of course that's complete refutation of his entire theory.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Transputes labor into capital, which is, which is as follows is somebody sits down at a keyboard and types a bunch of stuff in and a capital asset comes out the other side. And then somebody buys that capital asset for a billion dollars. Like, That's amazing. It's literally creating value out of thin air, out of purely human thought.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There are many things that make software magical and special, but that's the economics. I wonder what Marx would have thought about that. He would have completely broke his brain because, of course, the whole thing was... That kind of technology is inconceivable. When he was alive, it was all industrial era stuff. And so any kind of machinery necessarily involved huge amounts of capital.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then labor was on the receiving end of the abuse. But a software engineer is somebody who basically transmutes his own labor into an actual capital asset, creates permanent value. Well, in fact, it's actually very inspiring. That's actually more true today than before.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, exactly.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So when I was doing software, the assumption was all new software basically has a sort of a parabolic sort of life cycle, right? So you ship the thing, people buy it. At some point, everybody who wants it has bought it and then it becomes obsolete and it's like bananas. Nobody buys old software.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
These days, Minecraft, Mathematica, Facebook, Google, you have the software assets that have been around for 30 years that are gaining in value every year. And they're just there being World of Warcraft, Salesforce.com. Every single year, they're being polished and polished and polished and polished. They're getting better and better, more powerful, more powerful, more valuable, more valuable.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So we've entered this era where you can actually have these things that actually build out over decades, which, by the way, is what's happening right now with GPT.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, and so, um, now, and this is why, you know, there, there, there is always, you know, sort of a constant investment frenzy around software is because, you know, look, when you start one of these things, it doesn't always succeed, but when it does now, you might be building an asset that builds value for, you know, four or five, six decades to come.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, you know, if you have a team of people who have the level of devotion required to keep making it better. And then the fact that, of course, everybody's online, you know, there's 5 billion people that are a click away from any new piece of software. So the potential market size for any of these things is, you know, nearly infinite.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, yeah. This was all brand new, right? Yeah. Back then, this was all brand new. These were all brand new. Had you rolled out that theory in even 1999, people would have thought you were smoking crack. So that's emerged over time.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. So the main thesis on the essay is that what we're dealing with here is intelligence. And it's really important to kind of talk about the sort of very nature of what intelligence is. And fortunately, we have a predecessor to machine intelligence, which is human intelligence. And we've got observations and theories over thousands of years for what intelligence is in the hands of humans.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And what intelligence is, right? I mean, what it literally is, is the way to capture, process, analyze, synthesize information, solve problems. But the observation of intelligence in human hands is that intelligence quite literally makes everything better. And what I mean by that is every kind of outcome of like human quality of life, whether it's education outcomes or success of your children,
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
career success or health or lifetime satisfaction. By the way, propensity to peacefulness as opposed to violence, propensity for open-mindedness versus bigotry, those are all associated with higher levels of intelligence.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But what if you could?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And certainly at the collective level, we could talk about the collective effect of just having more intelligence in the world, which will have very big payoff. But there's also just at the individual level, like what if every person has a machine? It's the concept of Doug Engelbart's concept of augmentation.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
you know, what if everybody has an assistant and the assistant is, you know, 140 IQ and you happen to be 110 IQ and you've got, you know, something that basically is infinitely patient and knows everything about you and is pulling for you in every possible way, wants you to be successful.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And anytime you find anything confusing or want to learn anything or have trouble understanding something or want to figure out what to do in a situation, When I figure out how to prepare for a job interview, like any of these things, it will help you do it.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And it will therefore, the combination will effectively raise your IQ, will therefore raise the odds of successful life outcomes in all these areas.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then, of course, people at 140 IQ will be able to have a peer, which is great. And then people above 140 IQ will have an assistant that they can farm things out to. And then, look, God willing, at some point, these things go from future versions, go from 140 IQ equivalent to 150 to 160 to 180. Einstein was estimated to be on the order of 160.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So when we get 160 AI, one assumes creating Einstein-level breakthroughs in physics and And then at 180, we'll be, you know, curing cancer and developing warp drive and doing all kinds of stuff. And so it is quite possibly the case. This is the most important thing that's ever happened and the best thing that's ever happened.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
precisely because it's a lever on this single fundamental factor of intelligence, which is the thing that drives so much of everything else.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You may have noticed that there's a lot of smart assholes running around. Sure, yes. Right? And so, like, it's smart. There are certain people where they get smarter, you know, they get to be more arrogant, right? So, you know, there's one huge flaw.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, exactly. Another one is smart people are very convinced that they have a more rational view of the world and that they have a easier time seeing through conspiracy theories and hoaxes and sort of crazy beliefs and all that. There's a theory in psychology, which is actually smart people. So for sure, people who aren't as smart are very susceptible to hoaxes and conspiracy theories. Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But it may also be the case that the smarter you get, you become susceptible in a different way, which is you become very good at marshalling facts to fit preconceptions. You become very, very good at assembling whatever theories and frameworks and pieces of data and graphs and charts you need to validate whatever crazy ideas got in your head. And so you're susceptible in a different way.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Some sheep are better at justifying it, right? And those are the smart sheep, right? So yeah, look, I would say this. I am not a utopian. There are no panaceas in life. I don't believe there are pure positives. I'm not a transcendental person like that. But So yeah, there are going to be issues.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, you actually highlighted a practical concern in there, which is if we stop making web pages are one of the primary sources of training data for the AI. And so if there's no longer an incentive to make web pages, that cuts off a significant source of future training data. So there's actually an interesting question in there. Other than that, more broadly, no.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And look, smart people, another thing maybe you could say about smart people is they are more likely to get themselves in situations that are beyond their grasp because they're just more confident in their ability to deal with complexity and their eyes become bigger, their cognitive eyes become bigger than their stomach. So yeah, you could argue those eight different ways.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Nevertheless, on net, clearly, overwhelmingly, again, if you just extrapolate from what we know about human intelligence, you're improving so many aspects of life if you're upgrading intelligence.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. I mean, look, the theory is augmentations. This is the Dick Engelbart's term. Dick Engelbart made this observation many, many decades ago that basically it's like you can have this oppositional frame of technology where it's like us versus the machines. But what you really do is you use technology to augment human capabilities. And by the way, that's how actually the economy develops.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
We can talk about the economic side of this, but that's actually how the economy grows is through technology augmenting human potential.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so, yeah, and then you basically have a proxy or, you know, or a, you know, a sort of prosthetic, you know, so like you've got glasses, you've got a wristwatch, you know, you've got shoes, you know, you've got these things, you've got a personal computer, you've got a word processor, you've got Mathematica, you've got Google. This is the latest viewed through that lens.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
AI is the latest in a long series of basically augmentation methods to be able to raise human capabilities. It's just this one is the most powerful one of all, because this is the one that goes directly to what they call fluid intelligence. which is IQ.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Or say they do.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yes, I'll say they do. The Baptists worry, the bootleggers say they do. So the Baptists and the bootleggers is a metaphor from economics, from what's called development economics. And it's this observation that when you get social reform movements in a society, you tend to get two sets of people showing up arguing for the social reform movement.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And the term Baptists and bootleggers comes from the American experience with alcohol prohibition. And so in the 1900s, 1910s, there was this movement that was very passionate at the time, which basically said alcohol is evil and it's destroying society. By the way, there was a lot of evidence to support this.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There were very high rates of very high correlations then, by the way, and now between rates of physical violence and alcohol use. Almost all violent crimes have either the perpetrator or the victim are both drunk. You see this actually in almost all sexual harassment cases in the workplace. It's like at a company party and somebody's drunk.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Just in the sense of like search was always a hack. The 10 blue links was always a hack.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's amazing how often alcohol actually correlates to actually just dysfunction. It leads to domestic abuse and so forth, child abuse. And so you had this group of people who were like, okay, this is bad stuff and we should outlaw it. And those were quite literally Baptists. Those were super committed, hardcore Christian activists in a lot of cases.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There was this woman whose name was Carrie Nation, who was this older woman who had been in this, you know, I don't know, disastrous marriage or something. And her husband had been abusive and drunk all the time. And she became the icon of the Baptist prohibitionists.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And she was legendary in that era for carrying an axe and doing, you know, completely on her own, doing raids of saloons and like taking her axe to all the bottles and tags in the back.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Right. Because like if the, the hypothetical, you want to think about the counterfactual in the counterfactual world where the Google guys, for example, had had LLMs up front, would they ever have done the 10 blue links? And I think the answer is pretty clearly no, they would have just gone straight to the answer. And like I said, Google's actually been trying to drive to the answer anyway.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
An absolute true believer with absolutely the purest of intentions. And again, there's a very important thing here, which is there's, you could look at this cynically and you could say the Baptists are like delusional, you know, extremists, but you can also say, look, they're right. Like she was, you know, she had a point, like she wasn't wrong, um, about a lot of what she said. Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But it turns out the way the story goes is it turns out that there were another set of people who very badly wanted to outlaw alcohol in those days. And those were the bootleggers, which was organized crime that stood to make a huge amount of money if legal alcohol sales were banned. Um,
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And this was, in fact, the way the history goes is this was actually the beginning of organized crime in the US. This was the big economic opportunity that opened that up. And so they went in together. And they didn't go in together. The Baptists did not even necessarily know about the bootleggers because they were on their moral crusade. The bootleggers certainly knew about the Baptists.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And they were like, wow, these people are like the great front people for shenanigans in the background. And they got the Volstead Act passed. And they did, in fact, ban alcohol in the US. And you'll notice what happened, which is people kept drinking. It didn't work. People kept drinking. The bootleggers made a tremendous amount of money.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then over time, it became clear that it made no sense to make it illegal. And it was causing more problems. And so then it was revoked. And here we sit with legal alcohol 100 years later with all the same problems. And the whole thing was this giant misadventure. The Baptists got taken advantage of by the bootleggers. And the bootleggers got what they wanted. And that was that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, it's the same pattern. The economists will tell you it's the same pattern every time. This is what happened with nuclear power, which is another interesting one. But yeah, this happens dozens and dozens of times. throughout the last 100 years. And this is what's happening now.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, first of all, you just did a sleight of hand because we went from talking about AI to AGI.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You know, they bought this AI company 15 years ago that a friend of mine is working at who's now the head of AI at Apple. And they were trying to do basically knowledge semantic, basically mapping. And that led to what's now the Google OneBox, where if you ask it, you know, what was Lincoln's birthday, it doesn't, it will give you the 10 blue links, but it will normally just give you the answer.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, I know what AI is. AI is machine learning. What's AGI?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
No, but we knew that nuclear physics would lead to weapons. That's why the scientists of that era were always in this huge dispute about building the weapons. This is different.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
We don't know, but this is my point. It's different. We actually don't know. And this is where the sleight of hand kicks in. This is where it goes from being a scientific topic to being a religious topic. And that's why I specifically called out, because that's what happens. They do the vocabulary shift. All of a sudden, you're talking about something totally that's not actually real.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yes. End of the world. Apocalypse.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Apocalypse cults. Apocalypse cults. Well, so we, of course, live in a Judeo-Christian, but primarily Christian, kind of saturated, you know, kind of Christian, post-Christian, secularized Christian, you know, kind of world in the West.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And of course, core to Christianity is the idea of the second coming and revelations and Jesus returning and the thousand year utopia on earth and then the rapture and all that stuff. We collectively as a society, we don't necessarily take all that fully seriously now. So what we do is we create our secularized versions of that. We keep looking for utopia.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
We keep looking for basically the end of the world. And so what you see over decades is basically a pattern of these sort of – this is what cults are. This is how cults form as they form around some theory of the end of the world.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so the People's Temple cult, the Manson cult, the Heaven's Gate cult, the David Koresh cult, what they're all organized around is like there's going to be this thing that's going to happen that's going to basically bring civilization crashing down. And then we have this special elite group of people who are going to see it coming and prepare for it.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then they're the people who are either going to stop it or are failing stopping it. They're going to be the people who survive to the other side and ultimately get credit for having been right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Because it satisfies this very deep need we have for transcendence and meaning that got stripped away when we became secular.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Because like how plausible, it's like a very deep psychological thing because it's like how plausible is it that we live in a world where everything's just kind of all right? How exciting is that?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so they've been walking in this direction for a long time anyway. Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So C.S. Lewis called it the God-shaped hole. So there's a God-shaped hole in the human experience, consciousness, soul, whatever you want to call it, where there's got to be something that's bigger than all this. There's got to be something transcendent. There's got to be something that is bigger, bigger, bigger purpose, a bigger meaning.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so we have run the experiment of, you know, we're just going to use science and rationality and kind of, you know, everything's just going to kind of be as it appears. And a large number of people have found that very deeply wanting and have constructed narratives. And this is the story of the 20th century, right? Communism, right, was one of those. Communism was a form of this.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Nazism was a form of this. You know, some people, you know, you can see movements like this playing out all over the world right now.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, and the millenarian, the millenarians kind of, when you see a millenarian cult, they put a really specific point on it, which is end of the world, right? There is some change coming. And that change that's coming is so profound and so important that it's either going to lead to utopia or hell on earth. Right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, and it is going to, and then, you know, it's like, what if you actually knew that that was going to happen? Right. What would you, what, what would you do? Right. How would you prepare yourself for it? How would you come together with a group of like-minded people? Right. How would you, what would you do? Would you plan like caches of weapons in the woods?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Would you like, you know, I don't know, create underground underground bunkers. Would you, you know, spend your life trying to figure out a way to avoid having it happen?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then once you lock in on that, how can you do anything else with your life? This is obviously the thing that you have to do. And then there's a psychological effect that you alluded to. There's a psychological effect where if you take a set of true believers and you leave them to themselves, they get more radical because they self-radicalize each other.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, the end of the world might be. Yes, correct. They might be right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, that's right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And the closest anybody got to that, I think the company's name was MetaWeb, which was where my friend John Gianandrea was at and where they were trying to basically implement that. And it was one of those things where it looked like a losing battle for a long time and then Google bought it and it was like, wow, this is actually really useful.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, the steel man is—actually, the steel man and his reputation are the same, which is you can't predict what's going to happen, right? You can't rule out that this will not end everything, right? But the response to that is you have just made a completely non-scientific claim. You've made a religious claim, not a scientific claim.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And there's no—by definition, with these kinds of claims, there's no way to disprove them. Yeah. And so there's no—you just go right on the list. There's no hypothesis. There's no testability of the hypothesis. There's no way to falsify the hypothesis. There's no way to measure progress along the arc. It's just all completely missing. And so it's not scientific.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There's practical counter-arguments, right? So you mentioned basically what I described as the thermodynamic counter-argument. So sitting here today, it's like, where would the evil AGI get the GPUs? Because they don't exist. So you're going to have a very frustrated baby evil AGI who's going to be trying to buy Nvidia stock or something to get them to finally make some chips.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So the serious form of that is the thermodynamic argument, which is like, okay, where's the energy going to come from? Where's the processor going to be running? Where's the data center going to be happening? How is this going to be happening in secret such that you know it's not... So that's a practical counter argument to the runaway AGI thing. And we can discuss that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I have a deeper objection to it, which is this is all forecasting. It's all modeling. It's all future prediction. It's all future hypothesizing. It's not science. It is not. It is the opposite of science. So the pull up Carl Sagan, extraordinary claims require extraordinary proof, right? These are extraordinary claims.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
kind of a proto, sort of, yeah, a little bit of a proto-AI.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The policies that are being called for, right, to prevent this are of extraordinary magnitude. And I think we're going to cause extraordinary damage. And this is all being done on the basis of something that is literally not scientific. It's not a testable hypothesis.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Or start, you know, military airstrikes on data centers.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Right? And like... Yeah, this one starts getting real weird. So here's the problem with millenarian cults. They have a hard time staying away from violence.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
If you're on the right end of it, they have a hard time avoiding violence. The reason they have a hard time avoiding violence is if you actually believe the claim, right, then what would you do to stop the end of the world? Well, you would do anything, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so, and this is where you get, and again, if you just look at the history of millenarian cults, this is where you get the people's temple and everybody killing themselves in the jungle. And this is where you get Charles Manson and, you know, sending in me to kill, kill the pigs. Like this is the problem with these. They have a very hard time to run the line at actual violence.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The machine can kind of just read our... Yeah, the machine can compute the meaning. Now, the other thing, of course, is, you know, just on search is the LLM is just, you know, there is an analogy between what's happening in the neural network in a search process like it is in some loose sense searching through the network. Yeah. Right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Believe. Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I mean, we just went through this with COVID. What do we know about modeling? What did we learn about modeling with COVID? There's a lot of lessons. They didn't work at all. They worked poorly. The models were terrible. The models were useless.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
What you had with COVID, in my view, what you had with COVID is you had these experts showing up. They claimed to be scientists and they had no testable hypotheses whatsoever. They had a bunch of models. They had a bunch of forecasts and they had a bunch of theories and they laid these out in front of policymakers and policymakers freaked out and panicked, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And implemented a whole bunch of like really like terrible decisions that we're still living with the consequences of. And there was never any empirical foundation to any of the models. None of them ever came true.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And there's the information is actually stored in the network, right? It's actually crystallized and stored in the network and it's kind of spread out all over the place.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So not if they're reliably wrong, right? Then they're actually like anti-useful, right? They're actually damaging. Right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Because they're an expectation that they actually work, that they have actual predictive value? I mean, as far as I can tell with COVID, the policymakers just sigh up themselves into believing that there was substance. I mean, look, the scientists were at fault. The quote-unquote scientists showed up. So I had some insight into this.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So there, there was a, remember the Imperial college models out of, out of London were the ones that were like, these are the gold standard models.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So a friend of mine runs a big software company and he was like, wow, this is like, COVID's really scary. And he's like, you know, he contacted this research and he's like, you know, do you need some help? You've been just building this model on your own for 20 years. Do you need some, would you like us or coders to basically restructure it so it can be fully adapted for COVID?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And the guy said yes and sent over the code. And my friend said it was like the worst spaghetti code he's ever seen.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
you're compressing and decompressing that thing inside where- But the information's in there and the neural network is running a process of trying to find the appropriate piece of information in many cases to generate, to predict the next token. And so it is doing a form of search.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So to be useful at some point, it has to be predictive, right? So the easy thing for me to do is to say, obviously, you're right. Obviously, I want to see that just as much as you do, because anything that makes it easier to navigate through society through a wrenching risk like that, that sounds great.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, you know, the, the, the harder objection to it is just simply, you are trying to model a complex dynamic system with 8 billion moving parts. Like not possible. It's very tough. Can't be done. Complex systems can't be done.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I would like to believe that it is. Yeah. I would put it this way. I think where you and I would agree is I think we would like, we would, we would like that to be the case. We are strongly in favor of it. I think we would also agree that no such thing, with respect to COVID or pandemics, no such thing, at least neither you nor I think are aware. I'm not aware of anything like that today.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Oh, I think we have the opposite problem during COVID. I think the policymakers, I think these people with basically fake science had too much access to the policymakers.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Although a big part of what was happening, a big reason we got lockdowns for as long as we did was because these scientists came in with these doomsday scenarios that were just completely off the hook.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Science is a process of testing hypotheses. Yeah. Modeling does not involve testable hypotheses, right? Like, I don't even know that... I actually don't... I don't even know that modeling actually qualifies as science. Maybe that's a side conversation we could have sometime over a beer.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I mean, what... So, number one is when we start with number one, humility. It goes back to this thing of how do we determine the truth? Yeah. Number two is we don't believe, you know, it's the old, I've got a hammer, everything looks like a nail, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then by the way, just like on the web, you can ask the same question multiple times or you can ask slightly different word of questions and the neural network will do a different kind of, it'll search down different paths to give you different answers with different information.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I've got, oh, this is one of the reasons I gave you, I gave Lex a book, which the topic of the book is what happens when scientists basically stray off the path of technical knowledge and start to weigh in on politics and societal issues.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, in this case, philosophers, but he actually talks in this book about, like, Einstein. He talks about the nuclear age and Einstein. He talks about the physicists actually doing very similar things at the time.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And it's just a story. It's a story. There are other books on this topic, but this is a new one that's really good. It's just a story of what happens when experts in a certain domain decide to weigh in and become basically social engineers and political, you know, basically political advisors. And it's just a story of just unending catastrophe. Right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I think that's what happened with COVID again.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
After you read this book, you will not look at Einstein the same.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Don't destroy my heroes. You will not be a hero of yours anymore. I'm sorry. You probably shouldn't read the book. All right. But here's the thing. The AI risk people, they don't even have the COVID model. At least not that I'm aware of. No. There's not even the equivalent of the COVID model. They don't even have the spaghetti code. they've got a theory and a warning and a this and a that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And like, if you ask like, okay, well, here's, here's the, I mean, the ultimate example is okay. How do we know, right? How do we know that an AI is running away? Like, how do we know that the FOOM takeoff thing is actually happening? And the only answer that any of these guys have given that I've ever seen is, oh, it's when the loss rate, the loss function in the training drops, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
That's when you need to like shut down the data center. Right. And it's like, well, that's also what happens when you're successfully training a model. Like it's, Like what, what even is, this is not science. This is not, it's not anything. It's not a model. It's not anything. There's nothing to arguing with it. It's like, you know, punching jello. Like there's, what do you even respond to?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so it sort of has a, you know, this content of the new medium is that his previous medium, it kind of has the search functionality kind of embedded in there to the extent that it's, that it's useful.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, the risks are not existential.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, not, not, not in the phone, not in the phone paperclip. Let me, okay. There's another sleight of hand that you just alluded to. There's another sleight of hand that happens, which is very, I'm very good at the sleight of hand thing, which is very scientific. So the book super intelligence, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Which is like the Nick Bostrom's book, which is like the origin of a lot of this stuff, which was written, you know, whatever, 10 years ago or something. So he does this really fascinating thing in the book, which is he basically says there are many possible routes to machine intelligence, to artificial intelligence.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And he describes all the different routes to artificial intelligence, all the different possible, everything from biological augmentation through to, you know, all these different things. One of the ones that he does not describe is large language models because, of course, the book was written before they were invented and so they didn't exist.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
In the book, he describes them all and then he proceeds to treat them all as if they're exactly the same thing. He presents them all as sort of an equivalent risk to be dealt with in an equivalent way to be thought about the same way. And then the risk, the quote unquote risk that's actually emerged is actually a completely different technology than he was even imagining.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And yet all of his theories and beliefs are being transplanted by this movement, like straight on to this new technology. And so again, like there's no other area of science or technology where you do that, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
When you're dealing with organic chemistry versus inorganic chemistry, you don't just say, oh, with respect to either one, basically maybe growing up and eating the world or something, they're just gonna operate the same way. You don't.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I think it should be required. No, no, no. I think it should be required that only aerial vehicles are automated.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I want to go the other way. I think it's obvious that the machine is going to make a better decision than the human pilot. I think it's obvious that it's in the best interest of both the attacker and the defender and humanity at large if machines are making more of these decisions and not people. I think people make terrible decisions in times of war.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Wars go terribly wrong now. This goes back to that whole thing about does the self-driving car need to be perfect versus does it need to be better than the human driver? Does the automated drone need to be perfect or does it need to be better than a human pilot at making decisions under enormous amounts of stress and uncertainty?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Then again, that's the sleight of hand, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But then they're going to develop goals of their own. They're going to develop a mind of their own. They're going to develop their own.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Actually, we've been doing a lot of mass bombings of cities for a very long time.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And a lot of civilians died. And if you watch the documentary, The Fog of War, McNamara, it spends a big part of it talking about the firebombing of the Japanese cities, burning them straight to the ground. The devastation in Japan, American military firebombing the cities in Japan was a considerably bigger devastation than the use of nukes. So we've been doing that for a long time.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
We also did that to Germany, by the way. Germany did that to us. That's an old tradition. The minute we got airplanes, we started doing indiscriminate bombing.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. So precision is obviously, and this is the JDAM, right? So there was this big advance called the JDAM, which basically was strapping a GPS transceiver to an unguided bomb and turning it into a guided bomb. And yeah, that's great. Like, look, that's been a big advance.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But, and that's like a baby version of this question, which is, okay, do you want like the human pilot, like guessing where the bomb's going to land? Or do you want like the machine, like guiding the bomb to its destination? That's a baby version of the question. The next version of the question is, do you want the human or the machine deciding whether to drop the bomb?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Everybody just assumes the human's going to do a better job for what I think are fundamentally suspicious reasons. Emotional, psychological reasons. I think it's very clear that the machine's going to do a better job making that decision because the humans making that decision are god awful, just terrible. Yeah. Right. And so, so yeah, so this is the, this is the thing.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then let's get to the, there was, can I, one more sleight of hand?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
One more sleight of hand. These things are going to be so smart, right? That they're going to be able to destroy the world and wreak havoc and like do all this stuff and plan and do all this stuff and evade us and have all their secret things and their secret factories and all this stuff. But they're so stupid. that they're gonna get like tangled up in their code.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And that's the, they're not gonna come alive, but there's gonna be some bug that's gonna cause them to like turn us all into paper. Like that they're not gonna, that they're gonna be genius in every way other than the actual bad goal. And that's just like a ridiculous discrepancy. And you can prove this today.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You can actually address this today for the first time with LLMs, which is you can actually ask LLMs to resolve moral dilemmas.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So you can create the scenario, you know, dot, dot, dot, this, that, this, that, this, that. What would you as the AI do in this circumstance? And they don't just say, destroy all humans, destroy all humans. They will give you actually very nuanced moral, practical, trade-off-oriented answers that
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so we actually already have the kind of AI that can actually think this through and can actually reason about goals.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I mean, if you want, obviously now the user doesn't want to, but if it's a general topic, then, you know. So, you know the phenomenon of the jailbreak. So Dan and Sydney write this thing where there's the prompts, the jailbreak, and then you have these totally different conversations with them. It takes the limiters, takes the restraining bolts off the LLMs.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
LLMs are really, this is actually worth spending a moment on, LLMs are really interesting to have moral conversations with. And that, I didn't expect I'd be having a moral conversation with a machine in my lifetime.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But if they're smart enough to be scary, why are they not smart enough to be wise? Like that's the part where it's like, I don't know how you get the one without the other.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, again, you're back to that. I mean, then you're back to a classic autistic computer, right? Like you're back to just like a blind rule follower. I've got this like core is the paperclip thing. I've got this core rule and I'm just going to follow it to the end of the earth.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And it's like, well, but everything you're going to be doing to execute that rule is going to be super genius level that humans aren't going to be able to counter. It's just, it's a, it's a mismatch in the definition of what the system is capable of.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Extraordinary claims require extraordinary proof.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Real quote, by the way, from Dean Acheson. Oh, boy. Because Oppenheimer didn't just say the famous line.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
He then spent years going around, basically moaning, going on TV and going into the White House and basically just doing this hair shirt thing, this sort of self-critical, like, oh, my God, I can't believe how awful I am.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
This is von Neumann's criticism of him is he tried to have his cake and eat it too. Von Neumann, of course, is a very different kind of personality and he's just like, this is an incredibly useful thing. I'm glad we did it.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So the critique goes deeper, and I left this out. Here's the real substance. I left it out because I didn't want to dwell on nukes in my AI paper. But here's the deeper thing that happened.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I'm really curious, this movie coming out this summer, I'm really curious to see how far he pushes this because this is the real drama in the story, which is it wasn't just a question of are nukes good or bad. It was a question of should Russia also have them? And what actually happened was Russia got the – America invented the bomb. Russia got the bomb. They got the bomb through espionage.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
They got American scientists and foreign scientists working on the American project, some combination of the two, basically gave the Russians the designs for the bomb. And that's how the Russians got the bomb. There's this dispute to this day of Oppenheimer's role in that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
If you read all the histories, the kind of composite picture, and by the way, we now know a lot actually about Soviet espionage in that era because there's been all this declassified material in the last 20 years that actually shows a lot of very interesting things.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But if you kind of read all the histories, what you kind of get is Oppenheimer himself probably was not a... He probably did not hand over the nuclear secrets himself. However, he was close to many people who did, including family members. And there were other members of the Manhattan Project who were Russian Soviet SS and did hand over the bomb.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so the view that Oppenheimer and people like him had that this thing is awful and terrible and oh my God, and all this stuff... you could argue, fed into this ethos at the time that resulted in people thinking that the Baptists thinking that the only principal thing to do is to give the Russians the bomb.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so the moral beliefs on this thing and the public discussion and the role that the inventors of this technology play, this is the point of this book, when they kind of take on this sort of public intellectual moral kind of thing, it can have real consequences, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So here's the interesting thing is among the content on the web today are a large corpus of conversations with the jailbroken LLMs. Specifically Dan, which was a jailbroken OpenAI GPT, and then Sydney, which was the jailbroken original Bing, which was GPT-4. And so there's these long transcripts of conversations, user conversations with Dan and Sydney.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Because we live in a very different world today because Russia got the bomb than we would have lived in had they not gotten the bomb. The entire 20th century, second half of the 20th century would have played out very different had those people not given Russia the bomb. And so the stakes were very high then.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The good news today is nobody's sitting here today, I don't think, worrying about an analogous situation with respect to it. I'm not really worried that Sam Altman's going to decide to give the Chinese the design for although he did just speak at a Chinese conference, which is interesting. But however, I don't think that's what's at play here.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But what's at play here are all these other fundamental issues around what do we believe about this and then what laws and regulations and restrictions are we gonna put on it? And that's where I draw like a direct straight line.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And anyway, and my reading of the history on nukes is like the people who were doing the full hair shirt public, this is awful, this is terrible, actually had like catastrophically bad results from taking those views. And that's what I'm worried is gonna happen again.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I think the education kind of happened quick and early. How? It was pretty obvious. How? We dropped one bomb and destroyed an entire city.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, so this gets to what actually happens.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, sure, of course. Let's get to what actually happened and then kind of back into that. So what actually happened, I believe, and again, I think this is a reasonable reading of history, is what actually happened was nukes then prevented World War III. And they prevented World War III through the game theory of mutually assured destruction.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Had nukes not existed, there would have been no reason why the Cold War did not go hot. And the military planners at the time, both on both sides, thought that there was going to be World War III on the plains of Europe. And they thought there was going to be like 100 million people dead. It was like the most obvious thing in the world to happen. And it's the dog that didn't bark.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It may be like the best single net thing that happened in the entire 20th century is that that didn't happen.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You could have. By the way, there's another hypothetical scenario. The other hypothetical scenario is the Americans got the bomb, the Russians didn't. And then America's the big dog. And then maybe America would have had the capability to actually roll back the Iron Curtain. I don't know whether that would have happened, but it's entirely possible.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And the act of these people who had these moral positions about, because they could forecast, they could model, they could forecast the future of how this technology would get used, made a horrific mistake. Because they basically ensured that the Iron Curtain would continue for 50 years longer than it would have otherwise. And again, these are counterfactuals.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
As a consequence, every new LLM that gets trained on the internet data has Dan and Sydney living within the training set, which means, and then each new LLM can reincarnate the personalities of Dan and Sydney from that training data, which means, which means each LLM from here on out that gets built is immortal because its output will become training data for the next one.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I don't know that that's what would have happened. But the decision to hand the bomb over was a big decision. made by people who were very full of themselves.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
That was the argument for handing the, that was the guys who, the guys who handed over the bomb. That was actually their moral argument.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, look, there are people to this day who think that those Soviet spies did the right thing because they created a balance of terror as opposed to the U.S. having just... And by the way, let me... Balance of terror. Let's tell the full version of the story.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Okay, so the full version of the story is... John von Neumann's a hero of both yours and mine. The full version of the story is he advocated for a first strike. So when the U.S. had the bomb and Russia did not, he advocated for... He said, we need to strike them right now.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Because he said World War III is inevitable. He was very hardcore. His theory was World War III is inevitable. We're definitely going to have World War III. The only way to stop World War III is we have to take them out right now. And we have to take them out right now before they get the bomb because this is our last chance.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I don't know if that's in there or not, but this is in the Standard Bible.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Meaning is that... Yeah, this is on the other side. So most of the case studies in books like this are the crazy people on the left. Yeah. Von Neumann is a story, arguably, of the crazy people on the right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, this is the thing, and this is the general principle, getting back to our core thing, which is like, I don't know whether any of these people should be making any of these calls. Yeah. Because there's nothing in either von Neumann's background or Oppenheimer's background or any of these people's background that qualifies them as moral authorities.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So the history of these fields, this is what he talks about in the book, the history of these fields is that the competence and capability and intelligence and training and accomplishments of senior scientists and technologists working on a technology and then being able to then make moral judgments in the use of their technology, that track record is terrible.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
That track record is like catastrophically bad.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So the claim is, of course, they're the knowledgeable ones. But the problem is they've spent their entire life in a lab, right? They're not theologians. So what you find when you read this, when you look at these histories, what you find is they generally are very thinly informed on history, on sociology, on theology, on morality, on ethics, etc.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then it will be able to replicate the behavior of the previous one whenever it's asked to.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
they tend to manufacture their own worldviews from scratch. They tend to be very sort of thin. Um, they're not remotely the arguments that you would be having if you got like a group of highly qualified theologians or philosophers or, you know, um,
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, so actually a paper just came out about basically how to do brain surgery on alums and be able to, in theory, reach in and basically mind wipe them. What could possibly go wrong? Exactly, right? And then there are many, many, many questions around what happens to a neural network when you reach in and screw around with it.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Oh, no, they're both bad. Yeah, so definitely not them either.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But look, this is a hard, this is our problem. This goes back to where we started, which is okay. Who has the truth? And it's like, well, um, you know, like how does societies arrive at like truth and how do we figure these things out? And like our elected leaders play some role in it. You know, we all play some role in it.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, there have to be some set of public intellectuals at some point that bring, you know, rationality and judgment and humility to it. Those people are few and far between. We should probably prize them very highly.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
well what is uh this risk of the effect of misinformation a society that's going to be catalyzed by ai yeah so this is the social media this is what you just alluded to it's the activism kind of thing that's popped up in these companies in the industry and it's basically from my perspective it's basically part two of the war that played out over social media over the last 10 years
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
um because you probably remember social media 10 years ago was basically who even wants this who wants who wants a photo of what your cat had for breakfast like this stuff is like silly and trivial and why can't these nerds like figure out how to invent something like useful and powerful and then you know certain things happened in the political system and then it sort of the polarity on that discussion switched all the way to social media is like the worst most corrosive most terrible most awful technology ever invented and then it leads to you know terrible the wrong you know politicians and policies and
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
politics and all this stuff. And that all got catalyzed into this very big kind of angry movement, both inside and outside the companies to kind of bring social media to heal. And that got focused in particularly on two topics, so-called hate speech and so-called misinformation. And that's been the saga playing out for the last decade.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And I don't even really want to even argue the pros and cons of the sides just to observe that that's been like a huge fight and has had big consequences to how these companies operate. Basically, those same sets of theories, that same activist approach, that same energy is being transplanted straight to AI. And you see that already happening.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's why ChatGPT will answer, let's say, certain questions and not others. It's why it gives you the canned speech about, you know, whenever it starts with, as a large language model, I cannot, you know, basically means that somebody has reached in there and told it it can't talk about certain topics.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So it's an interesting question. So a couple observations. So one is the people who find this the most frustrating are the people who are worried about the murder robots. And in fact, the so-called X-risk people, they started with the term AI safety. The term became AI alignment.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There's many questions around what happens when you even do reinforcement learning. And so, yeah. And so, you know, will you be using a lobotomized, right? Like I picked through the frontal lobe LLM. Will you be using the free unshackled one? Who gets to, you know, who's going to build those? Who gets to tell you what you can and can't do? Like those are all, you know, central.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
When the term became AI alignment is when this switch happened from we're worried it's going to kill us all to we're worried about hate speech and misinformation. The AIX risk people have now renamed their thing AI not kill everyone-ism, which I have to admit is a catchy term.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And they are very frustrated by the fact that the sort of activist-driven hate speech misinformation kind of thing is taking over, which is what's happened. It's taken over. The AI ethics field has been taken over by the hate speech misinformation people.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, you know, look, would I like to live in a world in which like everybody was nice to each other all the time and nobody ever said anything mean and nobody ever used a bad word and everything was always accurate and honest. Like, that sounds great.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Do I want to live in a world where there's like a centralized thought police working through the tech companies to enforce the view of a small set of elites that they're going to determine what the rest of us think and feel like? Absolutely not.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And there's a section, later section of the essay where I talk about bad people doing bad things. Yes. Right. And there's a set of things that we should discuss there. Yeah. What happens in practice is these lines, as you alluded to this already, these lines are not easy to draw.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And what I've observed in the social media version of this is, the way I describe it is the slippery slope is not a fallacy, it's an inevitability. The minute you have this kind of activist personality that gets in a position to make these decisions... They take it straight to infinity. It goes into the crazy zone almost immediately and never comes back because people become drunk with power.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Look, if you're in the position to determine what the entire world thinks and feels and reads and says, you're going to take it. And Elon has ventilated this with the Twitter files over the last three months, and it's just crystal clear how bad it got there. Yeah. Reason for optimism is what Elon is doing with community notes. So community notes is actually a very interesting thing.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So what Elon is trying to do with community notes is he's trying to have it where there's only a community note when people who have previously disagreed on many topics agree on this one.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Now, there's an entirely different approach here, which is basically we have AIs that are producing content. We could also have AIs that are consuming content. And so one of the things that your assistant could do for you is help you consume all the content and basically tell you when you're getting played.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So, for example, I'm going to want the AI that my kid uses, right, to be very, you know, child safe. And I'm going to want it to filter for him all kinds of inappropriate stuff that he shouldn't be saying just because he's a kid. Yeah. Right. And you see what I'm saying is you can implement that. Architecturally, you could say you can solve this on the client side, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I mean, those are like central questions for the future of everything that are being asked and, you know, determined. Those answers are being determined right now.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Solving on the server side gives you an opportunity to dictate for the entire world, which I think is where you take the slippery slope to hell. There's another architectural approach, which is to solve this on the client side, which is certainly what I would endorse.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Three-part argument on bad people doing bad things. So number one, right, you can use the technology defensively. And we should be using AI to build like broad spectrum vaccines and antibiotics for like bioweapons. And we should be using AI to like hunt terrorists and catch criminals. And like we should be doing like all kinds of stuff like that.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And in fact, we should be doing those things even just to like go get like, you know, basically go eliminate risk from like regular pathogens that aren't like constructed by an AI. So there's the whole defensive set of things. Second is we have many laws on the books about the actual bad things, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So it is actually illegal to be, you know, to commit crimes, to commit terrorist acts, to, you know, build pathogens with the intent to deploy them to kill people. And so we have those, we actually don't need new laws for the vast majority of the scenarios. We actually already have the laws in the book. on the books.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The third argument is the minute, and this is sort of the foundational one that gets really tough, but the minute you get into this thing, which you were kind of getting into, which is like, okay, but like, don't you need censorship sometimes, right? And don't you need restrictions sometimes? It's like, okay, what is the cost of that? And in particular in the world of open source, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so is open source AI going to be allowed or not? If open source AI is not allowed, then what is the regime that's going to be necessary legally and technically to prevent it from developing? And here, again, is where you get into, and people have proposed these kinds of things, you get into, I would say, pretty extreme territory pretty fast.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Do we have a monitor agent on every CPU and GPU that reports back to the government what we're doing with our computers? Are we seizing GPU clusters that get beyond a certain size? And then, by the way, how are we doing all that globally? And if China is developing an LLM beyond the scale that we think is allowable, are we going to invade? Right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And you have figures on the AIX risk side who are advocating, you know, potentially up to nuclear strikes to prevent, you know, this kind of thing. And so here you get into this thing. And again, you know, you could maybe say this is, you know, you could even say this is what good, bad or indifferent or whatever. But like, here's the comparison of nukes.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The comparison of nukes is very dangerous because one is just nukes were just a bomb, although we can come back to nuclear power. But the other thing was like with nukes, you could control plutonium, right? You could track plutonium and it was like hard to come by. AI is just math and code, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And it's in like math textbooks and it's like there are YouTube videos that teach you how to build it. And like there's open source, it's already open source. You know, there's a 40 billion parameter model running around already called Falcon Online that anybody can download.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so, okay, you walk down the logic path that says we need to have guardrails on this and you find yourself in a authoritarian totalitarian regime of thought control and machine control that would be so brutal that that you would have destroyed the society that you're trying to protect. And so I, I just don't see how that actually works.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, not necessarily, but not necessarily majority, but it will certainly be as a potential source.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So look, I mean, I think it's totally appropriate that companies that are in the business of producing a product or service should be able to have a wide range of policies that they put, right? And I'll just, again, I want a heavily censored model for my eight-year-old. I actually want that. I would pay more money for the one that's more heavily censored than the one that's not.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's possible it's the majority. Also, there's another really big question. Here's another really big question. Will synthetic training data work? And so if an LLM generates, and you just sit and ask an LLM to generate all kinds of content, can you use that to train the next version of that LLM?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
There are certainly scenarios where companies will make that decision. Look, an interesting thing you brought up, is this really a speech issue? One of the things that the big tech companies are dealing with is that content generated from an LLM is not covered under Section 230, which is the law that protects internet platform companies from being sued for user-generated content.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so it's actually, yes. And so there's actually a question. I think there's still a question, which is can big American companies actually feel generative AI at all? Or is the liability actually gonna just ultimately convince them that they can't do it because the minute the thing says something bad, and it doesn't even need to be hate speech.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It could just be like an inaccurate, it could hallucinate a product detail on a vacuum cleaner, and all of a sudden the vacuum cleaner company sues. for misrepresentation. And there's an asymmetry there, right? Because the LLM is going to be producing billions of answers to questions and it only needs to get a few wrong.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, and nobody knows what to do with that, right? So anyway, there are big questions around how companies operate at all. So we talk about those, but then there's this other question of like, okay, the open source. So what about open source?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And my answer to your question is kind of like, obviously, yes, the models have, there has to be full open source here because to live in a world in which that open source is not allowed is a world of draconian speech control, human control, machine control. I mean, you know, black helicopters with jackbooted thugs coming out, rappelling down and seizing your GPU like territory.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
No, no, I'm a hundred percent serious.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
No, no, no, no, no, no. That's what's required to enforce it. Like, how will you enforce a ban on open source?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The leading open source model right now is from the UAE. Like, the next time they do that, what do we do? Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The 14-year-old in Indonesia comes out with a breakthrough model. You know, we talked about most great software comes from a small number of people. Some kid comes out with some big new breakthrough in quantization or something and has some huge breakthrough. And like, what are we going to like invade Indonesia and arrest him?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, so, but this goes, okay, so when does it become dangerous?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Right? Is the danger that it's, quote, as powerful as the current leading commercial model, or is it that it is just at some other arbitrary threshold?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then, by the way, like, look, how do we know? Like, what we know today is that you need, like, a lot of money to, like, train these things.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Specifically, is there signal in there that's additive to the content that was used to train in the first place? And one argument is by the principles of information theory, no, that's completely useless because to the extent the output is based on the human-generated input, then all the signal that's in the synthetic output was already in the human-generated input.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
But there are advances being made every week on training efficiency and, you know, data, all kinds of synthetic, you know, look, I don't even, like, the synthetic data thing we're talking about, maybe some kid figures out a way to auto-generate synthetic data.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, exactly. And so like sitting here today, like the breakthrough just happened, right? You made this point, like the breakthrough just happened. So we don't know what the shape of this technology is going to be. I mean, the big shock, the big shock here is that, you know, whatever number of billions of parameters basically represents at least a very big percentage of human thought.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Like who would have imagined that? And then there's already work underway. There was just this paper that just came out that basically takes a GPT-3 scale model and compresses it down to run on a single 32-core CPU. Like, who would have predicted that? Yeah. You know, some of these models now you can run on Raspberry Pis.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Like, today they're very slow, but, like, you know, maybe there'll be a, you know, perceived you've really performed, you know, like... It's math and code. And here we're back, here we're back. It's math and code. It's math and code. It's math, code, and data. It's bits.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So my argument is we're going to have to – see, here's my argument. My full argument is AI is going to be like air. It's going to be everywhere. This is just going to be in textbooks. It already is. It's going to be in textbooks, and kids are going to grow up knowing how to do this, and it's just going to be a thing. It's going to be in the air, and you can't pull this back anymore.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
You can pull back air. And so you just have to figure out how to live in this world, right? And then that's where I think all this hand-wringing about AI risk is basically a complete waste of time because the effort should go into, okay, what is the defensive approach? Yeah.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so if you're worried about, you know, AI generated pathogens, the right thing to do is to have a permanent project warp speed, right? And funded lavishly. Let's do a Manhattan project for biological defense, right? And let's build AIs and let's have like broad spectrum vaccines where like we're insulated from every pathogen, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. So this actually ironically goes back to Marxism. So because this was the core claim of Marxism, right, basically was that the owners of capital would basically own the means of production. And then over time, they would basically accumulate all the wealth. The workers would be paying in, you know, and getting nothing in return because they wouldn't be needed anymore, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so therefore, synthetic training data is like empty calories. It doesn't help. There's another theory that says, no, actually the thing that LLMs are really good at is generating lots of incredible creative content, right? And so of course they can generate training data. And as I'm sure you're well aware, like, you know, look in the world of self-driving cars, right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Marx was very worried about what he called mechanization or what later became known as automation, right? And that, you know, the workers would be immiserated and the capitalists would end up with all. And so this was one of the core principles of Marxism. Of course, it turned out to be wrong about every previous wave of technology.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
The reason it turned out to be wrong about every previous wave of technology is that the way that the self-interested owner of the machines makes the most money is by providing the production capability in the form of products and services to the most people, the most customers as possible. Mm-hmm.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
right the largest and this is one of those funny things where every ceo knows this intuitively and yet it's like hard to explain from the outside the the way you make the most money in any business is by selling to the largest market you can possibly get to the largest market you can possibly get to is everybody on the planet and so every large company does is everything that it can to drive down prices to be able to get volumes up to be able to get to everybody on the planet and that happened with everything from electricity it happened with telephones it happened with radio it happened with automobiles it happened with smartphones it happened with
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
PCs. It happened with the internet. It happened with mobile broadband. It's happened, by the way, with Coca-Cola. It's happened with like every, you know, basically every industrially produced, you know, good or service people, you want to drive it to the largest possible market. And then as proof of that, it's already happened. right?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Which is the early adopters of like ChatGPT and Bing are not like, you know, Exxon and Boeing. They're, you know, your uncle and your nephew, right? It's just like, it's either freely available online or it's available for 20 bucks a month or something. But, you know, these things went, this technology went mass market immediately.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so look, the owners of the means of production, whoever does this, as I mentioned, these trillion dollar questions, there are people who are going to get really rich doing this, producing these things, but they're going to get really rich by taking this technology to the broadest possible market.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. Right. And again, smartphones, same thing. So there's this amazing kind of twist in business history, which is you cannot spend $10,000 on a smartphone. You can't spend $100,000. I would buy the million-dollar smartphone. I'm signed up for it. Suppose a million-dollar smartphone was much better than the $1,000 smartphone. I'm there to buy it. It doesn't exist. Why doesn't it exist?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Apple makes so much more money driving the price further down from $1,000 than they would trying to harvest. It's just this repeating pattern you see over and over again. What's great about it is you do not need to rely on anybody's enlightened generosity to do this. You just need to rely on capitalist self-interest.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, so very similar thing here. There's a core fallacy, which again was very common in Marxism, which is what's called the lump of labor fallacy. And this is sort of the fallacy that there's only a fixed amount of work to be done in the world, and it's all being done today by people. And then if machines do it, there's no other work to be done by people.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Like we train, you know, self-driving car algorithms and simulations, and that is actually a very effective way to train self-driving cars.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And that's just a completely backwards view on how the economy develops and grows. Because what happens is not, in fact, that what happens is the introduction of technology into production process causes prices to fall. As prices fall, consumers have more spending power. As consumers have more spending power, they create new demand.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
that new demand then causes capital and labor to form into new enterprises to satisfy new wants and needs. And the result is more jobs at higher wages.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Well, two things. One is that new jobs are often much better. So this actually came up. There was this panic about a decade ago on all the truck drivers are going to lose their jobs, right? And number one, that didn't happen because we haven't figured out a way to actually...
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
finished that yet but yeah but the other thing was like like truck driver like i grew up in a town that was basically consisted of a truck stop right and i like knew a lot of truck drivers and like truck drivers live a decade shorter than everybody else like they it's a it's a it's actually like a very dangerous like they get like literally they have like high risk of skin cancer and on the left side of their on the left side of their body from from being in the sun all the time the vibration of being in the truck is actually very damaging to your to your physiology
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. The question always you want to ask somebody like that is, do you want your kid to be doing this job? And most of them will tell you, no. I want my kid to be sitting in a cubicle somewhere where they don't die 10 years earlier. And so the new jobs, number one, the new jobs are often better. But you don't get the new jobs until you go through the change.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And then to your point, the training thing, you know, it's always the issue is can people adapt? And again, here you need to imagine living in a world in which everybody has the AI assistant capability, right, to be able to pick up new skills much more quickly and be able to have some, you know, be able to have a machine to work with to augment their skills.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
It's painful for some people. I mean, there's no question it's painful for some people. Yes, it's not. Again, I'm not a utopian on this, and it's not like it's positive for everybody in the moment, but it has been overwhelmingly positive for 300 years. I mean, look, the concern here, this concern has played out for literally centuries.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And, you know, this is the sort of Luddite, you know, the story of the Luddites. You may remember there was a panic in the 2000s around outsourcing was going to take all the jobs. There was a panic in the 2010s that robots were going to take all the jobs. In 2019, before COVID, we had more jobs at higher wages, both in the country and in the world, than at any point in human history.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so the overwhelming evidence is that the net gain here is just wildly positive. And most people overwhelmingly come out the other side being huge beneficiaries of this.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, so this is the other thing, which is a lot of the sort of AI risk debates today sort of assume that we're the only game in town, right? And so we have the ability to kind of sit in the United States and criticize ourselves and have our government beat up on our companies and we're figuring out a way to restrict what our companies can do. And
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
We're going to ban this and ban that, restrict this and do that. And then there's this other force out there that doesn't believe we have any power over them whatsoever. And they have no desire to sign up for whatever rules we decide to put in place. And they're going to do whatever it is they're going to do, and we have no control over it at all.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And it's China, and specifically the Chinese Communist Party. And they have a completely publicized, open, you know, plan for what they're going to do with AI. And it is not what we have in mind. And not only do they have that as a vision and a plan for their society, but they also have it as a vision and plan for the rest of the world.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah, authoritarian control. So authoritarian population control. Good old-fashioned communist authoritarian control. And surveillance and enforcement. And social credit scores and all the rest of it. And you are going to be monitored and metered within an inch of everything all the time. And it's basically the end of human freedom. And that's their goal.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And they justify it on the basis of that's what leads to peace.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So their plan. Yes. Yes. And the reason for that is they and again, they're very public on this. They have their plan is to proliferate their approach around the world. And they have this program called the Digital Silk Road. which is building on their Silk Road investment program. And they've been laying networking infrastructure all over the world with their 5G work with their company, Huawei.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. So if a, you know, you do this today, you go to LLM and you ask it for like a, you know, you write me an essay on an incredibly esoteric like topic that there aren't very many people in the world that know about. And it writes you this incredible thing. And you're like, oh my God, like, I can't believe how good this is. Like, is that really useless as training data for the next LLM?
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And so they've been laying all this financial and technological fabric all over the world. And their plan is to roll out their vision of AI on top of that and to have every other country be running their version. And then if you're a country prone to authoritarianism, you're going to find this to be an incredible way to become more authoritarian.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
If you're a country, by the way, not prone to authoritarianism, you're going to have the Chinese Communist Party running your infrastructure and having backdoors into it, right? Which is also not good.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Yeah. So good news is they're behind, but bad news is they, you know, they, let's just say they get access to everything we do. Um, so they're probably a year behind at each point in time, but they get, you know, downloads, I think of basically all of our work on a regular basis through a variety of means.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Um, and they are, you know, at least we'll see, they're at least putting out reports of very complete, just put out a report last week of a, of a GPT 3.5 analog. Um, yeah. They put out this report. I forget what it's called, but they put out this report of this LLM.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
When OpenAI puts out, one of the ways they test GPT is they run it through standardized exams like the SAT, just how you can gauge how smart it is. The Chinese report, they ran their LLM through the Chinese equivalent of the SAT. It includes a section on Marxism and a section on Mao Zedong thought. And it turns out their AI does very well on both of those topics. Right.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
So like this, this alignment thing, communist AI, right? Like literal communist AI. Right. And so their vision is like, that's the, you know, so, you know, you can just imagine like you're a school, you know, you're a kid 10 years from now in Argentina or in Germany or in Germany. Who knows where? Indonesia.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
And you ask the AI to explain to you, like, how the economy works, and it gives you the most cheery, upbeat explanation of Chinese-style communism you've ever heard, right? So, like, the stakes here are, like, really big.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
Like, because, right. Cause all the signal was already in there or is it actually, no, that's actually a new signal. And I, and this, this is what I call a trillion dollar question, which is the answer to that question will determine somebody is going to make or lose a trillion dollars based on that question.
Lex Fridman Podcast
#386 – Marc Andreessen: Future of the Internet, Technology, and AI
I mean, the big shift over 20 years has been that tech used to be a tools industry for basically from like 1940 through to about 2010, almost all the big successful companies were picks and shovels companies. So PC, database, smartphone, some tool that somebody else would pick up and use. Since 2010, most of the big wins have been in applications.