Lex Fridman Podcast
#434 – Aravind Srinivas: Perplexity CEO on Future of AI, Search & the Internet
Aravind Srinivas
And they're distilling the intelligence from GPT-4 on it to see how far you can get if you just take the tokens of GPT-4 on datasets that require you to reason. And you train the model only on that. You don't need to train on all of like regular internet pages. Just train it on like basic common sense stuff. But it's hard to know what tokens are needed for that.
0
💬
0
Comments
Log in to comment.
There are no comments yet.