Lex Fridman Podcast
#434 – Aravind Srinivas: Perplexity CEO on Future of AI, Search & the Internet
Aravind Srinivas
Yeah. That is literally the recipe for chat GPT. Like you're spending bulk of the compute in pre-training, predicting the next token, which is on our self-supervised, whatever you want to call it. The icing is the supervised fine tuning step, instruction following, and the cherry on the cake, RLHF, which is what gives the conversational abilities. That's fascinating.
0
💬
0
Comments
Log in to comment.
There are no comments yet.