The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia
George Sivulka
Yeah, I think it's a bit of a marketing distinction. But ultimately, the idea is that the way that we got here over the last five, seven years of training models has been, let's build a bigger and bigger model, and let's give it more and more data, more and more clean data. And then maybe we'll do some RLHF or some reinforcement training to fine tune it after pre-training.
0
💬
0
Comments
Log in to comment.
There are no comments yet.