20VC: Bret Taylor: The AI Bubble and What Happens Now | How the Cost of Chips and Models Will Change in AI | Will Companies Build Their Own Software | Why Pre-Training is for Morons | Leaderships Lessons from Mark Zuckerberg

1439.682 - 1461.197 Bret Taylor

GPT breakthroughs that came next. You ended up with instruction tuning, which was how you turned one of these models into a chat interface, which was a breakthrough as well. Given even existing data, existing compute, we have all of the best minds in computer science thinking about different techniques. It's similar. There's folks even looking beyond the Transformers model and things like that.