589: Blame the Tools using the Tools

2097.207 - 2123.94 Mark Zuckerberg

Is there a current set of methods that seem to be scaling very well? Right. So. With past AI architectures, you could kind of feed an AI system a certain amount of data and use a certain amount of compute, but eventually it hit a plateau. And one of the interesting things about these new transformer-based architectures over the last five to 10 years is that we haven't found the end yet.