303 | AMA | February 2025

11029.889 - 11048.139 Sean Carroll

Do you have a sense as to whether there's a fundamental difference between the theory of operation of an AI LLM and that of an autocorrect feature on my phone? Is it just a massively scaled up version of this thing that is always failing to guess the next word I want, or is it doing the same thing in some utterly different way? I think it's both. It's a little bit half and half there.