#446 – Ed Barnhart: Maya, Aztec, Inca, and Lost Civilizations of South America

4825.086 - 4845.802 Arvid Lundmark

I think these models are really strong reflection of the pre-training distribution. And, you know, I do think they, they generalize as the loss gets lower and lower, but I don't think the, the loss and the scale is quite, or the loss is low enough such that they're like really fully generalizing in code. Like the things that we use these things for, uh, the frontier models, uh,