Accidental Tech Podcast
609: You're the Oreo Cookie
Marco Arment
He says, overall, we found no evidence of formal reasoning in language models, including open source models like Lama, Phi, Gamma, Mistral, and the leading closed source models like the recent OpenAI GPT-4.0 and O1 series. Their behavior is better explained by sophisticated pattern matching. So fragile, in fact, that changing names can alter results by up to 10%.
0
💬
0
Comments
Log in to comment.
There are no comments yet.