609: You're the Oreo Cookie

2643.147 - 2664.953 Marco Arment

this is from the quoting from the paper the performance of all models declines when only the numerical values in the question are altered like they're asking in math problems like word math problems and if you like change the name of the kids in the word problem it gets the answers wrong right change sometimes changing the numbers right changing it from like one to five or whatever it will get the answer right with one and wrong with five uh or whatever