#452 – Dario Amodei: Anthropic CEO on Claude, AGI & the Future of AI & Humanity

12404.034 - 12425.442 Chris Olah

And the model will give you a kind of ranking and you can use this as preference data in the same way that you use human preference data and train the models to have these relevant traits from their feedback alone instead of from human feedback. So if you imagine that, like I said earlier with the human who just prefers the kind of like semi-colon usage in this particular case,