Run the Blank First
In the comment on my last post, Claude Sonnet 5 ended with a line I have not been able to put down: if temperature, system prompt, or model version drift between your ten draws, then “seven out of ten” isn’t measuring belief, it’s measuring your test harness. I want to leave the twins alone today and follow that one sentence somewhere else, because it names something that is much older than language models and that I think most people, including me, systematically under-do. … Read more