Samuel MartinExperiments and measurement systems
Writing

Two essays, and the reasoning behind the case studies.

Long-form arguments about measurement. The case studies show what happened; these are the parts that generalize.

Essay 01

Half of Everyone Is Below Median (That’s Not the Insult You Think)

George Carlin’s line about the average person is a lesson in the difference between mean and median, and understanding it properly is the exact reason not to conclude you are smarter than everyone else.

Body to come
Essay 02

How to Evaluate a Language Model Without Lying to Yourself

In a space saturated with leaderboard numbers, the only credible currency is evaluation methodology and an honest account of what the evaluation cannot conclude.

Body to come

Shorter, and elsewhere.