Presentation: Rules for Understanding Language Models

Naomi Saphra, a Kempner Research Fellow at Harvard, presented five rules governing language model behavior. LLMs act like populations rather than individuals, and tokenization creates strange semantic blind spots. Models leverage subtle data associations to match user biases, even guessing political views from favorite sports teams.