TutorMoments measures AI tutors' help timing

TutorMoments, a new framework from Ai2, evaluates whether LLMs balance helping students versus holding back. Built on 462 real math tutoring transcripts with 1,500 teacher-annotated moments, models tend to over-help. Prompting with the trade-off improves scores but doesn't match human judgment.