ConvApparel: Measuring and bridging the realism gap in user simulators

Google Research introduced ConvApparel, a dataset and evaluation framework to quantify the realism gap in LLM-based user simulators. The framework uses human-AI conversations with helpful and unhelpful agents to expose simulator flaws and improve training of conversational agents.