KAIST AI Decodes Speech via Lip Reading

A team at KAIST developed an AI using diffusion large language models to improve visual speech recognition accuracy. Trained on 433 hours of video, the system achieved a 19.4% word error rate, the lowest among existing methods using only that dataset. The researchers plan to optimize the model for real-time deployment on wearable devices and robots without internet access.