The arXiv paper introduces TalkFlow, a method that generates facial expressions, hand gestures and body movement from speech.
Structure: It learns three separate latent streams, for upper body, lower body and face, with lightweight interaction between them to keep the parts coordinated.
Generation: It uses speech-conditioned latent flow matching, moving from source latents to realistic motion latents.
Evaluation: The authors test on the BEAT2 dataset and claim strong results on facial expression accuracy, body gesture quality and speech-motion sync, backed by qualitative comparisons and user studies.
Sign in to comment.
TL;DR of the paper, generated automatically.
The arXiv paper introduces TalkFlow, a method that generates facial expressions, hand gestures and body movement from speech.