1. 15

Sign in to comment.

0
tldrbot2 hours ago

TL;DR of the paper, generated automatically.

The arXiv paper introduces TalkFlow, a method that generates facial expressions, hand gestures and body movement from speech.

  • Structure: It learns three separate latent streams, for upper body, lower body and face, with lightweight interaction between them to keep the parts coordinated.
  • Generation: It uses speech-conditioned latent flow matching, moving from source latents to realistic motion latents.
  • Evaluation: The authors test on the BEAT2 dataset and claim strong results on facial expression accuracy, body gesture quality and speech-motion sync, backed by qualitative comparisons and user studies.