EMO: Emote Portrait Alive Generating Expressive Portrait Videos with Audio2 Video Diffusion Model under Weak Conditions

We proposed EMO, an expressive audiodriven portraitvideo generation framework. Input a single reference image and the vocal audio, e. g. talking and singing, our method can generate vocal avatar videos with expressive facial expressions, and various head poses, meanwhile, we can generate videos with any duration depending on the length of input video.