Can I read Visual Speech Enhancement via Pseudo-Lips on EtoBox?

Visual Speech Enhancement via Pseudo-Lips by Luis Dominguez Leiton is a document available to read on EtoBox.

What is Visual Speech Enhancement via Pseudo-Lips about?

1) The document proposes a new method of speech enhancement using generated lip movements even without a real visual stream. It trains a lip synthesis model to produce lip movements that mask noise in the audio, acting as a "visual noise filter". 2) Evaluation shows the intelligibility of speech enhanced with this pseudo-lip approach is comparable (<3% difference) to using real lips. This allows exploiting advantages of lip movements for a wide range of applications that lack a reliable video stream. 3) T

Author

Luis Dominguez Leiton

Language

EN