Opening book details…
Can I read 3D lip shapes from video: A combined physical–statistical model on EtoBox?
3D lip shapes from video: A combined physical–statistical model by Sumit Basu; Nuria Oliver; Alex Pentland is a Computer Science article available to read on EtoBox.
What is 3D lip shapes from video: A combined physical–statistical model about?
Tracking human lips in video is an important but notoriously dicult task. To accurately recover their motions in 3D from any head pose is an even more challenging task, though still necessary for natural interactions. Our approach is to build and train 3D models of lip motion to make up for the information we cannot always observe when tracking. We use physical models as a prior and combine them with statistical models, showing how the two can be smoothly and naturally integrated into a synthesis method and a MAP estimation framework for tracking. We have found that this approach allows us to accurately and robustly track and synthesize the 3D shape of the lips from arbitrary head poses in a 2D video stream. We demonstrate this with numerical results on reconstruction accuracy, examples of static ®ts, and audio-visual sequences.
Who reads 3D lip shapes from video: A combined physical–statistical model?
It is typically read by researchers, students, and practitioners in Computer Science.
- Author
- Sumit Basu; Nuria Oliver; Alex Pentland
- Publisher
- Elsevier Science; Elsevier ; Elsevier BV (ISSN 0167-6393)
- Published
- 1998
- Language
- EN
- Field
- Computer Science (Physical Sciences)