Can I read ControlVideo: Conditional Text-to-Video Editing on EtoBox?
ControlVideo: Conditional Text-to-Video Editing by Oscar is a document available to read on EtoBox.
What is ControlVideo: Conditional Text-to-Video Editing about?
ControlVideo is a method for one-shot text-driven video editing using a pretrained text-to-image diffusion model. It incorporates additional visual conditions like edge maps and depth maps from the source video as inputs to a ControlNet to better guide the editing process. ControlVideo also fine-tunes the attention modules in the diffusion model and ControlNet to enhance temporal consistency while preventing overfitting. An empirical study demonstrates that selecting a key frame for attention initialization
- Author
- Oscar
- Language
- EN