Can I read The Lost Melody: Empirical Observations on Text-to-Video Generation From A Storytelling Perspective on EtoBox?

The Lost Melody: Empirical Observations on Text-to-Video Generation From A Storytelling Perspective by Shin, Andrew; Mori, Yusuke; Kaneko, Kunitake is a scholarly article available to read on EtoBox.

What is The Lost Melody: Empirical Observations on Text-to-Video Generation From A Storytelling Perspective about?

Text-to-video generation task has witnessed a notable progress, with the generated outcomes reflecting the text prompts with high fidelity and impressive visual qualities. However, current text-to-video generation models are invariably focused on conveying the visual elements of a single scene, and have so far been indifferent to another important potential of the medium, namely a storytelling. In this paper, we examine text-to-video generation from a storytelling perspective, which has been hardly investigated, and make empirical remarks that spotlight the limitations of current text-to-video generation scheme. We also propose an evaluation framework for storytelling aspects of videos, and discuss the potential future directions.

Author

Shin, Andrew; Mori, Yusuke; Kaneko, Kunitake

Published

2024

Language

EN