Can I read Sketchforme: Composing Sketched Scenes from Text Descriptions for Interactive Applications on EtoBox?

Sketchforme: Composing Sketched Scenes from Text Descriptions for Interactive Applications by Huang, Forrest; Canny, John F. is a scholarly article available to read on EtoBox.

What is Sketchforme: Composing Sketched Scenes from Text Descriptions for Interactive Applications about?

Sketching and natural languages are effective communication media for interactive applications. We introduce Sketchforme, the first neural-network-based system that can generate sketches based on text descriptions specified by users. Sketchforme is capable of gaining high-level and low-level understanding of multi-object sketched scenes without being trained on sketched scene datasets annotated with text descriptions. The sketches composed by Sketchforme are expressive and realistic: we show in our user study that these sketches convey descriptions better than human-generated sketches in multiple cases, and 36.5% of those sketches are considered to be human-generated. We develop multiple interactive applications using these generated sketches, and show that Sketchforme can significantly improve language learning applications and support intelligent language-based sketching assistants.

Author

Huang, Forrest; Canny, John F.

Published

2019

Language

EN