Can I read Learning from Collective Intelligence: Feature Learning Using Social Images and Tags on EtoBox?

Learning from Collective Intelligence: Feature Learning Using Social Images and Tags by Hanwang Zhang; Xindi Shang; Huanbo Luan; Meng Wang; Tat-Seng Chua is a Computer Science article available to read on EtoBox.

What is Learning from Collective Intelligence: Feature Learning Using Social Images and Tags about?

Feature representation for visual content is the key to the progress of many fundamental applications such as annotation and cross-modal retrieval. Although recent advances in deep feature learning offer a promising route towards these tasks, they are limited in application domains where high-quality and large-scale training data are expensive to obtain. In this article, we propose a novel deep feature learning paradigm based on social collective intelligence, which can be acquired from the inexhaustible social multimedia content on the Web, in particular, largely social images and tags. Differing from existing feature learning approaches that rely on high-quality image-label supervision, our weak supervision is acquired by mining the visual-semantic embeddings from noisy, sparse, and diverse social image collections. The resultant image-word embedding space can be used to (1) fine-tune deep visual models for low-level feature extractions and (2) seek sparse representations as high-level cross-modal features for both image and text. We offer an easy-to-use implementation for the proposed paradigm, which is fast and compatible with any state-of-the-art deep architectures. Extensive

Who reads Learning from Collective Intelligence: Feature Learning Using Social Images and Tags?

Author

Hanwang Zhang; Xindi Shang; Huanbo Luan; Meng Wang; Tat-Seng Chua

Publisher

ACM

Published

2016

Language

EN

Field

Computer Science (Physical Sciences)