Can I read Revisiting Visual Question Answering Baselines on EtoBox?

Revisiting Visual Question Answering Baselines by Jabri, Allan; Joulin, Armand; van der Maaten, Laurens is a scholarly article available to read on EtoBox.

What is Revisiting Visual Question Answering Baselines about?

Visual question answering (VQA) is an interesting learning setting for evaluating the abilities and shortcomings of current systems for image understanding. Many of the recently proposed VQA systems include attention or memory mechanisms designed to support "reasoning". For multiple-choice VQA, nearly all of these systems train a multi-class classifier on image and question features to predict an answer. This paper questions the value of these common practices and develops a simple alternative model based on binary classification. Instead of treating answers as competing choices, our model receives the answer as input and predicts whether or not an image-question-answer triplet is correct. We evaluate our model on the Visual7W Telling and the VQA Real Multiple Choice tasks, and find that even simple versions of our model perform competitively. Our best model achieves state-of-the-art performance on the Visual7W Telling task and compares surprisingly well with the most complex systems proposed for the VQA Real Multiple Choice task. We explore variants of the model and study its transferability between both datasets. We also present an error analysis of our model that suggests a key

Author

Jabri, Allan; Joulin, Armand; van der Maaten, Laurens

Published

2016

Language

EN