Awesome-Visual Question Generation

Problem Statement

Give an image, the task is to generate natural Question based on the image.

Dataset

Image Dataset-:MS-COCO and Question Dataset -: VQG-COCO
Image Dataset-:Flickr and Question Dataset -: VQG-Bing
Image Dataset-:Bing and Question Dataset -: VQG-Flickr
Image Dataset-:MS-COCO and Question Dataset -: VQA-v1.0
Image Dataset-:MS-COCO and Question Dataset -: VQA-v2.0
Image Dataset-:MS-COCO and Question Dataset -: Visual7W

VQG Papers

Paper Name - Author 1 et al, Conference Year. [code]

Year 2020 papers:

Visual Question Generation from Radiology Images -Sarrouti et al, ALVR workshop 2020
Deep Bayesian Network for Visual Question Generation -Patro et al, WACV 2020. [Project Page]
Learning to Generate Diverse Questions from Keywords -Pen et al, ICASSP 2020
C3VQG: Category Consistent Cyclic Visual Question Generation -Uppal et al, Arxiv 2020

Year 2019 papers:

Information Maximizing Visual Question Generation - Krishna et al, *CVPR 2019. [code]
Improving Neural Question Generation Using Answer Separation -Kim et al, AAAI 2019
Visual Question Generation: The State of the Art -Patil et al, ACM Computing Survey 2019
Joint Learning of Question Answering and Question Generation -Sun et al, Transactions on Knowledge and Data Engineering 2019

Year 2018 papers:

Multimodal Differential Network for Visual Question Generation. - Patro et al, EMNLP 2018 [Project Link]
Visual Question Generation as Dual Task of Visual Question Answering -Yikang et al, *CVPR 2018

Year 2017 papers:

Automatic Generation of Grounded Visual Questions. - Zhang et al, IJCAI 2017.
Learning to Ask: Neural Question Generation for Reading Comprehension, -Xinya et al. ACL 2017
Creativity: Generating Diverse Questions using Variational Autoencoders. -Jain et al, CVPR 2017.
Image-grounded conversations: Multimodal context for natural question and response generation.. -Mostafazadeh et al,IJCNLP 2017
Asking the Difficult Questions: Goal-Oriented Visual Question Generation via Intermediate Rewards. -Zhang et al, Arxiv 2017

Year 2016 papers:

Generating natural questions about an image. -Mostafazadeh et al, ACL 2016.

Year 2015 papers:

Neural Self Talk: Image Understanding via Continuous Questioning and Answering] -Yang et al, Arxiv 2015.