Show, Attend and Tell: Neural Image Caption Generation with Visual Attention

Method and contribution

Introduces deterministic soft and stochastic hard visual attention for image captioning.

An early stochastic-attention reference for the distinction between expected features and sampled selection.

Read in context

Attention as a Latent Variable: Modeling a Distribution over Attention →

Citation

Kelvin Xu, Jimmy Lei Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhutdinov, Richard S. Zemel, Yoshua Bengio. Show, Attend and Tell: Neural Image Caption Generation with Visual Attention. ICML 2015.

@inproceedings{xu2015show,
  title = {{Show, Attend and Tell: Neural Image Caption Generation with Visual Attention}},
  author = {Xu, Kelvin and Ba, Jimmy Lei and Kiros, Ryan and Cho, Kyunghyun and Courville, Aaron and Salakhutdinov, Ruslan and Zemel, Richard S. and Bengio, Yoshua},
  year = {2015},
  booktitle = {ICML 2015},
  url = {https://proceedings.mlr.press/v37/xuc15.html},
  eprint = {1502.03044},
  archivePrefix = {arXiv}
}