Structured Attention Networks

Method and contribution

Uses differentiable graphical-model inference to attend over subsequences and syntactic trees.

Models structured selections and computes expected annotations; full prediction marginalization is a separate operation.

Read in context

Attention as a Latent Variable: Modeling a Distribution over Attention →

Citation

Yoon Kim, Carl Denton, Luong Hoang, Alexander M. Rush. Structured Attention Networks. ICLR 2017.

@inproceedings{kim2017structured,
  title = {{Structured Attention Networks}},
  author = {Kim, Yoon and Denton, Carl and Hoang, Luong and Rush, Alexander M.},
  year = {2017},
  booktitle = {ICLR 2017},
  url = {https://arxiv.org/abs/1702.00887},
  eprint = {1702.00887},
  archivePrefix = {arXiv}
}