Showing 1–1 of 1 results for author: Maksak, B
-
An Attention Mechanism for Answer Selection Using a Combined Global and Local View
Authors:
Yoram Bachrach,
Andrej Zukov-Gregoric,
Sam Coope,
Ed Tovell,
Bogdan Maksak,
Jose Rodriguez,
Conan McMurtie
Abstract:
We propose a new attention mechanism for neural based question answering, which depends on varying granularities of the input. Previous work focused on augmenting recurrent neural networks with simple attention mechanisms which are a function of the similarity between a question embedding and an answer embeddings across time. We extend this by making the attention mechanism dependent on a global e…
▽ More
We propose a new attention mechanism for neural based question answering, which depends on varying granularities of the input. Previous work focused on augmenting recurrent neural networks with simple attention mechanisms which are a function of the similarity between a question embedding and an answer embeddings across time. We extend this by making the attention mechanism dependent on a global embedding of the answer attained using a separate network.
We evaluate our system on InsuranceQA, a large question answering dataset. Our model outperforms current state-of-the-art results on InsuranceQA. Further, we visualize which sections of text our attention mechanism focuses on, and explore its performance across different parameter settings.
△ Less
Submitted 20 September, 2017; v1 submitted 5 July, 2017;
originally announced July 2017.
