Translation of Natural Language Query Into Keyword Query Using a RNN Encoder-Decoder

ABSTRACT

The number of natural language queries submitted to search engines is increasing as search environments get diversified. However, legacy search engines are still optimized for short keyword queries. Thus, the use of natural language queries at legacy search engines degrades the retrieval performance of the engines. This paper proposes a novel method to translate a natural language query into a keyword query relevant to the natural language query for retrieving better search results without change of the engines. The proposed method formulates the translation as a generation task. That is, the method generates a keyword query from a natural language query by preserving the semantics of the natural language query. A recurrent neural network encoder-decoder architecture is adopted as a generator of keyword queries from natural language queries. In addition, an attention mechanism is also used to cope with long natural language queries.

References

1. I. Antonellis, H. G. Molina, and C. C. Chang. 2008. Simrank++: Query Rewriting Through Link Analysis of the Click Graph. Proceedings of VLDB, Vol. 1, 1 (2008), 408--421.
2. D. Bahdanau, K. Cho, and Y. Bengio. 2015. Neural Machine Translation by Jointly Learning to Align and Translate. Proceedings of ICLR.
3. K. Cho, B. van Merrienboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, and Y. Bengio. 2014. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. In Proceedings of EMNLP. 1724--1734.
4. S. Chopra, M. Auli, and A. M. Rush. 2016. Abstractive Sentence Summarization with Attentive Recurrent Neural Networks. Proceedings of NAACL. 93--98.
5. D. Ferrucci, E. Brown, J. Chu-Carroll, J. Fan, D. Gondek, A. A Kalyanpur, A. Lally, J. W. Murdock, E. Nyberg, and J. Prager. 2010. Building Watson: An overview of the DeepQA project. AI magazine, Vol. 31, 3 (2010), 59--79.
6. J. Gao and J.-Y. Nie. 2012. Towards Concept-Based Translation Models Using Search Logs for Query Expansion. Proceedings of CIKM. 1:1--1:10.
7. A. Graves and J. Schmidhuber. 2005. Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Networks, Vol. 18, 5 (2005), 602--610.
8. Y. He, J. Tang, H. Ouyang, C. Kang, D. Yin, and Y. Chang. 2016. Learning to Rewrite Queries. In Proceedings of CIKM. 1443--1452.
9. S. Hochreiter and J. Schmidhuber. 1997. Long short-term memory. Neural computation, Vol. 9, 8 (1997), 1735--1780.
10. S. Huston and W. B. Croft. 2010. Evaluating Verbose Query Processing Techniques. In Proceedings of SIGIR. 291--298.
11. R. Jones, B. Rey, O. Madani, and W. Greiner. 2006. Generating query substitutions. In Proceedings of WWW. 387--396.
12. G. Kumaran and V. R. Carvalho. 2009. Reducing Long Queries Using Query Quality Predictors Proceedings of SIGIR. 564--571.
13. B. Li and I. King. 2010. Routing Questions to Appropriate Answerers in Community Question Answering Services. Proceedings of CIKM. 1585--1588.
14. T. Luong, H. Pham, and C. D. Manning. 2015. Effective Approaches to Attention-based Neural Machine Translation. Proceedings of EMNLP. 1412--1421.
15. K. T. Maxwell and W. B. Croft. 2013. Compact Query Term Selection Using Topically Related Text. Proceedings of SIGIR. 583--592.
16. A. Otegi, X. Arregi, O. Ansa, and E. Agirre. 2015. Using knowledge-based relatedness for information retrieval. Knowledge and Information Systems Vol. 44, 3 (2015), 689--718.
17. J. H. Park and W. B. Croft. 2010. Query Term Ranking Based on Dependency Parsing of Verbose Queries. Proceedings of SIGIR. 829--830.
18. S. Riezler and Y. Liu. 2010. Query Rewriting Using Monolingual Statistical Machine Translation. Computational Linguistics Vol. 36, 3 (2010), 569--582.
19. I. Sutskever, O. Vinyals, and Q. V Le. 2014. Sequence to sequence learning with neural networks. Proceedings of NIPS. 3104--3112.
20. X. Wang and C. Zhai. 2008. Mining Term Association Patterns from Search Logs for Effective Query Reformulation. Proceedings of CIKM. 479--488.
21. G. Weikum and M. Theobald. 2010. From Information to Knowledge: Harvesting Entities and Relationships from Web Sources. Proceedings of SIGMOD/PODS. 65--76.
22. J. Xu and W. B. Croft. 1996. Query Expansion Using Local and Global Document Analysis. Proceedings of SIGIR. 4--11.

Index Terms

• Computing methodologies

  • Machine learning

    • Machine learning approaches

      • Neural networks

• Information systems

  • Information retrieval

    • Information retrieval query processing

      • Query reformulation