Feature Extraction for Token Based Word Alignment for Question Answering Systems

Authors

  • Lokesh Kumar Sharma Dept of CSE, Galgotias College of Engg and Tech, Greater Noida, UP
  • Namita Mittal Dept of CSE, Malaviya National Institute of Technology Jaipur, RJ
  • Anubha Aggarwal Dept of CSE, Shri Mata Vaishno Devi University, Katra

DOI:

https://doi.org/10.13053/cys-22-4-3070

Keywords:

Structural feature, question alignment, feature score, alignment score

Abstract

Mapping between the source words and the target words in a set of parallel sentences are a crucial part of Question Answering (QA) systems. I fan accurate aligner is used in QA systems then the efficiency of these systems also gets increased. We purpose the aligner which despite using very less lexical resources gives very good results in terms of precision, recall and F1. Previous aligners either uses more lexical resources or uses very less lexical resources. Hence, we have used POS TAG and WordNet as lexical resources. But some words whose meaning we maynot know but these occur in a similar distributionand by observing their distribution these words aresimilar. Consider two sentences "Lambodar is theson of Parvati" and "Ganesha is the son of Parvati". Here we will not find the meaning of Lambodar and Ganesha in Wordnet but since they have similar distributions so they should be aligned. For these words, we used Distribution Similarity Feature in our word aligner. This distributional similarity helps our alignerin broader coverage of words. Previous aligners were having recall in the range of 75-86 but this aligner has recall in the range of 88.4-93.3. Similarly, Exact match of previous aligners was in the range of 21-35.3 but the proposed aligner’s exact match range is 46.1-58.6. Similarly F-measure and precision have also increased.

Downloads

Published

2018-12-30

Issue

Vol. 22 No. 4 (2018): Topic Trends in Computing Research (Guest Editors: A. Aguilar-Meléndez, E. Moya-Sánchez)

Section

Articles of the Thematic Section

License 

Hereby I transfer exclusively to the Journal "Computación y 
Sistemas", published by the Computing Research Center (CIC-IPN),
the Copyright of the aforementioned paper. I also accept that these 
rights will not be transferred to any other publication, in any other 
format, language or other existing means of developing.
I certify that the paper has not been previously disclosed or simultaneo
usly submitted to any other publication, and that it does not contain 
material whose publication would violate the Copyright or other 
proprietary rights of any person, company or institution. I certify that 
I have the permission from the institution or company where I work or 
study to publish this work.
The representative author accepts the responsibility for the publication
of this paper on behalf of each and every one of the authors. 
This transfer is subject to the following conditions:
  • The authors retain all ownership rights (such as patent rights) of this work, except for the publishing rights transferred to the CIC, through this document.
  • Authors retain the right to publish the work in whole or in part in any book they are the authors or publishers. They can also make use of this work in conferences, courses, personal web pages, and so on.
  • Authors may include working as part of his thesis, for non-profit distribution only.