文章基本信息

标题：Question to Question Similarity Analysis Using Morphological, Syntactic, Semantic, and Lexical Features
本地全文：下载
作者：Mahmoud M. Hammad ; Mohammad Al-Smadi ; Qanita Bani Baker 等
期刊名称：Journal of Universal Computer Science
印刷版ISSN：0948-6968
出版年度：2020
卷号：26
期号：6
页码：671-697
出版社：Graz University of Technology and Know-Center
摘要：In the digitally connected world that we are living in, people expect to get answers to their questions spontaneously. This expectation increased the burden on Question/Answer platforms such as Stack Overflow and many others. A promising solution to this problem is to detect if a question being asked is similar to a question in the database, then present the answer of the detected question to the user. To address this challenge, we propose a novel Natural Language Processing (NLP) approach that detects if two Arabic questions are similar or not using their extracted morphological, syntactic, semantic, lexical, overlapping, and semantic lexical features. Our approach involves several phases including Arabic text processing, novel feature extraction, and text classifications. Moreover, we conducted a comparison between seven different machine learning classifiers. The included classifiers are: Support Vector Machine (SVM), Decision Tree (DT), Logistic Regression (LR), Extreme Gradient Boosting (XGB), Random Forests (RF), Adaptive Boosting (AdaBoost), and Multilayer Perceptron (MLP). To conduct our experiments, we used a real-world questions dataset consisting of around 19,136 questions (9,568 pairs of questions) in which our approach achieved 82.93% accuracy using our XGB model on the best features selected by the Random Forest feature selection technique. This high accuracy of our model shows the ability of our approach to correctly detect similar Arabic questions and hence increases user satisfactions.
关键词：Arabic language; LDA; NLP; Semantic Text Similarity (STS); XGB; lexical features; machine learning; text classification