文章基本信息

标题：Determining reliability in interactive question answering systems by regression
本地全文：下载
作者：Hosseini, Mohammad Mehdi Hosseini ; Jalai, Alireza
期刊名称：Iranian Journal of Information Processing & Management
印刷版ISSN：2251-8223
电子版ISSN：2251-8231
出版年度：2021
卷号：36
期号：3
页码：817-834
出版社：Iranian Research Institute for Information and Technology
摘要：Evaluation of interactive question answering systems plays an important role to determine the effectiveness of these questions is of great importance. In the process evaluation of an interactive question answering system, several features can be considered. One of the most effective criteria in the assessment of these systems is reliability. Few attempts have been made to measure the reliability and accurate determination of reliability criteria in interactive question answering systems by applying different models, and most tasks have been used only or qualitative evaluation. In this paper, a new method for the reliability of reliability is presented using the set of criteria affecting this feature, including qualitative and quantitative criteria. In this method, first a list of qualitative and quantitative characteristics is collected and then according to the criteria set, 8 quantitative characteristics are selected and then based on the prepared questionnaire, the coefficients of impact of each question are determined and by combining these characteristics according to the proposed relationship of reliability was measured. The evaluation of the performance of the selected criteria on four interactive question answering indicates that by applying this set of criteria, the reliability of an interactive question answering system can be used to automate the calculation of this feature in the process evaluation process.
关键词：Reliability ; Evaluation Criteria ; Qualitative Software Features ; Interactive Question answering systems.