文章基本信息

标题：Feature selection to increase the random forest method performance on high dimensional data
本地全文：下载
作者：Maria Irmina Prasetiyowati ; Nur Ulfa Maulidevi ; Kridanto Surendro 等
期刊名称：IJAIN (International Journal of Advances in Intelligent Informatics)
印刷版ISSN：2442-6571
电子版ISSN：2548-3161
出版年度：2020
卷号：6
期号：3
页码：303-312
DOI：10.26555/ijain.v6i3.471
语种：English
出版社：Universitas Ahmad Dahlan
摘要：Random Forest is a supervised classification method based on bagging (Bootstrap aggregating) Breiman and random selection of features. The choice of features randomly assigned to the Random Forest makes it possible that the selected feature is not necessarily informative. So it is necessary to select features in the Random Forest. The purpose of choosing this feature is to select an optimal subset of features that contain valuable information in the hope of accelerating the performance of the Random Forest method. Mainly for the execution of high-dimensional datasets such as the Parkinson, CNAE-9, and Urban Land Cover dataset. The feature selection is done using the Correlation-Based Feature Selection method, using the BestFirst method. Tests were carried out 30 times using the K-Cross Fold Validation value of 10 and dividing the dataset into 70% training and 30% testing. The experiments using the Parkinson dataset obtained a time difference of 0.27 and 0.28 seconds faster than using the Random Forest method without feature selection. Likewise, the trials in the Urban Land Cover dataset had 0.04 and 0.03 seconds, while for the CNAE-9 dataset, the difference time was 2.23 and 2.81 faster than using the Random Forest method without feature selection. These experiments showed that the Random Forest processes are faster when using the first feature selection. Likewise, the accuracy value increased in the two previous experiments, while only the CNAE-9 dataset experiment gets a lower accuracy. This research’s benefits is by first performing feature selection steps using the Correlation-Base Feature Selection method can increase the speed of performance and accuracy of the Random Forest method on high-dimensional data.
关键词：Random forest;Feature selection;BestFirst method;High dimensional data;CNAE-9 dataset