An Analysis of The Small Sample Datasets Based on Machine Learning
Shaoxuan Zhou
Abstract
In machine learning, building the optimal model for small sample data has become a widespread issue in the data science community. Some methods have been proven to achieve high accuracy in training small sample datasets. However, the solution to more extreme minor sample problems still lacks further exploration. Therefore, this paper will explore the prediction accuracy of machine learning methods for small sample datasets. Collecting the forest fire dataset and pulsar dataset from Kaggle as examples, the prediction of various machine learning models (SVM, random forest, neural networks, regression) was carried out, respectively. It was found that the machine learning model failed to achieve high prediction accuracy in the imbalanced samples represented by the forest fire dataset. Because of the small number and the imbalanced distribution, the model cannot obtain an apparent discrimination degree for each feature.