Application of artificial intelligence for feature engineering in education sector and learning science
Chao Wang, Tao Li, Zhicui Lu, Zhenqiang Wang, Tmader Alballa, Somayah Abdualziz Alhabeeb, Maryam Sulaiman Albely, Hamiden Abd El‐Wahed Khalifa
Abstract
This study investigates the utilization of artificial intelligence (AI) for feature engineering in the education sector, highlighting its potential to enhance individualized learning and improve academic outcomes. The correlation analysis, performed using a correlation matrix of the feature set, indicated that specific pairings of characteristics exhibit a strong association, resulting in the ineffectiveness of conventional models. In order to tackle this issue, we utilized three sophisticated machine learning methodologies: Adaptive Lasso (ALasso), Artificial Neural Networks (ANN), and Support Vector Regression (SVR). The ALasso model discovered several influential characteristics, namely Gender (X5), Education (X1), Hours of Work (X4), and Marital Status (X6), that significantly affect salaries. Subsequently, a comparative evaluation of these methods was conducted using Root Mean Squared Error (RMSE) and Mean Absolute Error (MAE). The results demonstrated that SVR outperformed the other techniques, with the most optimal RMSE of 0.595 and MAE of 0.423. These findings emphasize the significance of using data-driven strategies in policymaking and propose further investigation into the use of AI methods in various educational contexts to improve the identification of features and the performance of models.