Design and Implementation of Intelligent Classroom Framework Through Light-Weight Neural Networks Based on Multimodal Sensor Data Fusion Approach
Lakshaga Jyothi Murugesan, Shanmugasundaram Ramasamy Seeranga Chettiar
Abstract
Intelligent classrooms are becoming famous. Multimodal sensor data fusion technique, where data generated from different sensors are fused to derive at some valuable insights from the classroom settings. In this paper, the proposed framework model tries to enable intelligence in a traditional Classroom Environment by experimenting on modules such as Deep Learning based Face recognition systems, Interactive Smart Mirror Assistant, Indoor Classroom Air quality monitors. Sensor hub (Jedi One) helps to visualize and analyse streaming data in real-time. Based on the proposed framework design, experimentations are carried out. The accuracy achieved in the Face Recognition System of 71% has to be increased with 80-90% by finetuning the parameters. In future, Interactive dashboards can be activated via PowerBI or Excel worksheets. Based on the questionnaire study & responses from the participants on AI & IoT systems inside the classrooms, more than 50% responded positively to support the usage of these technologies in a Classroom Environment. The future classrooms will be (DLeIC) Deep Learning enabled IoT Classrooms to lift the educational space into a new dimension. Incorporating Deep Learning on IoT systems can be a savvy and fruitful path to collaborate with generations to come.