Enhancing Learning Experiences For Visually Impaired Students With AI and Machine Learning on Smart Device
D. I. De Silva, S. Vidhanaarachchi, R. A. K. M. Ranasinghe, M. N. N. J. Jayasooriya, D. M. P. S. Jayawardhana, D. K. S. Savishka
Abstract
This paper explores the challenges faced by visually impaired students in educational settings. The research introduces a smart glass system based on YOLOv8 and Internet of Things technology, leveraging advancements in computer vision and machine learning. This system offers real-time object detection and comprehensive voice feedback, facilitating independent learning in subjects such as science, math, and financial transactions. The effectiveness of YOLOv8 has been proven through extensive training and analysis using a comprehensive dataset. By integrating text-to-speech and speech-to-text technologies, the smart glass system is reshaping inclusive education and underscores the importance of equal learning opportunities for visually impaired individuals worldwide, promoting independence, removing educational barriers, and fostering interest in STEM subjects among visually impaired students.