An Adaptive Multi-Agent Architecture with Reinforcement Learning and Generative AI for Intelligent Tutoring Systems: A Moodle-Based Case Study
Juan P. López-Goyez, Alfonso González‐Briones, Yves Demazeau
Abstract
Intelligent Tutoring Systems are increasingly used in higher education to support personalized learning and academic monitoring in large-scale digital environments. However, existing systems are predominantly based on static architecture and rigid rule-based mechanisms, which limit scalability and hinder effective adaptation to heterogeneous learners, evolving learning behaviors, and real-world educational contexts. This paper presents a self-adaptive multi-agent architecture based on Reinforcement Learning for autonomous decision-making in intelligent systems deployed in real environments. The proposal integrates an RL Meta-Agent that dynamically optimizes the selection of specialized agents through an intelligent switching mechanism, considering the user’s state, behavior, and interaction patterns. The architecture was implemented in Moodle using flows orchestrated in n8n, LLMs, databases, APIs developed in Django, and real academic data. For the empirical evaluation, a real and a simulated case study were designed. A questionnaire was administered to university students, considering dimensions of usability, satisfaction and usefulness, and accessibility and interaction, to understand the perception of the system and improvements. The quantitative data were analyzed using descriptive statistics and nonparametric tests (Mann–Whitney U and Kruskal–Wallis), while the qualitative data were examined using thematic categorization. A simulated case study was conducted to analyze the behavior of the system. The results show that the RL Meta-Agent significantly improves system efficiency, response relevance, and adaptive agent selection, demonstrating that self-adaptive RL-based MAS architectures are a viable solution for intelligent systems applied in real-world contexts, providing empirical evidence of their performance and adaptability in complex scenarios such as higher education.