Explaining transformer-based models for automatic short answer grading
Andrew Poulton, Sebas Eliëns
Abstract
Over recent years, advances in natural language processing have brought ever more advanced and expressive language models to the world. With open-source implementations and model registries, these state-of-the-art models are freely available to anyone, and the successful application of transfer learning has meant benchmarks on previously difficult tasks can be beaten with relative ease.
Topics & Concepts
Computer scienceTransformerImplementationGrading (engineering)Natural language processingProgramming languageTransfer of learningOpen sourceArtificial intelligenceNatural languageLanguage modelSoftware engineeringEngineeringSoftwareElectrical engineeringVoltageCivil engineeringTopic ModelingNatural Language Processing TechniquesExplainable Artificial Intelligence (XAI)