AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning
Ruiyi Zhang, Rushi Qiang, Sai Ashish Somayajula, Pengtao Xie
Abstract
Ruiyi Zhang, Rushi Qiang, Sai Ashish Somayajula, Pengtao Xie. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2024.
Topics & Concepts
Meta learning (computer science)Rank (graph theory)Adaptation (eye)Computer scienceMatrix (chemical analysis)Meta-analysisMatrix algebraLearning to rankArtificial intelligenceMathematicsRanking (information retrieval)EngineeringCombinatoricsMaterials sciencePhysicsInternal medicineTask (project management)OpticsMedicineComposite materialQuantum mechanicsEigenvalues and eigenvectorsSystems engineeringAnomaly Detection Techniques and ApplicationsDomain Adaptation and Few-Shot LearningMachine Learning and ELM