Hydra: Multi-head low-rank adaptation for parameter efficient fine-tuning
Sanghyeon Kim, Hyun-Mo Yang, Yunghyun Kim, Youngjoon Hong, Eunbyung Park
Topics & Concepts
Computer scienceLernaean HydraInferenceAdaptation (eye)GeneralizationFine-tuningArtificial intelligenceMachine learningTheoretical computer scienceMathematical analysisOpticsClassicsMathematicsQuantum mechanicsPhysicsHistoryAdvanced Neural Network ApplicationsDomain Adaptation and Few-Shot LearningMultimodal Machine Learning Applications