PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models
Fan-Xu Meng, Zhaohui Wang, Muhan Zhang
Topics & Concepts
Computer scienceMathematicsArtificial intelligencePrincipal (computer security)Measure (data warehouse)Singular spectrum analysisSingular value decompositionAlgorithmSingular valueFeature (linguistics)Adaptation (eye)Principal component analysisApplied mathematicsConstraint (computer-aided design)Identification (biology)Natural Language Processing TechniquesLanguage and cultural evolutionTopic Modeling