SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels
Hengyuan Zhao, Pichao Wang, Yuyang Zhao, Hao Luo, Fan Wang, Mike Zheng Shou
Topics & Concepts
Computer scienceLeverage (statistics)SalientFine-tuningTask (project management)Benchmark (surveying)GeneralizationLimited resourcesArtificial intelligenceFeature (linguistics)Channel (broadcasting)TransformerMachine learningSimple (philosophy)Baseline (sea)Pattern recognition (psychology)Data miningMathematicsStatisticsVoltageLinguisticsGeodesyManagementMathematical analysisOceanographyEpistemologyGeologyComputer networkQuantum mechanicsPhysicsEconomicsPhilosophyGeographyAdvanced Neural Network ApplicationsDomain Adaptation and Few-Shot LearningImage Enhancement Techniques