On the effect of dropping layers of pre-trained transformer models
Hassan Sajjad, Fahim Dalvi, Nadir Durrani, Preslav Nakov
Topics & Concepts
TransformerComputer scienceLimitingSentenceArtificial intelligenceParaphraseMachine learningNatural language processingEngineeringElectrical engineeringMechanical engineeringVoltageTopic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications