Improved robustness of vision transformers via prelayernorm in patch embedding
Bum Jun Kim, Hyeyeon Choi, Hyeonah Jang, Dong Gu Lee, Wonseok Jeong, Sang Woo Kim, Sang Woo Kim
Topics & Concepts
EmbeddingRobustness (evolution)Convolutional neural networkComputer scienceArtificial intelligenceComputer visionTransformerPattern recognition (psychology)EngineeringChemistryElectrical engineeringVoltageBiochemistryGeneAdvanced Neural Network ApplicationsVisual Attention and Saliency DetectionImage Enhancement Techniques