Convolutions are competitive with transformers for protein sequence pretraining
Kevin Yang, Nicolò Fusi, Alex X. Lu
Topics & Concepts
TransformerComputer scienceArchitectureConvolutional neural networkLanguage modelArtificial intelligenceVoltageEngineeringElectrical engineeringVisual artsArtRNA and protein synthesis mechanismsMachine Learning in BioinformaticsGenomics and Phylogenetic Studies