Protein language models for predicting drug–target interactions: Novel approaches, emerging methods, and future directions
Atabey Ünlü, Erva Ulusoy, Melih Gökay Yiğit, Melih Darcan, Tunca Doğan
Abstract
Identifying new drug candidates remains a critical and complex challenge in drug development. Recent advances in deep learning have demonstrated significant potential to accelerate this process, particularly through the use of protein language models (pLMs). These models aim to effectively capture the structural and functional properties of proteins by embedding them in high-dimensional spaces, thereby providing powerful tools for predictive tasks. This review examines the application of pLMs in drug-target interaction (DTI) prediction, addressing both small-molecule and protein-based therapeutics. We explore diverse methodologies, including end-to-end learning models and those that leverage pre-trained foundational pLMs. Furthermore, we highlight the role of heterogeneous data integration—ranging from protein structures to knowledge graphs—to improve the accuracy of DTI predictions. Despite notable progress, challenges persist in accurately identifying DTIs, mainly due to data-related limitations and algorithmic constraints. Future research directions include utilising multimodal learning approaches, incorporating temporal/dynamic interaction data into training, and employing novel deep learning architectures to refine protein representations, gain a deeper understanding of biological context regarding molecular interactions, and, thus, advance the DTI prediction field. • Protein language models (pLMs) have advanced ML-based drug-target interaction (DTI) prediction in several aspects. • Pre-trained pLM-based DTI prediction models outperform conventional end-to-end models in generalisation and robustness. • Transformers dominate pLM-based DTI prediction models, mainly leveraging self-attention for feature extraction. • New, specialised ML architectures are required in protein science to capture the complexity of molecular interactions entirely. • Multimodal learning can improve DTI prediction by integrating sequences, structures, text, and other relevant data types. • Future pLM-centric DTI studies should incorporate protein binding site-specific features and dynamic interaction data.