A method Based on an Attention Mechanism to Measure the Similarity of two Sentences
Seyed Vahid Moravvej, Mehdi Joodaki, Mohammad Javad Maleki Kahaki, Moein Salimi Sartakhti
Abstract
Bidirectional LSTMs and the attention mechanism play an essential role in many areas of natural language processing. Many studies give equal importance to words, which leads to a flawed model. This research offers a method based on Attention-Based Bidirectional Long-Short Term Memory (BLSTM) to solve the problem of plagiarism at the sentence level. For this purpose, word embedding is first made with Glove and Word2Vec methods and is considered as initial embedding. Then the two BLSTM networks are used separately for sentence embedding. Finally, the embedding of sentences and their differences are connected and passed through a classifier. We evaluate our model on two datasets of Persian and English. The evaluation results show the superiority of the proposed model over other compared methods.