Stacked Transformer Models for Enhanced Wind Speed Prediction in the Red Sea
Mohamad Mazen Hittawe, Fouzi Harrou, Ying Sun, Omar Knio
Abstract
Accurate wind speed (WS) prediction in the Red Sea is essential for enhancing maritime operations, climate analysis, and monitoring ecosystems. Due to the region's complex oceanic and atmospheric patterns, this work introduces new models based on Transformer architectures to improve WS forecasting. Transformers are employed for their strength in handling sequential data and capturing time dependencies. A stacked model called StackedTrans has been developed to boost performance further and integrate multiple Transformer layers. The model's effectiveness is tested with WS data collected from ten locations across the Red Sea and evaluated using five statistical metrics. The results indicate that the StackedTrans model consistently outperforms other methods, such as LSTM, BiLSTM, GRU, BIGRU, and single Transformer models. The StackedTrans architecture performed a notable R2 score of 99.96, demonstrating its high precision in WS prediction