AUT Journal of Civil Engineering

AUT Journal of Civil Engineering

Clockwork Recurrent Neural Network- M5T: A New Machine Learning Model for Predicting Reservoir Inflow

Document Type : Research Article

Authors
Department of Water Engineering, Shahrekord University, Shahrekord, Iran
Abstract
Reservoir inflow prediction is critical for effective water management. By accurately forecasting these inflows, reservoir operators can make well-informed choices regarding water releases, which can influence both the availability of water downstream and the potential for flooding. This research introduces a novel predictive model called the Clockwork Recurrent Neural Network (CWRNN)-M5T, specifically designed to forecast monthly reservoir inflow. By synthesizing these two models, this study proposes a groundbreaking method that significantly improves prediction accuracy and provides critical insights for effective water resource management. The CWRNN-M5T model can predict inflow for one, two, and three months ahead. This study showcases the model's effectiveness, contributing to advancements in engineering informatics for water resource management and optimal dam operations. It also explores how the model's performance changes with longer prediction horizons, emphasizing its limitations and potential real-world applications. The models utilized the lagged reservoir inflow values as inputs. For one month predictions, the CWRNN model yielded the best results. However, the CWRNN-M5T model surpassed all others, achieving a Nash Sutcliffe efficiency (NSE) of 0.98, compared to 0.94 for the CWRNN model. Additionally, the CWRNN-M5T model recorded the lowest mean absolute error (MAE) at 0.123, while the CWRNN model had an MAE of 0.210. For two months predictions, the CWRNN-M5T model achieved the lowest root mean square error (RMSE) of 0.254. Overall, the CWRNN-M5T model has proven to be a highly effective tool for predicting reservoir inflow.
Keywords
Subjects

[1] X. Zhang, H. Wang, A. Peng, W. Wang, B. Li, and X. Huang, Quantifying the uncertainties in data-driven models for reservoir inflow prediction, Water Resources Management 34, 4 (2020): 1479-1493.
[2] Bashir, M. A. Shehzad, I. Hussain, M. I. Asif Rehmani, and S. H. Bhatti, Reservoir inflow prediction by ensembling wavelet and bootstrap techniques to multiple linear regression model, Water Resources Management 33, 15 (2019): 5121-5136.
[3] M. Babaei, R. Moeini, and E. Ehsanzadeh, Artificial neural network and support vector machine models for inflow prediction of dam reservoir (case study: Zayandehroud dam reservoir), Water Resources Management 33, 6 (2019): 2203-2218.
[4] B. Luo, Y. Fang, H. Wang, and D. Zang, Reservoir inflow prediction using a hybrid model based on deep learning, In IOP Conference Series: Materials Science and Engineering vol. 715, 1, p. 012044. IOP Publishing, 2020.
[5] H. Apaydin, H. Feizi, M. T. Sattari, M. S. Colak, Sh. Shamshirband, and K. W. Chau, Comparative analysis of recurrent neural network architectures for reservoir inflow forecasting, Water 12, 5 (2020): 1500
[6] T. D. Tran, V. N. Tran, and J. Kim, Improving the accuracy of dam inflow predictions using a long short-term memory network coupled with wavelet transform and predictor selection, Mathematics 9, 5 (2021): 551.
[7] Z. C. Herbert, Z. Asghar, and C. A. Oroza, Long-term reservoir inflow forecasts: Enhanced water supply and inflow volume accuracy using deep learning, Journal of Hydrology 601 (2021): 126676.
[8] Y. Qi, Z. Zhou, L. Yang, Y. Quan, and Q. Miao, A decomposition-ensemble learning model based on LSTM neural network for daily reservoir inflow forecasting, Water Resources Management 33, 12 (2019): 4123-4139.
[9] B. Keshtegar, C. Mert, and O. Kisi, Comparison of four heuristic regression techniques in solar radiation modeling: Kriging method vs RSM, MARS, and M5 model tree, Renewable and sustainable energy reviews 81 (2018): 330-341.
[10] R. C. Deo, O. Kisi, and V. P. Singh, Drought forecasting in eastern Australia using multivariate adaptive regression spline, least square support vector machine, and M5Tree model, Atmospheric Research 184 (2017): 149-175.
[11] B. Esmaeilzadeh, M. T. Sattari, and S. Samadianfard, Performance evaluation of ANNs and an M5 model tree in Sattarkhan Reservoir inflow prediction, ISH Journal of Hydraulic Engineering 23, 3 (2017): 283-292.
[12] Z. Yin, Q. Feng, X. Wen, R. C. Deo, L. Yang, J. Si, and Z. He, Design and evaluation of SVR, MARS and M5Tree models for 1, 2, and 3-day lead time forecasting of river flow data in a semiarid mountainous catchment, Stochastic Environmental Research and Risk Assessment 32, 9 (2018): 2457-2476.
[13] N. Rouzegari, Y. Hassanzadeh, and M. T. Sattari, Using the hybrid simulated annealing-M5 tree algorithms to extract the if-then operation rules in a single reservoir, Water Resources Management 33, 10 (2019): 3655-3672.
[14] O. Kisi, Pan evaporation modeling using least square support vector machine, multivariate adaptive regression splines, and M5 model tree, Journal of Hydrology 528 (2015): 312-320.
[15] O. Kisi, and K. S. Parmar, Application of least square support vector machine and multivariate adaptive regression spline models in long term prediction of river water pollution, Journal of Hydrology 534 (2016): 104-112.
[16] E. Ghanbari-Adivi, and M. Ehteram, CEEMDAN-BILSTM-ANN and SVM models: two robust predictive models for predicting river flow, Water Resources Management (2025): 1-37.
[17] M. Ehteram, A. N. Ahmed, Z. Sheikh Khozani, and A. El-Shafie, Convolutional neural network-support vector machine model-gaussian process regression: a new machine model for predicting monthly and daily rainfall, Water Resources Management 37, 9 (2023): 3631-3655.
[18] Sh. Chang, X. Chen, and Ch. Zhao, Flexible Clockwork Recurrent Neural Network for multirate industrial soft sensor, Journal of Process Control, 119 (2022): 86-100.
 [19] J. Gao, Z. Wu, D.  Zhao, and X. Lin, Research on USV path planning method based on CW-RNN framework, In Third International Conference on Computer Science and Communication Technology (ICCSCT 2022), vol. 12506: 63-72.
[20] Y. Yan, Y. Yang, Z. Gao, B. Gao, and R. Lv, Clockwork Convolutional Recurrent Neural Network for Traffic Prediction, In International Conference on Signal and Information Processing, Networking And Computers, pp. 1079-1086. Singapore: Springer Nature Singapore, 2021.
[21] O. Kisi, B. Keshtegar, M. Zounemat-Kermani, S. Heddam, and N. T. Trung, Modeling reference evapotranspiration using a novel regression-based method: radial basis M5 model tree, Theoretical and Applied Climatology 145, 1 (2021): 639-659.
[22] R. M. Adnan, R. R. Mostafa, Elbeltagi, A., Yaseen, Z. M., Shahid, S., and O. Kisi, Development of new machine learning model for streamflow prediction: case studies in Pakistan, Stochastic Environmental Research and Risk Assessment, 4(2022): 999-1033
[23] Rastgou, M., H. Bayat, M. Mansoorizadeh, and A. S. Gregory, Estimating soil water retention curve by extreme learning machine, radial basis function, M5 tree, and modified group method of data handling approaches, Water Resources Research 58, 4 (2022): e2021WR031059.
[24] Y. Shi, Y. Wang, and H. Zheng, Wind speed prediction for offshore sites using a clockwork recurrent network, Energies 15, 3 (2022): 751.
[25] Y. Liu, X.  Zhang, G. Chen, Q. Dong, X. Guo, X. Tian, W. Lu, and T. Peng, Deterministic wave prediction model for irregular long-crested waves with Recurrent Neural Network, Journal of Ocean Engineering and Science 9, 3 (2024): 251-263
[26] Y. Wang, Z. Xiao, and G. Cao, A convolutional neural network method based on Adam optimizer with power-exponential learning rate for bearing fault diagnosis, Journal of Vibroengineering 24, 4 (2022): 666-678.
[27] Y. Xu, F. Li, and A. Asgari, Prediction and optimization of heating and cooling loads in a residential building based on multi-layer perceptron neural network and different optimization algorithms, Energy 240 (2022): 122692.
[28] S. G. Meshram, C. Meshram, F. Akhoni Pourhosseini, M. A. Hasan, and S. Islam, A multi-layer perceptron (MLP)-Fire fly algorithm (FFA)-based model for sediment prediction, Soft Computing 26, 2 (2022): 911-920.
[29] J. Isabona, A. L. Imoize, S. Ojo, O. Karunwi, Y. Kim, C. C. Lee, and C. T. Li, Development of a multilayer perceptron neural network for optimal predictive modeling in urban microcellular radio environments, Applied Sciences 12, 11 (2022): 5713.
[30] G. Zhang, B. Xia, J. Wang, B. Ye, Y. Chen, Z. Yu, and Y. Li, Intelligent state of charge estimation of battery pack based on particle swarm optimization algorithm improved radical basis function neural network, Journal of Energy Storage 50 (2022): 104211.
[31] P.S. Ashofteh, O. Bozorg Haddad, and M.A. Mariño, Climate change impact on reservoir performance indexes in agricultural water supply, Journal of Irrigation and Drainage Engineering 139, 2 (2013): 85-97.