Research on Electricity Load Forecasting and Demand Side Modeling Based on the Integration of Big Data and Machine Learning
DOI:
https://doi.org/10.13052/spee1048-5236.4415Keywords:
Electricity load forecasting, big data, machine learning, LSTM model, demand side modelingAbstract
In recent times, the application of machine learning algorithms in energy forecasting has expanded significantly, facilitated by the abundant data amassed through the integration of sensor technology and power distribution systems. This data richness presents opportunities for leveraging diverse machine learning techniques. Electric load forecasting and strategic planning are pivotal for driving national industrialization and urbanization, enabling the identification of demand-side load patterns and efficient resource allocation, thereby mitigating resource waste or power shortages and fostering economic growth. This study aims to delve into the prediction and analysis of demand-side loads, leveraging the synergy of big data and machine learning methodologies. Key findings reveal that the LSTM model outperforms SVR and DNN in terms of prediction error reduction and robustness. Specifically, for single load type prediction, LSTM achieves an RMSE of 18.65% and an MAE of 18.74%. When applied to multiple load types, LSTM further enhances its performance, with RMSE and MAE declining to 9.73% and 8.89%, respectively. Aggregate load forecasting emerges as an effective strategy to minimize prediction errors stemming from individual variability, with the three models achieving RMSEs of 5.01%, 5.94%, and 6.59%, respectively, underscoring improved predictive accuracy. Notably, apparent temperature significantly influences the load prediction process, exhibiting a strong negative correlation with the average daily load.
Downloads
References
Ahmad, T., and Chen, H. (2020). A review on machine learning forecasting growth trends and their real-time applications in different energy systems. Sustainable Cities and Society. 54, 102010.
Li, L. L., Zhao, X., Tseng, M. L., and Tan, R. R. (2020). Short-term wind power forecasting based on support vector machine with improved dragonfly algorithm. Journal of Cleaner Production. 242, 118447.
Eseye, A. T., and Lehtonen, M. (2020). Short-Term Forecasting of Heat Demand of Buildings for Efficient and Optimal Energy Management Based on Integrated Machine Learning Models. IEEE Transactions on Industrial Informatics. 16, 7743–7755.
García Kerdan, I., and Morillón Gálvez, D. (2022). ANNEXE: An open-source building energy design optimisation framework using artificial neural networks and genetic algorithms. Journal of Cleaner Production. 371, 133500.
Zheng, Z., Shafique, M., Luo, X., and Wang, S. (2024). A systematic review towards integrative energy management of smart grids and urban energy systems. Renewable and Sustainable Energy Reviews. 189, 114023.
Cheng, L. M., Bao, Y. Q., Tang, L., and Di, H. F. (2020). Very-short-term load forecasting based on empirical mode decomposition and deep neural network. IEEJ Transactions on Electrical and Electronic Engineering. 15, 252–258.
Aslam, S., Herodotou, H., Mohsin, S. M., Javaid, N., Ashraf, N., and Aslam, S. (2021). A survey on deep learning methods for power load and renewable energy forecasting in smart microgrids. Renewable and Sustainable Energy Reviews. 144, 110992.
Shen, Y., Ma, Y., Deng, S., Huang, C. J., and Kuo, P. H. (2021). An Ensemble Model based on Deep Learning and Data Preprocessing for Short-Term Electrical Load Forecasting. Sustainability. 13, 1694.
Almaghrebi, A., Aljuheshi, F., Rafaie, M., James, K., and Alahmad, M. (2020). Data-Driven Charging Demand Prediction at Public Charging Stations Using Supervised Machine Learning Regression Methods. Energies. 13, 4231.
Satre-Meloy, A., Diakonova, M., and Grünewald, P. (2020). Cluster analysis and prediction of residential peak demand profiles using occupant activity data. Applied Energy. 260, 114246.
Wang, R., Lu, S., and Feng, W. (2020). A novel improved model for building energy consumption prediction based on model integration. Applied Energy. 262, 114561.
Khan, P. W., Byun, Y. C., Lee, S. J., and Park, N. (2020). Machine Learning Based Hybrid System for Imputation and Efficient Energy Demand Forecasting. Energies. 13, 2681.
Ahmad, W., Ayub, N., Ali, T., Irfan, M., Awais, M., Shiraz, M., and Glowacz, A. (2020). Towards Short Term Electricity Load Forecasting Using Improved Support Vector Machine and Extreme Learning Machine. Energies. 13, 2907.
Bedi, J., and Toshniwal, D. (2019). Deep learning framework to forecast electricity demand. Applied Energy. 238, 1312–1326.
El-Hendawi, M., and Wang, Z. (2020). An ensemble method of full wavelet packet transform and neural network for short term electrical load forecasting. Electric Power Systems Research. 182, 106265.
Seyedzadeh, S., Pour Rahimian, F., Rastogi, P., and Glesk, I. (2019). Tuning machine learning models for prediction of building energy loads. Sustainable Cities and Society. 47, 101484.
Li, J., Deng, D., Zhao, J., Cai, D., Hu, W., Zhang, M., and Huang, Q. (2021). A Novel Hybrid Short-Term Load Forecasting Method of Smart Grid Using MLR and LSTM Neural Network. IEEE Transactions on Industrial Informatics. 17, 2443–2452.
Choi, E., Cho, S., and Kim, D. K. (2020). Power demand forecasting using long short-term memory (LSTM) deep-learning model for monitoring energy sustainability. Sustainability (Switzerland). 12, 1109.
Cai, Q., Yan, B., Su, B., Liu, S., Xiang, M., Wen, Y., Cheng, Y., and Feng, N. (2020). Short-term load forecasting method based on deep neural network with sample weights. International Transactions on Electrical Energy Systems. 30, 12340.
Jain, A., and Gupta, S. C. (2024). Evaluation of electrical load demand forecasting using various machine learning algorithms. Frontiers in Energy Research. 12, 1408119.
Ansari, M. H., Tabatab Vakili, V., and Bahrak, B. (2019). Evaluation of big data frameworks for analysis of smart grids. Journal of Big Data. 6, 1–14.
Ali, H. A. E. S., Alham, M. H., and Ibrahim, D. K. (2024). Big data resolving using Apache Spark for load forecasting and demand response in smart grid: a case study of Low Carbon London Project. Journal of Big Data. 11, 1–26.
Martinez-Pabon, M., Eveleigh, T., and Tanju, B. (2017). Smart Meter Data Analytics for Optimal Customer Selection in Demand Response Programs. Energy Procedia. 107, 49–59.
Syed, D., Zainab, A., Ghrayeb, A., Refaat, S. S., Abu-Rub, H., and Bouhali, O. (2021). Smart Grid Big Data Analytics: Survey of Technologies, Techniques, and Applications. IEEE Access. 9, 59564–59585.
Dong, Y., Ma, X., and Fu, T. (2021). Electrical load forecasting: A deep learning approach based on K-nearest neighbors. Applied Soft Computing. 99, 106900.
Ming Wen, Zongchao Yu, Wenying Li, Shuchen Luo, Yuan Zhong, Chen Changqing. (2023). Short-term load forecasting based on feature mining and deep learning of big data of user electricity consumption. AIP Advances. 13,125315.
Qiao, W., Lu, H., Zhou, G., Azimi, M., Yang, Q., and Tian, W. (2020). A hybrid algorithm for carbon dioxide emissions forecasting based on improved lion swarm optimizer. Journal of Cleaner Production, (244), 118612.
Hu, H., Wang, L., Peng, L., and Zeng, Y. R. (2020). Effective energy consumption forecasting using enhanced bagged echo state network. Energy, 193, 116778.
Sevlian, R., and Rajagopal, R. (2018). A scaling law for short term load forecasting on varying levels of aggregation. International Journal of Electrical Power & Energy Systems, 98, 350–361.
Park, D.C., El-Sharkawi, M., Marks, R., Atlas, L., Damborg, M. (1991). Electric load forecasting using an artificial neural network. IEEE Trans. Power Syst. 6, 442–449.

https://aeeeuropeenergy.com/