Reinforcement Learning-Driven Microgrid Dispatch Under Extreme Weather Events: A Risk-Averse Decision Architecture for Coastal Cities
DOI:
https://doi.org/10.13052/dgaej2156-3306.4127Keywords:
RARLDA, CVaR, microgrid dispatch, extreme weather events, coastal cities resilience, weather-derived risk indicesAbstract
Resilience in action through the growing effects of weather events that threaten the stability of coastal energy infrastructure systems and microgrids with risks not manageable by traditional dispatch techniques. Discuss Risk Averse Reinforcement Learning Decision Architecture (RARLDA), proposed with the intention of integrating risk responsiveness into traditional dispatch plans. Discuss the uniqueness of RARLDA over existing conventional reinforcement learning models through its adaptation from average performance measures into risk-aware decision-making with primary attention devoted to maximum wind speed, rainfall intensity, and temperature. Adopt a qualitative research methodology through the utilization of the “Top 100 Cities Weather Dataset” with the purpose of developing risk indices specific for coastal areas. The research also makes use of median imputation techniques for the elimination of any gaps in the dataset with additional focus on Z score normalization for maximum reliability of the dataset. Calculate the risk indices based on the use of the percentile-based thresholds, together with the use of the Conditional Value at Risk penalization, incorporating them into the RL reward function. The validity of the framework can be shown through the simulation outcome, thereby providing the measure of novelty and performance, where the value of the mean reward is calculated to be 9.84, the mean accuracy defined at 75.95%, and the mean risk index threshold derived at 0.070, thereby outdoing other techniques based upon stability and adaptability. Finally, the conclusion could be derived based upon the contribution to the field, thereby providing the insights into the integration of the risk associated with the climate change into the learning process itself, thereby providing the notion of a qualitatively verified and risk-sensitive model within the field of Resilient and Graceful Management of Energy Systems within the Coastal Cities.
Downloads
References
Zhou Y, Zhou L, Yi Z, Shi D, Guo M. Leveraging AI for enhanced power systems control: an introductory study of model-free deep reinforcement learning approaches. IEEE Access, 2024, 12: 98189–98206.
Zhang X, Wang Q, Yu J, Sun Q, Hu H, Liu X. A multi-agent deep-reinforcement-learning-based strategy for safe distributed energy resource scheduling in energy hubs. Electronics, 2023, 12(23): 4763.
Zaman MA, Razzak MA. Sustainable microgrid analysis for Kutubdia Island of Bangladesh. IEEE Access, 2022, 10: 37533–37556.
Yoon S, Jang D, Yoon H, Park T, Lee K. GRU-based deep learning framework for real-time, accurate, and scalable UAV trajectory prediction. Drones, 2025, 9(2): 142.
Yang X, et al. Robust optimization dispatch for PV-rich power systems considering demand response and energy storage systems. Frontiers in Energy Research, 2024, 12: 1415874.
Xu W, Guo Y, Meng T, Wang Y, Yu J. Coordinated dispatch based on distributed robust optimization for interconnected urban integrated energy and transmission systems. Journal of Modern Power Systems and Clean Energy, 2024, 12(3): 840–851.
Xu F, et al. Hydrogels for tissue engineering: addressing key design needs toward clinical translation. Frontiers in Bioengineering and Biotechnology, 2022, 10: 849831.
Wu M, Ma D, Xiong K, Yuan L. Deep reinforcement learning for load frequency control in isolated microgrids: a knowledge aggregation approach with emphasis on power symmetry and balance. Symmetry, 2024, 16(3): 322.
Vamvakas D, et al. Review and evaluation of reinforcement learning frameworks on smart grid applications. Energies, 2023, 16(14): 5326.
Emdadi, K., Gandomkar, M., & Nikoukar, J. (2025). Energy scheduling of renewable integrated system with hydrogen storage in distribution grid including charging and hydrogen stations of eclectic vehicles. Scientific Reports, 15(1), 16347.
Théate T, Ernst D. Risk-sensitive policy with distributional reinforcement learning. Algorithms, 2023, 16(7): 325.
Sugumar BK, Anglani N. A novel decision-support framework for renewable energy technology siting in microgrids focusing on resilience and SDGs. Energies, 2025, 18(3): 544.
Bakeer A, Elmorshedy MF, Salama HS, Elkadeem MR, Almakhles DJ, Kotb KM. Optimal design and performance analysis of coastal microgrids using different optimization algorithms. Electrical Engineering, 2023, 105(6): 4499–4523.
Stavrev S, Ginchev D. Reinforcement learning techniques in optimizing energy systems. Electronics, 2024, 13(8): 1459.
Sakki GK, Tsoukalas I, Kossieris P, Makropoulos C, Efstratiadis A. Stochastic simulation–optimization framework for renewable energy systems under uncertainty. Renewable and Sustainable Energy Reviews, 2022, 168: 112886.
Qin JC, Jiang R, Mo H, Dong D. Data-driven mixed-integer programming for joint chance-constrained optimal power flow under uncertainty. International Journal of Machine Learning and Cybernetics, 2025, 16(2): 1111–1127.
Panzer M, Bender B, Gronau N. Deep reinforcement learning-based hyper-heuristic for modular production control. International Journal of Production Research, 2024, 62(8): 2747–2768.
Nozari H, Szmelter-Jarosz A, Weiland D. Fuzzy multi-objective sustainable and agile supply chain model using digital twin and IoT. Applied Sciences, 2025, 15(19): 10399.
Nguyen DN, Usuda Y, Imamura F. Disaster risk reduction in urban areas through smart community infrastructure standardization. Sustainability, 2024, 16(21): 9586.
Nasab NM, Kilby J, Bakhtiaryfard L. Hybrid wind and tidal turbine microgrid for remote off-grid communities. Energies, 2021, 14(12): 3636.
Meregillano EO, Delina LL. Impacts of extreme weather events on coastal electricity systems. The Electricity Journal, 2023, 36(9–10): 107339.
Martin N. Risk assessment of future climate and land-use change impacts on water resources. Hydrology, 2021, 8(1): 38.
Lee S, Seon J, Hwang B, Kim S, Sun Y, Kim J. Recent trends in machine-learning-based energy management systems. Energies, 2024, 17(3): 624.
Manas, M. (2018). Optimization of distributed generation based hybrid renewable energy system for a DC micro-grid using particle swarm optimization. Distributed Generation & Alternative Energy Journal, 33(4), 7–25.
Kim I, Jeon Y, Chae J, You D. Deep reinforcement learning for fluid mechanics: control and optimization. Fluids, 2024, 9(9): 216.
Ishraque MF, et al. Grid-connected microgrid optimization for a coastal island. Sustainability, 2022, 14(24): 16697.
Ghasemi R, et al. multi-objective decision-making for an island microgrid. Sustainability, 2023, 15(18): 13900.
Ghahramani M, Habibi D, Ghamari S, Soleimani H, Aziz A. Renewable-based isolated power systems: scalability and uncertainty modeling. Clean Technologies, 2025, 7(3): 80.
Ghahramani M, Habibi D, Aziz A. Risk-averse data-driven distributionally robust optimization for power systems. Energies, 2025, 18(19): 5245.
Gautam M. Deep reinforcement learning for resilient power and energy systems. Electricity, 2023, 4(4): 336–380.
Garlík B. Energy sustainability of building clusters using smart grids. Energies, 2022, 15(5): 1649.
Escobar-González D, et al. Soil moisture forecasting using transfer learning. Water, 2024, 16(6): 832.
Di Persio L, Alruqimi M, Garbelli M. Stochastic approaches to energy markets. Energies, 2024, 17(23): 6106.
Dawn S, et al. Renewable energy integration in deregulated microgrids. Advanced Energy and Sustainability Research, 2024, 5(10): 2400088.
Das A, Ni Z, Zhong X. Microgrid energy scheduling under extreme weather using reinforcement learning. International Journal of Electrical Power & Energy Systems, 2023, 152: 109210.
Daeli A, Mohagheghi S. Power grid infrastructural resilience against extreme events. Energies, 2022, 16(1): 64.
Chaudhary MT, Piracha A. Natural disasters: origins, impacts, and management. Encyclopedia, 2021, 1(4): 1101–1131.
Canziani F, et al. Reliability and cost analysis of rural hybrid microgrids. Energies, 2021, 14(19): 6396.
Bedoui R, Noiali S, Hamdi H. Hedge fund portfolio optimization using vine copula-GARCH-EVT-CVaR. International Journal of Entrepreneurship and Small Business, 2020, 39(1–2): 121–140.
Azizi R, Koskinopoulou M, Petillot Y. Machine learning approaches for PPE detection in construction sites. Robotics, 2024, 13(2): 31.

