Robust Scheduling Algorithm for Virtual Power Plants in Distributed Multi-Energy Systems Based on Generative Adversarial Reinforcement Learning
DOI:
https://doi.org/10.13052/dgaej2156-3306.4145Keywords:
Distributed Multi-Energy Systems, Virtual Power Plants, Scheduling Strategies, Wasserstein Generative Adversarial Networks, Reinforcement Learning, Proximal Policy OptimizationAbstract
In the scheduling of distributed multi-energy virtual power plants, this paper proposed a robust scheduling method based on Wasserstein Generative Adversarial Network with Reinforcement Learning (WGAN-RL) to address the vulnerability of scheduling strategies caused by renewable energy output fluctuations and load uncertainties. This method defined the state and action space based on physical constraints and embedded hard operating rules. Then, it designed a conditional Wasserstein GAN to generate the worst-case perturbation scenario that approximates the real distribution support boundary and covers high-risk areas, based on weather and load forecasts. On this basis, it used Proximal Policy Optimization (PPO) to train the scheduling policy in an environment with dynamically injected extreme perturbations, and improved the convergence stability by pruning probability ratios and GAE. Finally, it introduced a rolling time-domain online scheduling and a weekly fine-tuning mechanism of WGAN to achieve long-term adaptability under perturbation distribution drift. Experiments show that, in terms of economics, with a 70% renewable energy penetration rate, the average daily dispatch cost is 2680 USD ± 150 USD, and the curtailment rate is 9.6% ± 1.1%. Regarding robustness, under a perturbation of 0.7 output standard deviation, the dispatch feasibility rate remains at 90.1% ± 2.1%, and the number of strategy collapses is controlled at 9.9 ± 2.1. In terms of real-time performance, the single-step inference time is only 4.2 ms ± 0.3 ms, and the training convergence steps are only 823. This research provides a deployable, adaptive, and engineering-feasible technical path for robust dispatch of virtual power plants under high uncertainty environments.
Downloads
References
F. Ghasemi Olanlari, T. Amraee, M. Moradi-Sepahvand, et al., ‘Coordinated multi-objective scheduling of a multi-energy virtual power plant considering storages and demand response’, IET Generation, Transmission & Distribution, vol. 16, no. 17, pp. 3539–3562, 2022.
L. Yue, X. Liang, L. Sun, Y. Li, C. Cheng, ‘Research on Collaborative Control Strategy of Virtual Power Plant Based on Deep Reinforcement Learning Framework’, Distributed Generation & Alternative Energy Journal, vol. 40, no. 03, pp. 533–558, 2025.
Li, H., Wang, C., Tian, H., Ren, Z., Zhao, E., and Xu, L., ‘A Multi-objective Optimization Planning Framework for Active Distribution System Via Reinforcement Learning’, Distributed Generation & Alternative Energy Journal, vol. 38, no. 06, pp. 1745–1768, 2023.
J. Liu, N. Luo, L. Chen, F. Zheng, C. Xu, ‘A Two-stage Optimal Dispatching Method of Distribution Network Considering the High Proportion of Distributed Renewable Energy Penetration’, Distributed Generation & Alternative Energy Journal, vol. 40, no. 01, pp. 109–140, 2025.
B. Li, J. J. Wang, X. F. Bai, et al., ‘Overview and prospect of information and communication technology development in virtual power plants’, Energy Conversion and Economics, vol. 3, no. 6, pp. 368–380, 2022.
X. Wan, X. Wen, T. Gong, et al., ‘The low-carbon economic operation strategy of virtual power plant under different electricity-gas-heat-carbon multi-market synergy scenarios’, Journal of Computational Methods in Sciences and Engineering, vol. 23, no. 4, pp. 2237–2254, 2023.
Z. Qiu, X. Zhang, Z. Han, et al., ‘Power allocation optimization strategy for multiple virtual power plants with diversified distributed flexibility resources’, IET Renewable Power Generation, vol. 18, no. 16, pp. 4034–4046, 2024.
Z. Ullah, B. M. Mirjat, ‘Optimisation and Management of Virtual Power Plants Energy Mix Trading Model’, Int. J. Renew. Energy Dev, vol. 11, no. 1, pp. 83–94, 2022.
B. Li, F. Yang, B. Qi, et al., ‘Research on key technologies of P2P transaction in virtual power plant based on blockchain’, IET Smart Grid, vol. 5, no. 4, pp. 223–233, 2022.
S. Wang, W. Wu, Q. Chen, et al., ‘Stochastic flexibility evaluation for virtual power plants by aggregating distributed energy resources’, CSEE Journal of Power and Energy Systems, vol. 10, no. 3, pp. 988–999, 2022.
Z. Dou, C. Zhang, C. Duan, et al., ‘Multi-time scale economic regulation model of virtual power plant considering multiple uncertainties of source, load and storage’, Journal of Computational Methods in Science and Engineering, vol. 24, no. 2, pp. 935–953, 2024.
M. H. Salehi, M. Moradian, M. Moazzami, et al., ‘Distributed energy technologies planning and sizing in a sample virtual power plant using speedy particle swarm optimization algorithm’, International Journal of Smart Electrical Engineering, vol. 12, no. 4, pp. 253–266, 2023.
H. Gao, T. Jin, G. Wang, et al., ‘Low-carbon dispatching for virtual power plant with aggregated distributed energy storage considering spatiotemporal distribution of cleanness value’, Journal of Modern Power Systems and Clean Energy, vol. 12, no. 2, pp. 346–358, 2024.
X. Bai, Y. Fan, R. Hao, et al., ‘Data-driven virtual power plant aggregation method’, Electrical Engineering, vol. 107, no. 1, pp. 569–578, 2025.
S. Mishra, C. Bordin, Q. Wu, et al., ‘Resilient expansion planning of virtual power plant with an integrated energy system considering reliability criteria of lines and towers’, International journal of energy research, vol. 46, no. 10, pp. 13726–13751, 2022.
N. Gu, J. Cui, C. Wu, ‘An auto-tuned robust dispatch strategy for virtual power plants to provide multi-stage real-time balancing service’, IEEE Transactions on Smart Grid, vol. 14, no. 6, pp. 4494–4507, 2023.
M. Basu, C. Jena, B. Khan, ‘Dynamic optimal power flow for multi-operator renewable energy-based virtual power plants’, IET Renewable Power Generation, vol. 17, no. 10, pp. 2625–2637, 2023.
A. Bedi, J. Ramprabhakar, R. Anand, et al., ‘Empowering net zero energy grids: a comprehensive review of virtual power plants, challenges, applications, and blockchain integration’, Discover Applied Sciences, vol. 7, no. 4, pp. 1–22, 2025.
T. Xu, R. Wang, H. Meng, et al., ‘Grid frequency regulation through virtual power plant of integrated energy systems with energy storage’, IET Renewable Power Generation, vol. 18, no. 14, pp. 2277–2293, 2024.
S. Wu, J. Lin, J. Li, et al., ‘Multi-timescale trading strategy for renewable power to ammonia virtual power plant in the electricity, hydrogen, and ammonia markets’, IEEE Transactions on Energy Markets, Policy and Regulation, vol. 1, no. 4, pp. 322–335, 2023.
F. J. Fangshuai, J. C. Junbo, Z. Z. Zhihua, et al., ‘Robust Optimal Scheduling of Distributed Power and Storage Virtual Power Plants Considering Risks’, Modern Electric Power, vol. 40, no. 4, pp. 570–576, 2023.
X. Lu, J. Qiu, C. Zhang, et al., ‘Assembly and competition for virtual power plants with multiple ESPs through a “recruitment–participation” approach’, IEEE Transactions on Power Systems, vol. 39, no. 2, pp. 4382–4396, 2023.
A. Dogan, D. C. Dogan, ‘A review on machine learning models in forecasting of virtual power plant uncertainties’, Archives of Computational Methods in Engineering, vol. 30, no. 3, pp. 2081–2103, 2023.
P. Yong, Z. Yang, N. Zhang, et al., ‘On the Self-Scheduling of Cellular Base Station-Based Virtual Power Plants’, IEEE Internet of Things Journal, vol. 11, no. 14, pp. 24511–24522, 2024.
J. Li, M. Chen, X. Shao, ‘A low-carbon demand response dispatch model for virtual power plants based on information gap decision theory’, Chinese Journal of Management Science, vol. 33, no. 4, pp. 345–356, 2025.
Z. Yi, Y. Xu, C. Wu, ‘Model-free economic dispatch for virtual power plants: An adversarial safe reinforcement learning approach’, IEEE Transactions on Power Systems, vol. 39, no. 2, pp. 3153–3168, 2023.
M. Awadalla, F. Bouffard, ‘Flexibility characterization of sustainable power systems in demand space: A data-driven inverse optimization approach’, IEEE Transactions on Power Systems, vol. 39, no. 5, pp. 6196–6209, 2024.
Q. Fan, D. Liu, ‘A Wasserstein-distance-based distributionally robust chance constrained bidding model for virtual power plant considering electricity-carbon trading’, IET Renewable Power Generation, vol. 18, no. 3, pp. 545–557, 2024.
B. Chen, T. Liu, X. Liu, et al., ‘A Wasserstein distance-based distributionally robust chance-constrained clustered generation expansion planning considering flexible resource investments’, IEEE Transactions on Power Systems, vol. 38, no. 6, pp. 5635–5647, 2022.
C. L. Liu, C. J. Tseng, T. H. Huang, et al., ‘Dynamic parallel machine scheduling with deep Q-network’, IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 53, no. 11, pp. 6792–6804, 2023.
Z. Kuai, T. Wang, S. Wang, ‘Fair virtual network function mapping and scheduling using proximal policy optimization’, IEEE Transactions on Communications, vol. 70, no. 11, pp. 7434–7445, 2022.
N. Khan, S. U. Khan, A. Farouk, et al., ‘Generative adversarial network-assisted framework for power management’, Cognitive Computation, vol. 16, no. 5, pp. 2596–2610, 2024.
M. Kang, R. Zhu, D. Chen, et al., ‘A cross-modal generative adversarial network for scenarios generation of renewable energy’, IEEE Transactions on Power Systems, vol. 39, no. 2, pp. 2630–2640, 2023.
Z. Song, Y. Huang, H. Xie, et al., ‘Generation method of multi-regional photovoltaic output scenarios-set using conditional generative adversarial networks’, IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 13, no. 3, pp. 861–870, 2023.
J. Chen, T. Yu, Z. Pan, et al., ‘Stochastic dynamic power dispatch with human knowledge transfer using graph-GAN assisted inverse reinforcement learning’, IEEE Transactions on Smart Grid, vol. 15, no. 3, pp. 3303–3315, 2023.
Y. Yang, L. Feng, Y. Sun, et al., ‘Decentralized cooperative caching and offloading for virtual reality task based on GAN-powered multi-agent reinforcement learning’, IEEE Transactions on Services Computing, vol. 17, no. 1, pp. 291–305, 2023.
X. Zhang, D. Li, X. Fu, ‘A novel wasserstein generative adversarial network for stochastic wind power output scenario generation’, IET Renewable Power Generation, vol. 18, no. 16, pp. 3731–3742, 2024.
M. N. Hasan, S. U. Jan, I. Koo, ‘Wasserstein GAN-based digital twin-inspired model for early drift fault detection in wireless sensor networks’, IEEE sensors journal, vol. 23, no. 12, pp. 13327–13339, 2023.
Y. Pezhmani, M. A. Mirzaei, K. Zare, et al., ‘Robust self-scheduling of a virtual multi-energy plant in thermal and electricity markets in the presence of multi-energy flexible technologies’, International Journal of Energy Research, vol. 46, no. 5, pp. 6225–6245, 2022.
H. Zhao, X. Wang, Z. Siqin, et al., ‘Two-stage optimal dispatching of multi-energy virtual power plants based on chance constraints and data-driven distributionally robust optimization considering carbon trading’, Environmental Science and Pollution Research, vol. 30, no. 33, pp. 79916–79936, 2023.
Y. Xu, Y. Mu, H. Qi, et al., ‘Optimal dispatch approach for rural multi-energy supply systems considering virtual energy storage’, Global Energy Interconnection, vol. 6, no. 6, pp. 675–688, 2023.

