Online Measurement Method of Intelligent Energy Meter Based on Heuristic Q-Learning Algorithm
DOI:
https://doi.org/10.13052/dgaej2156-3306.40410Keywords:
Smart energy meters, online measurement, heuristic Q-learning, smart grid, abnormal data detectionAbstract
With China’s rapid smart grid development, smart energy meters have been widely applied in the power system. To solve large measurement errors and poor stability in traditional electric energy meters, an online electricity metering method based on heuristic Q-learning algorithm is designed. Based on prior knowledge, a heuristic action learning module is designed to guide the action output. A parallel hybrid deep neural network model is constructed to explore the relationship between electric energy data, line energy loss values, and line loss sequences at different time periods from multiple dimensions. The results showed that the accuracy in analyzing abnormal data was higher than 95%. The accuracy of the online error estimation algorithm was higher than 90%, which was significantly improved when compared with previous algorithms. When the line loss rate was less than 7.5%, the accuracy of the online error estimation algorithm was higher than 90%, greatly reducing the interference of line energy loss on online error estimation. This method can effectively solve the problems such as large error, poor stability, and insufficient adaptability of traditional electric meters, especially in the complex cases such as changes in line energy loss and abnormal data types. The proposed method can effectively improve the online measurement accuracy of smart energy meters, accurately estimating the errors of cluster smart energy meters in real-time.
Downloads
References
Usman A M, Abdullah M K., “An assessment of building energy consumption characteristics using analytical energy and carbon footprint assessment model”. Green and Low-Carbon Economy, 2023, 1(1): 28–40.
Aryavalli S N G, Kumar G H., “Futuristic vigilance: Empowering chipko movement with cyber-savvy IoT to safeguard forests”. Archives of Advanced Engineering Science, 2023, 1(8): 1–16.
Bae J, Lee J, Chong S., “Learning to schedule network resources throughput and delay optimally using Q-learning”. IEEE/ACM Transactions on Networking, 2021, 102(99): 1–14.
Liu K, Sun Y, Yang D., “The administrative center or economic center: Which dominates the regional green development pattern. A case study of Shandong Peninsula urban agglomeration, China”. Green and Low-Carbon Economy, 2023, 1(3): 110–120.
Badr M M, Ibrahem M I, Mahmoud M, Fouda M M, Alsolami F, Alasmary W., “Detection of false-reading attacks in smart grid net-metering system”. IEEE Internet of Things Journal, 2022, 9(2): 1386–1401.
Wang D, Zhang W, He H, Yu C T., “Efficient hybrid central processing unit/input-output resource scheduling for virtual machines”. IEEE Transactions on Industrial Electronics, 2021, 68(3): 2714–2724.
Wang Y, Liu Y T, Chen W, Ma Z M, Liu T Y., “Target transfer Q-learning and its convergence analysis”. Neurocomputing, 2020, 392(7): 11–22.
Xiang B I, Huang H, Zhang B, Xing W., “A hybrid routing algorithm for V2V communication in VANETs based on blocked Q-learning”. IEICE Transactions on Communications, 2022, 8(1): 1–73.
Ilker G, Ozsoydan F B., “Q-learning and hyper-heuristic based algorithm recommendation for changing environments”. Engineering Applications of Artificial Intelligence, 2021, 102(4): 1084–1103.
Lim S, Yu H, Lee H., “Optimal tethered-UAV deployment in A2G communication networks: Multi-agent Q-learning approach”. IEEE Internet of Things Journal, 2022, 9(19): 18539–18549.
Fekri M N, Patel H, Grolinger K, Sharma V., “Deep learning for load forecasting with smart meter data: Online adaptive recurrent neural network”. Applied Energy, 2020, 282(3): 116177.1–116177.17.
Yan S, Li K, Wang F, Yan S, Wang F., “Time-frequency features combination-based household characteristics identification approach using smart meter data”. IEEE Transactions on Industry Applications, 2020, 56(3): 2251–2262.
Biswas S, Himanshu G S, Das P, Saha K, De S., “Efficient data transfer mechanism for DLMS/COSEM enabled smart energy metering platform”. Performance Evaluation Review, 2023, 50(4): 14–16.
Zakariazadeh A., “Smart meter data classification using optimized random forest algorithm”. ISA Transactions, 2021, 126(3): 361–369.
Qaisar S M, Alsharif F., “Event-driven system for proficient load recognition by interpreting the smart meter data”. Procedia Computer Science, 2020, 168(26): 210–216.
Cao H, Wu Y, Bao Y, Feng X, Wan S, Qian C., “UTrans-Net: A model for short-term precipitation prediction”. Artificial Intelligence and Applications, 2023, 1(2): 106–113.
Zhao B, Ye M, Stankovic L, Stankovic V., “Non-intrusive load disaggregation solutions for very low-rate smart meter data”. Applied Energy, 2020, 268(14): 949–962.
Wang J, Srikantha P., “Stealthy black-box attacks on deep learning non-intrusive load monitoring models”. IEEE Transactions on Smart Grid, 2021, 12(4): 3479–3492.
Ly A, El-Sayegh Z., “Tire wear and pollutants: An overview of research”. Archives of Advanced Engineering Science, 2023, 1(1): 2–10.
Garai S, Paul R K, Kumar M., “Intra-annual national statistical accounts based on machine learning algorithm”. Journal of Data Science and Intelligent Systems, 2023, 2(2): 12–15.

