Energy Management Based on Neural Networks for a Hydraulic Hybrid Wheel Loader
DOI:
https://doi.org/10.13052/ijfp1439-9776.2338Keywords:
Construction machines, hydraulic hybrid, energy management strategiesAbstract
This paper presents a method to derive optimised energy management strategies for a hydraulic hybrid wheel loader. Energy efficiency is a key aspect for the sustainability of off-road mobile machines. Energy management strategies for on-road hybrid vehicles cannot be directly applied to off-road hybrid machines. One significant reason is that there are added degrees of freedom with respect to how power can be recovered, exchanged and reused in the different functions, such as drivetrain or work functions. This results in more complex energy management strategies being derived. This paper presents an analysis and preliminary conclusions for a proposed method to derive optimised online energy management strategies for a hydraulic hybrid wheel loader. Dynamic programming is used to obtain optimal offline energy management strategies for a series of drive cycles. The results are used as examples to train a neural network. The trained neural network then implements the energy management strategy and is used to make optimised control decisions. Through simulation, the neural network’s ability to learn the dynamic programming decision-making process is shown, resulting in the machine operating with fuel consumption similar to that of the offline optimal energy management strategy. Aspects of simplicity to model these machines for dynamic programming optimisation, the data necessary to train the network, the training process, variables used to learn the dynamic programming decision-making process and the robustness of the network when facing unseen operational conditions are discussed. The paper demonstrates the simplicity of the method for taking into account variables that affect the control decisions, therefore achieving optimised solutions.
Downloads
References
A. M. Ali and D. Söffker, “Towards optimal power management of hybrid electric vehicles in real-time: A review on methods, challenges, and state-of-the-art solutions,” Energies, vol. 11(3), 476, February 2018. DOI: 10.3390/en11030476.
W. Enang and C. Bannister, “Modelling and control of hybrid electric vehicles (A comprehensive review),” Renewable and Sustainable Energy Reviews, vol. 74, pp. 1210–1239, March 2017. DOI: 10.1016/j.rser.2017.01.075.
M. A. Karbaschian and D. Söffker, “Review and comparison of power management approaches for hybrid vehicles with focus on hydraulic drives,” Energies, vol. 7, pp. 3512–3536, May 2014. DOI: 10.3390/en7063512.
W. Zhang et al., “Energy management strategies for hybrid construction machinery: Evolution, classification, comparison and future trends,” Energies, vol. 12, 2024, May 2019. DOI: 10.3390/en12102024.
J. Wang, Z. Yang, S. Liu, Q. Zhang and Y. Han, “A comprehensive overview of hybrid construction machinery,” Advances in Mechanical Engineering, Vol. 8(3) 1–15, 2016. DOI: 10.1177/1687814016636809.
P. Casoli, A. Gambarotta, N. Pompini and L. Riccò, “Hybridization methodology based on DP algorithm for hydraulic mobile machinery: Application to a middle size excavator,” Automation in Construction, vol. 61, pp. 42–57, January 2016a. DOI: 10.1016/j.autcon.2015.09.012.
K. Baer, Simulation-Based Optimization of a Series Hydraulic Hybrid Vehicle: Division of Fluid and Mechatronic Systems. Doctoral Thesis. Department of Management and Engineering. Linköping University, Sweden. 2018. ISBN 978-91-7685-344-3.
A. Somà, “Trends and hybridization factor for heavy-duty working vehicles,” Intech, June 2017. DOI: 10.5772/intechopen.68296.
I. Naskoudakis and K. Petroutsatou, “A thematic review of the main research on construction equipment over recent years,” Periodica Polytechnica Architecture, vol. 47(2), pp. 110–118, January 2016. DOI: 10.3311/PPar.10384.
V. Krithika and C. Subramani, “A comprehensive review on choice of hybrid vehicles and power converters, control strategies for hybrid electric vehicles,” International Journal of Energy Research, vol. 42(5), pp. 1789–1812, March 2018. DOI: 10.1002/er.3952.
H. Lee, C. Kang, Y. Park and S. W. Char, “A study on power management strategy of HEV using dynamic programming,” EVS29 International Battery, Hybrid and Fuel Cell Electric Vehicle Symposium. Canada. June 2016.
K. Uebel, H. Raduenz, P. Krus, and V. J. De Negri, “Design optimisation strategies for a hydraulic hybrid wheel loader,” in: ASME/BATH Symposium on Fluid Power and Motion Control (FPMC2018). Bath, United Kingdom, September 2018.
F. Wang, M. Azrin, M. Zulkfli, Z. Sun, and K. A. Stelson, “Energy management strategy for a power-split hydraulic hybrid wheel loader,” Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, vol. 230(8), pp. 1105–1120, July 2016. DOI: 10.1177/0954407015600899.
Y. L. Murphey et al., “Intelligent Hybrid Vehicle power control – part I: Machine Learning of Optimal Vehicle Power,” IEEE Transactions on Vehicular Technology, vol. 61(8), pp. 3519–3530, October 2012. DOI: 10.1109/TVT.2012.2206064.
R. Bellman, Dynamic Programming. Princeton, NJ: Princeton University Press, 1957.
D. P. Bertsekas, Dynamic Programming and Optimal Control – Volume I, 3rd Ed. Nashua, NH, Athena Scientific, 2005.
T. M. Mitchell, Machine Learning. New York, NY: McGraw-Hill, 1997.
M. Sprengel and M. Ivantysynova, “Neural network based power management of hydraulic hybrid vehicles,” International Journal of Fluid Power, vol. 18(2), pp. 79–91, July 2017. DOI: 10.1080/14399776.2016.1232117.
C. Majed, S. H. Karaki, and R. Jabr, “Neural network technique for hybrid electric vehicle optimization,” Proceedings of the 18th Mediterranean Electrotechnical Conference. Cyprus, April 2016.
J. Park, Z. Chen, and Y. L. Murphey, “Intelligent vehicle power management through neural learning,” The 2010 International Joint Conference on Neural Networks (IJCNN), pp. 1–7, July 2010. DOI: 10.1109/IJCNN.2010.5596725.
Z. Chen, C. C. Mi, J. Xu, X. Gong, and C. You, “Energy management for a power-split plug-in hybrid electric vehicle based on dynamic programming and neural networks,” IEEE transactions on Vehicular Technology, Vol. 63, No. 4, pp. 1567–1580, May 2014. DOI: 10.1109/TVT.2013.2287102.
C. W. Yen and M. L. Nagurka, “Design of predictive controllers by dynamic programming and neural networks,” Proceedings of the American Control Conference. Denver, CO, pp. 1284–1289, June 2003. DOI: 10.1109/ACC.2003.1239766.
S. Hui and J. Junqing, “Research on the system configuration and energy control strategy for parallel hydraulic hybrid loader,” Automation in Construction, vol. 19(2), pp. 213–220, March 2010. DOI: 10.1016/j.autcon.2009.10.006.
H. T. Do, “Energy management of parallel hydraulic hybrid wheel loader with focus on fuel consumption minimization,” Master Thesis, KTH Royal Institute of Technology, 2018.
O. Sundström, and L. Guzzella, “A generic dynamic programming Matlab function,” 2009 IEEE Control Applications, (CCA) & Intelligent Control, no. 7, pp. 1625–1630, July 2009. DOI: 10.1109/CCA.2009.5281131.
E. Alpaydin, Introduction to Machine Learning, 2nd ed. Cambridge, MA: MIT Press, 2010.
