A Multi-GPU Accelerated DGTD Method for Solving Electrically Large-Scale Problems
DOI:
https://doi.org/10.13052/2025.ACES.J.401103Keywords:
Discontinuous Galerkin time-domain (DGTD) method, multiple graphics processing units (multi-GPU)Abstract
In this paper, we proposed a multiple graphics processing units (GPU) platform accelerated discontinuous Galerkin time-domain (DGTD) method for solving electrically large-scale problems. Rather than simply porting the code to a GPU, we proposed a cache optimization strategy tailored to the GPU architecture. Furthermore, by grouping and reordering the elements and employing asynchronous techniques, we achieve a linear speedup ratio when scaling across multiple GPUs. The numerical examples not only validate accuracy of the proposed method, but also demonstrate excellent performance, achieving up to 40 times speedup even compared to parallelism CPU implementations.
Downloads
References
J. S. Hesthaven and T. Warburton, Nodal Discontinuous Galerkin Methods, Algorithms, Analysis, and Applications. New York: Springer, 2008.
L. E. Tobón, Q. Ren, and Q. H. Liu, “A new efficient 3D discontinuous Galerkin time-domain (DGTD) method for large and multiscale electromagnetic simulations,” Journal of Computational Physics, vol. 283, pp. 374–387, 2015.
J. Chen and Q. H. Liu, “Discontinuous Galerkin time-domain methods for multiscale electromagnetic simulations: A review,” Proceedings of the IEEE, vol. 101, pp. 242–254, 2013.
J. J. Jin, “From FETD to DGTD for computational electromagnetics,” ACES Tutorial, Williamsburg, VA, Mar. 2015.
R. Sevilla, O. Hassan, and K. Morgan, “The use of hybrid meshes to improve the efficiency of a discontinuous Galerkin method for the solution of Maxwell’s equations,” Computers & Structures, vol. 137, pp. 2–13, 2014.
S. Yan, C. P. Lin, R. R. Arslanbekov, V. I. Kolobov, and J.-M. Jin, “A discontinuous Galerkin time-domain method with dynamically adaptive cartesian mesh for computational electromagnetics,” IEEE Transactions on Antennas and Propagation, vol. 65, pp. 3122–3133, 2017.
I. Hussain, H. Li, and Q. Cao, “Multiscale structure simulation using adaptive mesh in DGTD method,” IEEE Journal on Multiscale and Multiphysics Computational Techniques, vol. 2, pp. 115–123, 2017.
P. Bonnet, X. Ferrières, F. Issac, F. Paladian, J. Grando, J. Alliot, and J. Fontaine, “Numerical modeling of scattering problems using a time domain finite volume method,” Journal of Electromagnetic Waves and Applications, vol. 11, pp. 1165–1189, 1997.
J. Diaz and M. J. Grote, “Energy conserving explicit local time stepping for second-order wave equations,” SIAM Journal on Scientific Computing, vol. 31, pp. 1985–2014, 2009.
A. Taube, M. Dumbser, C. D. Munz, and R. Schneider, “A high-order discontinuous Galerkin method with time-accurate local time stepping for the Maxwell equations,” International Journal of Numerical Modelling: Electronic Networks, Devices and Fields, vol. 22, pp. 77–103, 2009.
L. Zhao, G. Chen, W. Yu, and J. M. Jin, “A fast waveguide port parameter extraction technique for the DGTD method,” IEEE Antennas and Wireless Propagation Letters, vol. 16, pp. 2659–2662, 2017.
G. Chen, L. Zhao, W. Yu, and J. M. Jin, “Discontinuous Galerkin time domain method for devices with lumped elements,” in International Applied Computational Electromagnetics Society (ACES) Symposium, Suzhou, China, pp. 1–2, 2017.
W. Yu, L. Zhao, and G. Chen, “A novel DGTD method and engineering applications,” in International Conference on Electromagnetics in Advanced Applications (ICEAA), Cairns, QLD, Australia, pp. 324–327, 2016.
A. Klöckner, T. Warburton, J. Bridge, and J. S. Hesthaven, “Nodal discontinuous Galerkin methods on graphics processors,” Journal of Computational Physics, vol. 228, pp. 7863–7882, 2009.
S. Dosopoulos, J. D. Gardiner, and J.-F. Lee, “An MPI/GPU parallelization of an interior penalty discontinuous Galerkin time domain method for Maxwell’s equations,” Radio Science, vol. 46, 2011.
L. Zhao, G. Chen, and W. H. Yu, “GPU accelerated discontinuous Galerkin time domain algorithm for electromagnetic problems of electrically large objects,” Progress in Electromagnetics Research B, vol. 67, pp. 137–151, 2016.
J. Chan, Z. Wang, A. Modave, J. F. Remacle, and T. Warburton, “GPU-accelerated discontinuous Galerkin methods on hybrid meshes,” Journal of Computational Physics, vol. 318, pp. 142–168, 2016.
Z. Shen, Z. Li, J. Yu, C. Gu, X. Chen, and L. Zhao, “GPU accelerated DGTD method for analyzing electromagnetic scattering problems,” in International Applied Computational Electromagnetics Society Symposium (ACES-China), Xuzhou, China, pp. 1–3, 2022.
S. Wang, Q. Zhu, Y. Wu, R. Xu, and L. Zhao, “Accelerating DGTD-based field-circuit coupling simulations using CUDA,” in Cross Strait Radio Science and Wireless Technology Conference (CSRSWTC), Macao, China, pp. 1–3, 2024.
H. T. Meng, B. L. Nie, S. Wong, C. Macon, and J. M. Jin, “GPU accelerated finite-element computation for electromagnetic analysis,” IEEE Antennas and Propagation Magazine, vol. 56, no. 2, pp. 39–62, Apr. 2014.
C. Richter, S. Schöps, and M. Clemens, “Multi-GPU acceleration of algebraic multi-grid preconditioners for elliptic field problems,” IEEE Transactions on Magnetics, vol. 51, no. 3, pp. 1–4, Mar. 2015.
A. Dziekonski, P. Sypek, A. Lamecki, and M. Mrozowski, “Communication and load balancing optimization for finite element electromagnetic simulations using multi-GPU workstation,” IEEE Transactions on Microwave Theory and Techniques, vol. 65, no. 8, pp. 2661–2671, Aug. 2017.
D. Herrero-Pérez and H. Martínez-Barberá, “Multi-GPU acceleration for finite element analysis in structural mechanics,” Appl. Sci., vol. 15, no. 8, 2025.
T. Cabel, J. Charles, and S. Lanteri. “Multi-GPU acceleration of a DGTD method for modeling human exposure to electromagnetic waves,” Hal Inria, p. 27, 2011.
B. Cockburn, S. Hou, and C.W. Shu, “The Runge–Kutta local projection discontinuous Galerkin finite element method for conservation laws. IV: The multidimensional case,” Mathematics of Computation, vol. 54, pp. 545–581, 1990.
Ansys-HFSS [Online]. Available: https://www.ansys.com/products/electronics/ansys-hfss.
Altair-Feko [Online]. Available: https://www.altair.com/feko.
CST-Studio-Suite [Online]. Available: https://www.3ds.com/products/simulia/cst-studio-suite.


