Performance of a Massively Parallel Method of Moment Solver and Its Application
Keywords:
Communication avoiding, high performance, LU decomposition, massively parallel, method of momentsAbstract
A massively parallel Method of Moment (MoM) solver able to run on 200,000 CPU cores and solve matrices larger than 1.3 million unknowns is presented. The solver implements a novel LU decomposition algorithm based on the Communication Avoiding LU (CALU) scheme. By using a new pivoting policy, the communication between processes is improved enhancing the parallel speed up of the algorithm. Solver effectiveness and performance are demonstrated comparing the results with two of the most important math libraries used by direct dense solvers: the commercial MKL and the open source ScaLapack. Results show how simulation time is reduced significantly thanks to this novel LU decomposition algorithm making possible the simulation of incredibility electrically large problems using MoM.
Downloads
References
J. M. Jin, The Finite Element Method in Electromagnetics. John Wiley & Sons, Inc., 1993.
A. Taflove, Computational Electrodynamics: The Finite-Difference Time-Domain Method. Artech House, Norwood, Mass, USA, 2000.
R. F. Harrington, Field Computation by Moment Methods in IEEE Series on Electromagnetic Waves. IEEE, New York, NY, USA, 1993.
Y. Zhang and T. K. Sarkar, Parallel Solution of Integral Equation Based EM Problems in the Frequency Domain. Hoboken, NJ: John Wiley, 2009.
J. Chen, M. Zhu, M. Wang, S. Li, and X. Li, “A hybrid MoM-PO method combining ACA technique for electromagnetic scattering from target above a rough surface,” ACES Journal, vol. 29, no. 4, pp. 301-306, 2014.
Y. Kim, H. Kim, K. Bae, J. Park, and N. Myung, “A hybrid UTD-ACGF technique for DOA finding of receiving antenna array on complex environment,” IEEE Trans. Antennas Propag., vol. 63, no. 11, pp. 5045-5055, 2015.
J. M. Song, C. C. Lu, and W. C. Chew, “Multilevel fast multipole algorithm for electromagnetic scattering by large complex object,” IEEE Trans. Antennas Propag., vol. 45, no. 10, pp. 1488-1493, 1997.
H. Fangjing, N. Zaiping, and H. Jun, “An efficient parallel multilevel fast multipole algorithm for large-scale scattering problems,” ACES Journal, vol. 25, no. 4, pp. 381-387, 2010.
Y. Zhang, T. K. Sarkar, M. C. Taylor, and H. Moon, “Solving MoM problems with million level unknowns using a parallel out-of-core solver on a high performance cluster,” in IEEE Antennas and Propagation Soc. Int. Symp., Charleston, SC, USA, pp. 1-4, 2009.
Y. Zhang, R. A. van ce Geijn, M. C. Taylor, and T. K. Sarkar, “Parallel MoM using higher-order basis functions and PLAPACK in-core and out-of-core solvers for challenging EM simulations,” IEEE Trans. Antennas Propag., vol. 51, no. 5, pp. 42-60, 2009.
Y. Zhang, T. K. Sarkar, X. Zhao, D. GarciaDonoro, W. Zhao, M. Salazar, and S. Ting, Higher Order Basis Based Integral Equation Solver (HOBBIES). Hoboken, NJ: John Wiley, 2012.
Intel Copyright (2015) Intel Math Kernel Library for Linux OS User’s Guide, Intel Corporation. available: https://software.intel.com/sites/default/ files/managed/df/1e/mkl_11.3_lnx_userguide.pdf.
W. Gropp, T. Hoefler, and R. Thakur, Using Advanced MPI: Modern Features of the MessagePassing Interface. Cambridge, MA: The MIT Press, 2014.
B. Chapman, G. Jost, R. van der Pas, and D. J. Kuck, (foreword), Using OpenMP: Portable Shared Memory Parallel Programming. The MIT Press, Cambridge, MA, 2007.
L. S. Blackford, J. Choi, A. Cleary, et al., “ScaLAPACK: A portable linear algebra library for distributed memory computers - Design issues and performance,” Proceedings of the 1996 ACM/ IEEE Conference on Supercomputing, IEEE, pp. 1- 20, 1996.
Y. Zhang, Z. Lin, X. Zhao, et al., “Performance of a massively parallel higher-order method of moments code using thousands of CPUs and its applications,” IEEE Trans. Antennas Propag., vol. 62, no. 12, pp. 6317-6324, 2014.
L. Grigori, J. W. Demmel, and H. Xiang, “CALU: A communication optimal LU factorization algorithm,” SIAM Journal on Matrix Analysis and Applications, vol. 32, no. 4, pp. 1317-1350, 2008.
A. Khabou, J. W. Demmel, L. Grigori, and M. Gu, “LU factorization with panel rank revealing pivoting and its communication avoiding version,” eprint arXiv:1208.2451, 2012.
