Scalable GPU-Parallelized FDTD Method for Analysis of Large-Scale Electromagnetic Dosimetry Problems
Keywords:
Exposure assessment, GPU acceleration, parallel FDTD method, scalability, specific absorption rateAbstract
A massively parallel finite-difference timedomain (FDTD) method using a GPU cluster of TSUBAME system has been developed for numerical exposure of a human body to electromagnetic fields. We have also developed and implemented a novel approach for tracing total energy absorbed into a human body in our parallel FDTD code. Our developed FDTD code has shown a strong scalability using 216 nodes and 648 GPUs in total with a high capability to calculate over ten billion cells per second. Whole-body specific absorption rate (SAR) at 200 MHz, as well as its distribution, of a human body with a 0.5 mm resolution with 40000 time steps was found in less than approximately three hours, showing the availability of the method for large-scale EM dosimetry problems.
Downloads
References
D. M. Sullivan, D. T. Borup, and O. P. Gandhi, “Use of the finite-difference time-domain method in calculating EM absorption in human tissues,” IEEE Trans. Biomedical Engineering, vol. BME34, no. 2, pp. 148-157, Feb. 1987.
K. S. Yee, “Numerical solution of initial boundary value problems involving Maxwell’s equations in isotropic media,” IEEE Trans. Antennas Propag., vol. 14, no. 4, pp. 302-307, 1966.
K. S. Kunz and R.J. Luebbers, The Finite Difference Time Domain Method for Electromagnetics, CRC Press, May 3, 1993.
P. J. Dimbylow, “FDTD calculations of the wholebody averaged SAR in an anatomically realistic voxel model of the human body from 1 MHz to 1 GHz,” Phys. Med. Biol., vol. 42, pp. 479-490, 1997.
T. Nagaoka, S. Watanabe, K. Sakurai, E. Kunieda, S. Watanabe, M. Taki, and Y. Yamanaka, “Development of realistic high-resolution wholebody voxel models of Japanese adult and females of average height and weight, and application of models to radio-frequency electromagnetic field dosimetry,” Phys. Med. Biol., vol. 49, pp. 1-15, 2004.
T. Nagaoka, E. Kunieda, and S. Watanabe, “Proportion corrected scaled voxel models for Japanese children and their application to the numerical dosimetry of specific absorption rate for frequencies from 30 MHz to 3 GHz,” Phys. Med. Biol., vol. 53, pp. 6695-6711, 2008.
A. Christ, W. Kainz, E. G. Hahn, K. Honegger, M. Zefferer, E. Neufeld, W. Rascher, R. Janka, W. Bautz, J. Chen, B. Kiefer, P. Schmitt, H.-P. Hollenbach, J. Shen, M. Oberle, D. Szczerba, A. Kam, J. W. Guag, and N. Kuster, “The virtual family – development of surface-based anatomical models of two adults and two children for dosimetric simulations,” Phys. Med. Biol., vol. 55, pp. N23-N38, 2010.
I. Laakso, H. Matsumoto, A. Hirata, Y. Terao, R. Hanajima, and Y. Ugawa, “Multi-scale simulations predict responses to non-invasive nerve root stimulation,” J. Neural Eng., vol. 11, pp. 1-9, 2014.
T. Nagaoka and S. Watanabe, “Accelerating threedimensional FDTD calculations on GPU clusters for electromagnetic field simulation,” in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC’12), pp. 5691-5694, 2012.
K. H. Kim and Q. H. Park, “Overlapping computation and communication of three-dimensional FDTD on a GPU cluster,” Computer Physics Communications, vol. 183, pp. 2364-2369, 2012.
L. Xu, Y. Xu, R. Jiang, and D. Zhang, “Implementation and optimization of threedimensional UPML-FDTD algorithm on GPU cluster,” Computer Engineering & Science, vol. 35, p. 160, 2013.
NVIDIA, NVIDIA CUDA programming guide version 4.0, NVIDIA Corporation, 2011.
TOP500 supercomputer, http://www.top500.org
C. Gabriel, “Compilation of the dielectric properties of body tissues at RF and microwave frequencies,” Brooks AFB, San Antonio, TX, Brooks Air Force Tech. Rep., AL/OE-TR-1996-0037, 1996.
