Algebraic and Geometric Basis of Principal Components: An Overview
DOI:
https://doi.org/10.13052/jrss0974-8024.1314Keywords:
Algebraic basis, basis of principal components, geometric basis,, principal components, properties of principal componentsAbstract
Principal Component Analysis is considered as a dimension-reduction tool which may be used to reduce a large set of possibly correlated variables to hopefully a smaller set of uncorrelated variables that still accounts for most of the variation of the original large set. To understand the inner constructs of principal components, concepts of algebraic as well as geometric basis of principal components are prerequisites. Hence, in the current study, an attempt has been made to provide a step by step and vivid discussion of the basis of principle components and its various important properties.
Downloads
References
Ahmed, N., Natarajan, T. and Rao, K.R. (1974). Discrete cosine transform, IEEE Transactions on Computers, 23(1), pp. 90–93.
Aitken, A.C. (2016). Determinants and Matrices, Brousson, Read BooksLtd.
Anderson, T.W. (2003). An Introduction to Multivariate Statistical Analysis (3rd
Edition), New Jersey, John Wiley & Sons.
Bertsekas, D.P. (2014). Constrained Optimization and Lagrange Multiplier Methods, New York, Academic Press Inc.
Bunch, J.R. and Nielsen, C.P. (1978). Updating the singular value decomposition, Numerische Mathematik, 31(2), pp. 111–129.
Chatterjee, A. (2000). An introduction to the proper orthogonal decomposition, Current Science, 78(7), pp. 808–817.
Eisenhart, L.P. (2005). Coordinate Geometry, USA, Dover Publications Inc.
Gujarati, D.N., Porter, D.C. and Gunasekar, S. (2011). Basic Econometrics, New York, McGraw-Hill.
Hannachi, A., Jolliffe, I.T. and Stephenson, D.B. (2007). Empirical orthogonal functions and related techniques in atmospheric science: a review, International Journal of Climatology, 27, pp. 1119–1152.
Hardle, W.K. and Simar L. (2014). Applied Multivariate Statistical Analysis (4th Edition), New York, Springer-Verlag New York, Inc.
Harris, R.J. (2001). A Primer of Multivariate Statistics (3rd
Edition). Mahwah, Lawrence Erlbaum Associates, Inc., Publishers.
Hotelling, H. (1933). Analysis of a complex of statistical variables into principal components, Journal of Educational Psychology, 24,pp. 417–441.
Jackson, J.E. (1991). A User’s Guide to Principal Components, New Jersey, John Wiley & Sons, Inc.
Johnson, R.A. and Wichern, D.W. (2007). Applied Multivariate Statistical Analysis. Upper Saddle River, New Jersey, Pearson Education, Inc.
Johnson, R.M. (1963). On a theorem stated by Eckart and Young, Psychometrika, 28(3), pp. 259–263.
Johnstone, I.M. (2001). On the distribution of the largest eigenvalue in principal components analysis, The Annals of Statistics, 29(2),pp. 295–327.
Pearson, K. (1901). On lines and planes of closest fit to systems of points in space, Philosophical Magazines, 2, pp. 559–572.
Rencher, A.C. (2012). Methods of Multivariate Analysis (3rd
Edition), New Jersey, John Wiley & Sons.
Riedel, T. and Sahoo, P.K. (1998). Mean Value Theorems and Functional Equations, Singapore, World Scientific Publishing Co. Pte. Ltd.
Searle, S.R. and Khuri, A.I. (2017). Matrix Algebra Useful for Statistics (2nd
Edition), New Jersey, John Wiley & Sons, Inc.
Stark, H. and Yang, Y. (1998). Vector Space Projections: A Numerical Approach to Signal and Image Processing, Neural Nets, and optics, New York, John Wiley & Sons, Inc.
Timm, N.H. (2002). Applied Multivariate Analysis. New York, Springer-Verlag New York, Inc.
Zhang, F. (2011). Matrix Theory: Basic Results and Techniques (2nd Edition), New York, Springer Science & Business Media.
