Principal Component Analysis: Group-7, Section-B

Download as pptx, pdf, or txt
Download as pptx, pdf, or txt
You are on page 1of 6

+

Principal Component Analysis


Group-7, Section-B
+
Introduction
Statistical procedure that uses orthogonal transformation to
convert a set of observations of possibly correlated variables
into a set of values of linearly uncorrelated variables called
principal components
No. of principal components is less than or equal to the no. of
original variables
+
Illustration

+
Steps for PCA
Covariance
Matrix
Variance between i
th
and
j
th
element of dataset
Eigen Value
Decomposition
Vector of M eigen values
MXM matrix of eigen vectors
Selection of
main
componenents
Select variables
that contribute most
to eigen vector
+
PCA vs Factor Analysis
PCA is data clustering technique where the new variables are
all orthogonal
In Factor Analysis, one predicts underlying factors which can
be estimated from observed data
When to use PCA?
When there is sufficient correlation among the original variables to
warrant component representation
KMO measure > 0.5
Bartletts Sphericity test to check whether data is dependent /
independent
+
Limitations of PCA
Directions with largest variance are assumed to be of most
interest
Only orthogonal transformations of original variables is
considered
Based only on mean and covariance matrix of the data
Excludes some distributions which are not characterized by this
Only applicable when variables are correlated
Not Scale Invariant

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy