Robust Multivariate Methods: The Projection Pursuit Approach

  • Peter Filzmoser
  • Sven Serneels
  • Christophe Croux
  • Pierre J. Van Espen
Conference paper
Part of the Studies in Classification, Data Analysis, and Knowledge Organization book series (STUDIES CLASS)


Projection pursuit was originally introduced to identify structures in multivariate data clouds (Huber, 1985). The idea of projecting data to a low-dimensional subspace can also be applied to multivariate statistical methods. The robustness of the methods can be achieved by applying robust estimators to the lower-dimensional space. Robust estimation in high dimensions can thus be avoided which usually results in a faster computation. Moreover, flat data sets where the number of variables is much higher than the number of observations can be easier analyzed in a robust way.

We will focus on the projection pursuit approach for robust continuum regression (Serneels et al., 2005). A new algorithm is introduced and compared with the reference algorithm as well as with classical continuum regression.


Partial Little Square Canonical Correlation Analysis Principal Component Regression Projection Direction Robust Estimator 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. BRANCO, J.A., CROUX, C., FILZMOSER, P., and OLIVEIRA, M.R. (2005): Robust Canonical Correlations: A Comparative Study. Computational Statistics, 2. To appear.Google Scholar
  2. CROUX, C. and HAESBROECK, G. (2000): Principal Component Analysis based on Robust Estimators of the Covariance or Correlation Matrix: Influence Functions and Efficiencies. Biometrika, 87, 603–618.CrossRefMathSciNetGoogle Scholar
  3. CROUX, C. and RUIZ-GAZEN, A. (2005): High Breakdown Estimators for Principal Components: The Projection-pursuit Approach Revisited. Journal of Multivariate Analysis. To appear.Google Scholar
  4. DE JONG, S. (1993): SIMPLS: An Alternative Approach to Partial Least Squares Regression. Chemometrics and Intelligent Laboratory Systems, 18, 251–263.Google Scholar
  5. FEARN, T. (1983): A Misuse of Ridge Regression in the Calibration of a Near Infrared Reflectance Instrument. Applied Statistics, 32, 73–79.Google Scholar
  6. FRIEDMAN, J.H., and TUKEY, J.W. (1974): A Projection Pursuit Algorithm for Exploratory Data Analysis. IEEE Transactions on Computers, 9, 881–890.Google Scholar
  7. HAMPEL, F.R., RONCHETTI, E.M., ROUSSEEUW, P.J. and STAHEL, W. (1986): Robust Statistics. The Approach Based on Influence Functions. John Wiley & Sons, New York.Google Scholar
  8. HÖSSJER, O. and CROUX, C. (1995): Generalizing Univariate Signed Rank Statistics for Testing and Estimating a Multivariate Location Parameter. Nonparametric Statistics, 4, 293–308.MathSciNetGoogle Scholar
  9. HUBER, P.J. (1981): Robust Statistics. John Wiley & Sons, New York.Google Scholar
  10. HUBER, P.J. (1985): Projection Pursuit. The Annals of Statistics, 13, 435–525.zbMATHMathSciNetGoogle Scholar
  11. LI, G., and CHEN, Z. (1985): Projection-Pursuit Approach to Robust Dispersion Matrices and Principal Components: Primary Theory and Monte Carlo. Journal of the American Statistical Association, 80,391, 759–766.Google Scholar
  12. MARONNA, R.A. and YOHAI, V.J. (1998): Robust Estimation of Multivariate Location and Scatter. In: S. Kotz, C. Read and D. Banks (Eds.): Encyclopedia of Statistical Sciences. John Wiley & Sons, New York, 589–596.Google Scholar
  13. PISON, G., ROUSSEEUW, P.J., FILZMOSER, P., and CROUX, C. (2003): Robust Factor Analysis. Journal of Multivariate Analysis, 84, 145–172.CrossRefMathSciNetGoogle Scholar
  14. SERNEELS, S., FILZMOSER, P., CROUX, C. and VAN ESPEN, P.J. (2005): Robust Continuum Regression. Chemometrics and Intelligent Laboratory Systems, 76, 197–204.CrossRefGoogle Scholar
  15. STONE, M. and BROOKS, R.J. (1990): Continuum Regression: Cross-validated Sequentially Constructed Prediction Embracing Ordinary Least Squares, Partial Least Squares and Principal Components Regression. Journal of the Royal Statistical Society B, 52, 237–269.MathSciNetGoogle Scholar

Copyright information

© Springer Berlin · Heidelberg 2006

Authors and Affiliations

  • Peter Filzmoser
    • 1
  • Sven Serneels
    • 2
  • Christophe Croux
    • 3
  • Pierre J. Van Espen
    • 2
  1. 1.Department of Statistics and Probability TheoryVienna University of TechnologyViennaAustria
  2. 2.Department of ChemistryUniversity of AntwerpAntwerpBelgium
  3. 3.Department of Applied EconomicsK.U. LeuvenLeuvenBelgium

Personalised recommendations