Enhancing Interpretability in Factor Analysis by Means of Mathematical Optimization

Emilio Carrizosa, Vanesa Guerrero, Dolores Romero Morales, Albert Satorra

Research output: Contribution to journalJournal articleResearchpeer-review

Abstract

Exploratory Factor Analysis (EFA) is a widely used statistical technique to discover the structure of latent unobserved variables, called factors, from a set of observed variables. EFA exploits the property of rotation invariance of the factor model to enhance factors’ interpretability by building a sparse loading matrix. In this paper, we propose an optimization-based procedure to give meaning to the factors arising in EFA by means of an additional set of variables, called explanatory variables, which may include in particular the set of observed variables. A goodness-of-fit criterion is introduced which quantifies the quality of the interpretation given this way. Our methodology also exploits the rotational invariance of EFA to obtain the best orthogonal rotation of the factors, in terms of the goodness-of-fit, but making them match to some of the explanatory variables, thus going beyond traditional rotation methods. Therefore, our approach allows the analyst to interpret the factors not only in terms of the observed variables, but in terms of a broader set of variables. Our experimental results demonstrate how our approach enhances interpretability in EFA, first in an empirical dataset, concerning volumes of reservoirs in California, and second in a synthetic data example.
Original languageEnglish
JournalMultivariate Behavioral Research
Number of pages15
ISSN0027-3171
DOIs
Publication statusPublished - 30 Oct 2019

Bibliographical note

Epub ahead of print. Published online: 30. October 2019

The research presented in the contribution was funded by the H2020 Marie Skłodowska-Curie Actions grant ‘Research and Innovation Staff Exchange Network of European Data Scientists' (#822214 – NeEDS).

Keywords

  • Exploratory factor analysis
  • Interpretability
  • Factor rotation
  • Explanatory variables
  • Mathematical optimization

Cite this

@article{6ea49f696b85415aa5ea52f3fc49ed63,
title = "Enhancing Interpretability in Factor Analysis by Means of Mathematical Optimization",
abstract = "Exploratory Factor Analysis (EFA) is a widely used statistical technique to discover the structure of latent unobserved variables, called factors, from a set of observed variables. EFA exploits the property of rotation invariance of the factor model to enhance factors’ interpretability by building a sparse loading matrix. In this paper, we propose an optimization-based procedure to give meaning to the factors arising in EFA by means of an additional set of variables, called explanatory variables, which may include in particular the set of observed variables. A goodness-of-fit criterion is introduced which quantifies the quality of the interpretation given this way. Our methodology also exploits the rotational invariance of EFA to obtain the best orthogonal rotation of the factors, in terms of the goodness-of-fit, but making them match to some of the explanatory variables, thus going beyond traditional rotation methods. Therefore, our approach allows the analyst to interpret the factors not only in terms of the observed variables, but in terms of a broader set of variables. Our experimental results demonstrate how our approach enhances interpretability in EFA, first in an empirical dataset, concerning volumes of reservoirs in California, and second in a synthetic data example.",
keywords = "Exploratory factor analysis, Interpretability, Factor rotation, Explanatory variables, Mathematical optimization, Exploratory factor analysis, Interpretability, Factor rotation, Explanatory variables, Mathematical optimization",
author = "Emilio Carrizosa and Vanesa Guerrero and {Romero Morales}, Dolores and Albert Satorra",
note = "Epub ahead of print. Published online: 30. October 2019 The research presented in the contribution was funded by the H2020 Marie Skłodowska-Curie Actions grant ‘Research and Innovation Staff Exchange Network of European Data Scientists' (#822214 – NeEDS).",
year = "2019",
month = "10",
day = "30",
doi = "10.1080/00273171.2019.1677208",
language = "English",
journal = "Multivariate Behavioral Research",
issn = "0027-3171",
publisher = "Psychology Press",

}

Enhancing Interpretability in Factor Analysis by Means of Mathematical Optimization. / Carrizosa, Emilio ; Guerrero, Vanesa; Romero Morales, Dolores ; Satorra, Albert.

In: Multivariate Behavioral Research, 30.10.2019.

Research output: Contribution to journalJournal articleResearchpeer-review

TY - JOUR

T1 - Enhancing Interpretability in Factor Analysis by Means of Mathematical Optimization

AU - Carrizosa, Emilio

AU - Guerrero, Vanesa

AU - Romero Morales, Dolores

AU - Satorra, Albert

N1 - Epub ahead of print. Published online: 30. October 2019 The research presented in the contribution was funded by the H2020 Marie Skłodowska-Curie Actions grant ‘Research and Innovation Staff Exchange Network of European Data Scientists' (#822214 – NeEDS).

PY - 2019/10/30

Y1 - 2019/10/30

N2 - Exploratory Factor Analysis (EFA) is a widely used statistical technique to discover the structure of latent unobserved variables, called factors, from a set of observed variables. EFA exploits the property of rotation invariance of the factor model to enhance factors’ interpretability by building a sparse loading matrix. In this paper, we propose an optimization-based procedure to give meaning to the factors arising in EFA by means of an additional set of variables, called explanatory variables, which may include in particular the set of observed variables. A goodness-of-fit criterion is introduced which quantifies the quality of the interpretation given this way. Our methodology also exploits the rotational invariance of EFA to obtain the best orthogonal rotation of the factors, in terms of the goodness-of-fit, but making them match to some of the explanatory variables, thus going beyond traditional rotation methods. Therefore, our approach allows the analyst to interpret the factors not only in terms of the observed variables, but in terms of a broader set of variables. Our experimental results demonstrate how our approach enhances interpretability in EFA, first in an empirical dataset, concerning volumes of reservoirs in California, and second in a synthetic data example.

AB - Exploratory Factor Analysis (EFA) is a widely used statistical technique to discover the structure of latent unobserved variables, called factors, from a set of observed variables. EFA exploits the property of rotation invariance of the factor model to enhance factors’ interpretability by building a sparse loading matrix. In this paper, we propose an optimization-based procedure to give meaning to the factors arising in EFA by means of an additional set of variables, called explanatory variables, which may include in particular the set of observed variables. A goodness-of-fit criterion is introduced which quantifies the quality of the interpretation given this way. Our methodology also exploits the rotational invariance of EFA to obtain the best orthogonal rotation of the factors, in terms of the goodness-of-fit, but making them match to some of the explanatory variables, thus going beyond traditional rotation methods. Therefore, our approach allows the analyst to interpret the factors not only in terms of the observed variables, but in terms of a broader set of variables. Our experimental results demonstrate how our approach enhances interpretability in EFA, first in an empirical dataset, concerning volumes of reservoirs in California, and second in a synthetic data example.

KW - Exploratory factor analysis

KW - Interpretability

KW - Factor rotation

KW - Explanatory variables

KW - Mathematical optimization

KW - Exploratory factor analysis

KW - Interpretability

KW - Factor rotation

KW - Explanatory variables

KW - Mathematical optimization

UR - https://sfx-45cbs.hosted.exlibrisgroup.com/45cbs?url_ver=Z39.88-2004&url_ctx_fmt=info:ofi/fmt:kev:mtx:ctx&ctx_enc=info:ofi/enc:UTF-8&ctx_ver=Z39.88-2004&rfr_id=info:sid/sfxit.com:azlist&sfx.ignore_date_threshold=1&rft.object_id=954925426216&rft.object_portfolio_id=&svc.holdings=yes&svc.fulltext=yes

U2 - 10.1080/00273171.2019.1677208

DO - 10.1080/00273171.2019.1677208

M3 - Journal article

JO - Multivariate Behavioral Research

JF - Multivariate Behavioral Research

SN - 0027-3171

ER -