Mathematical Optimization in Classification and Regression Trees

Emilio Carrizosa, Cristina Molero del Rio, Dolores Romero Morales*

*Corresponding author af dette arbejde

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

33 Downloads (Pure)

Abstrakt

Classification and regression trees, as well as their variants, are off-the-shelf methods in Machine Learning. In this paper, we review recent contributions within the Continuous Optimization and the Mixed-Integer Linear Optimization paradigms to develop novel formulations in this research area. We compare those in terms of the nature of the decision variables and the constraints required, as well as the optimization algorithms proposed. We illustrate how these powerful formulations enhance the flexibility of tree models, being better suited to incorporate desirable properties such as cost-sensitivity, explainability, and fairness, and to deal with complex data, such as functional data.
OriginalsprogEngelsk
TidsskriftTOP
Vol/bind29
Udgave nummer1
Sider (fra-til)5-33
Antal sider29
ISSN1134-5764
DOI
StatusUdgivet - apr. 2021

Bibliografisk note

Published online: 17. Marts 2021

Emneord

  • Classification and Regression Trees
  • Tree ensembles
  • Mixed-integer linear optimization
  • Continuous nonlinear optimization
  • Sparsity
  • Explainability

Citationsformater