On the Selection of the Globally Optimal Prototype Subset for Nearest-Neighbor Classification

Emilio Carrizosa, Belén Martín-Barragán, Frank Plastria, Dolores Romero Morales

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review


The nearest-neighbor classifier has been shown to be a powerful tool for multiclass classification. We explore both theoretical properties and empirical behavior of a variant method, in which the nearest-neighbor rule is applied to a reduced set of prototypes. This set is selected a priori by fixing its cardinality and minimizing the empirical misclassification cost. In this way we alleviate the two serious drawbacks of the nearest-neighbor method: high storage requirements and time-consuming queries. Finding this reduced set is shown to be NP-hard. We provide mixed integer programming (MIP) formulations, which are theoretically compared and solved by a standard MIP solver for small problem instances. We show that the classifiers derived from these formulations are comparable to benchmark procedures. We solve large problem instances by a metaheuristic that yields good classification rules in reasonable time. Additional experiments indicate that prototype-based nearest-neighbor classifiers remain quite stable in the presence of missing values.
TidsskriftI N F O R M S Journal on Computing
Udgave nummer3
Sider (fra-til)470-479
StatusUdgivet - 2007
Udgivet eksterntJa


  • Classification
  • Optimal prototype subset
  • Nearest neighbor
  • Dissimilarities
  • Integer programming
  • Variable neighborhood search
  • Missing values