Measuring Potential Sub-unit Efficiency to Counter the Aggregation Bias in Benchmarking

Heinz Ahn, Peter Bogetoft, Ana Lopes

Research output: Contribution to journalJournal articleResearchpeer-review

Abstract

The paper deals with benchmarking cases where highly aggregated decision making units are in the data set. It is shown that these units—consisting of sub-units which are not further known by the evaluator—are likely to receive an unjustifiable harsh evaluation, here referred to as aggregation bias. To counter this bias, we present an approach which allows to calculate the potential sub-unit efficiency of a decision making unit by taking into account the possible impact of its sub-units’ aggregation without having disaggregated sub-unit data. Based on data envelopment analysis, the approach is operationalized in several ways. Finally, we apply our method to the benchmarking model actually used by the Brazilian Electricity Regulator to measure the cost efficiency of the Brazilian distribution system operators. For this case, our results reveal that the potential effect of the aggregation bias on the operators’ efficiency scores is enormous.
The paper deals with benchmarking cases where highly aggregated decision making units are in the data set. It is shown that these units—consisting of sub-units which are not further known by the evaluator—are likely to receive an unjustifiable harsh evaluation, here referred to as aggregation bias. To counter this bias, we present an approach which allows to calculate the potential sub-unit efficiency of a decision making unit by taking into account the possible impact of its sub-units’ aggregation without having disaggregated sub-unit data. Based on data envelopment analysis, the approach is operationalized in several ways. Finally, we apply our method to the benchmarking model actually used by the Brazilian Electricity Regulator to measure the cost efficiency of the Brazilian distribution system operators. For this case, our results reveal that the potential effect of the aggregation bias on the operators’ efficiency scores is enormous.
LanguageEnglish
JournalJournal of Business Economics
Volume89
Issue number1
Pages53-77
Number of pages25
ISSN0044-2372
DOIs
StatePublished - Feb 2019

Bibliographical note

Published online: 20. March 2018

Keywords

  • Benchmarking
  • Data Envelopment Analysis
  • DEA
  • Aggregation Bias
  • Potential Sub-Unit Efficiency
  • Regulation

Cite this

@article{f6a0b3973c2d4dff96afb8a1511fe25e,
title = "Measuring Potential Sub-unit Efficiency to Counter the Aggregation Bias in Benchmarking",
abstract = "The paper deals with benchmarking cases where highly aggregated decision making units are in the data set. It is shown that these units—consisting of sub-units which are not further known by the evaluator—are likely to receive an unjustifiable harsh evaluation, here referred to as aggregation bias. To counter this bias, we present an approach which allows to calculate the potential sub-unit efficiency of a decision making unit by taking into account the possible impact of its sub-units’ aggregation without having disaggregated sub-unit data. Based on data envelopment analysis, the approach is operationalized in several ways. Finally, we apply our method to the benchmarking model actually used by the Brazilian Electricity Regulator to measure the cost efficiency of the Brazilian distribution system operators. For this case, our results reveal that the potential effect of the aggregation bias on the operators’ efficiency scores is enormous.",
keywords = "Benchmarking, Data Envelopment Analysis, DEA, Aggregation Bias, Potential Sub-Unit Efficiency, Regulation, Benchmarking, Data Envelopment Analysis, DEA, Aggregation Bias, Potential Sub-Unit Efficiency, Regulation",
author = "Heinz Ahn and Peter Bogetoft and Ana Lopes",
note = "Published online: 20. March 2018",
year = "2019",
month = "2",
doi = "10.1007/s11573-018-0901-0",
language = "English",
volume = "89",
pages = "53--77",
journal = "Journal of Business Economics",
issn = "0044-2372",
publisher = "Springer",
number = "1",

}

Measuring Potential Sub-unit Efficiency to Counter the Aggregation Bias in Benchmarking. / Ahn, Heinz; Bogetoft, Peter; Lopes, Ana.

In: Journal of Business Economics, Vol. 89, No. 1, 02.2019, p. 53-77.

Research output: Contribution to journalJournal articleResearchpeer-review

TY - JOUR

T1 - Measuring Potential Sub-unit Efficiency to Counter the Aggregation Bias in Benchmarking

AU - Ahn,Heinz

AU - Bogetoft,Peter

AU - Lopes,Ana

N1 - Published online: 20. March 2018

PY - 2019/2

Y1 - 2019/2

N2 - The paper deals with benchmarking cases where highly aggregated decision making units are in the data set. It is shown that these units—consisting of sub-units which are not further known by the evaluator—are likely to receive an unjustifiable harsh evaluation, here referred to as aggregation bias. To counter this bias, we present an approach which allows to calculate the potential sub-unit efficiency of a decision making unit by taking into account the possible impact of its sub-units’ aggregation without having disaggregated sub-unit data. Based on data envelopment analysis, the approach is operationalized in several ways. Finally, we apply our method to the benchmarking model actually used by the Brazilian Electricity Regulator to measure the cost efficiency of the Brazilian distribution system operators. For this case, our results reveal that the potential effect of the aggregation bias on the operators’ efficiency scores is enormous.

AB - The paper deals with benchmarking cases where highly aggregated decision making units are in the data set. It is shown that these units—consisting of sub-units which are not further known by the evaluator—are likely to receive an unjustifiable harsh evaluation, here referred to as aggregation bias. To counter this bias, we present an approach which allows to calculate the potential sub-unit efficiency of a decision making unit by taking into account the possible impact of its sub-units’ aggregation without having disaggregated sub-unit data. Based on data envelopment analysis, the approach is operationalized in several ways. Finally, we apply our method to the benchmarking model actually used by the Brazilian Electricity Regulator to measure the cost efficiency of the Brazilian distribution system operators. For this case, our results reveal that the potential effect of the aggregation bias on the operators’ efficiency scores is enormous.

KW - Benchmarking

KW - Data Envelopment Analysis

KW - DEA

KW - Aggregation Bias

KW - Potential Sub-Unit Efficiency

KW - Regulation

KW - Benchmarking

KW - Data Envelopment Analysis

KW - DEA

KW - Aggregation Bias

KW - Potential Sub-Unit Efficiency

KW - Regulation

UR - https://sfx-45cbs.hosted.exlibrisgroup.com/45cbs?url_ver=Z39.88-2004&url_ctx_fmt=info:ofi/fmt:kev:mtx:ctx&ctx_enc=info:ofi/enc:UTF-8&ctx_ver=Z39.88-2004&rfr_id=info:sid/sfxit.com:azlist&sfx.ignore_date_threshold=1&rft.object_id=110978976477973

U2 - 10.1007/s11573-018-0901-0

DO - 10.1007/s11573-018-0901-0

M3 - Journal article

VL - 89

SP - 53

EP - 77

JO - Journal of Business Economics

T2 - Journal of Business Economics

JF - Journal of Business Economics

SN - 0044-2372

IS - 1

ER -