Evaluating Treatment Effects Using Data Envelopment Analysis on Matched Samples: An Analysis of Electronic Information Sharing and Firm Performance

Peter Bogetoft, Lene Kromann

Research output: Contribution to journalJournal articleResearchpeer-review

Abstract

An intuitively obvious approach to evaluating the effects of a new business model is to compare the performance of firms using the business model (the treatment group) with the performance of a simi- lar group of firms that do not use the business model (the control group). Data Envelopment Analysis (DEA) can be a powerful tool in such comparisons because it allows us to estimate changes in average performance as well as in frontier performance. In this paper, we suggest using matching together with DEA as a way to ensure sub-sample homogeneity. The advantages of using a matched sample compared to a random sample of non-treated firms to remove sample size bias is documented using a simulation study. A real-world application is also provided. In the application, we study how information sharing has impacted the performance of Danish manufacturing firms. We match firms that use electronic informa- tion sharing to their “twin”firms that do not on the basis of firm characteristics. Before matching, there is a considerable difference in performance between the two groups. However, after matching, we can conclude that approximately 50% of the difference is the result of selection bias.
An intuitively obvious approach to evaluating the effects of a new business model is to compare the performance of firms using the business model (the treatment group) with the performance of a simi- lar group of firms that do not use the business model (the control group). Data Envelopment Analysis (DEA) can be a powerful tool in such comparisons because it allows us to estimate changes in average performance as well as in frontier performance. In this paper, we suggest using matching together with DEA as a way to ensure sub-sample homogeneity. The advantages of using a matched sample compared to a random sample of non-treated firms to remove sample size bias is documented using a simulation study. A real-world application is also provided. In the application, we study how information sharing has impacted the performance of Danish manufacturing firms. We match firms that use electronic informa- tion sharing to their “twin”firms that do not on the basis of firm characteristics. Before matching, there is a considerable difference in performance between the two groups. However, after matching, we can conclude that approximately 50% of the difference is the result of selection bias.
LanguageEnglish
JournalEuropean Journal of Operational Research
Volume270
Issue number1
Pages302-313
Number of pages12
ISSN0377-2217
DOIs
StatePublished - Oct 2018

Bibliographical note

Published online: 14. March 2018

Keywords

  • Data envelopment analysis
  • Bias
  • Matching
  • Propensity score

Cite this

@article{d53fdb0741a542d28022bdd5d4d96b6f,
title = "Evaluating Treatment Effects Using Data Envelopment Analysis on Matched Samples: An Analysis of Electronic Information Sharing and Firm Performance",
abstract = "An intuitively obvious approach to evaluating the effects of a new business model is to compare the performance of firms using the business model (the treatment group) with the performance of a simi- lar group of firms that do not use the business model (the control group). Data Envelopment Analysis (DEA) can be a powerful tool in such comparisons because it allows us to estimate changes in average performance as well as in frontier performance. In this paper, we suggest using matching together with DEA as a way to ensure sub-sample homogeneity. The advantages of using a matched sample compared to a random sample of non-treated firms to remove sample size bias is documented using a simulation study. A real-world application is also provided. In the application, we study how information sharing has impacted the performance of Danish manufacturing firms. We match firms that use electronic informa- tion sharing to their “twin”firms that do not on the basis of firm characteristics. Before matching, there is a considerable difference in performance between the two groups. However, after matching, we can conclude that approximately 50{\%} of the difference is the result of selection bias.",
keywords = "Data envelopment analysis, Bias, Matching, Propensity score, Data envelopment analysis, Bias, Matching, Propensity score",
author = "Peter Bogetoft and Lene Kromann",
note = "Published online: 14. March 2018",
year = "2018",
month = "10",
doi = "10.1016/j.ejor.2018.03.013",
language = "English",
volume = "270",
pages = "302--313",
journal = "European Journal of Operational Research",
issn = "0377-2217",
publisher = "Elsevier",
number = "1",

}

Evaluating Treatment Effects Using Data Envelopment Analysis on Matched Samples : An Analysis of Electronic Information Sharing and Firm Performance. / Bogetoft, Peter; Kromann, Lene.

In: European Journal of Operational Research, Vol. 270, No. 1, 10.2018, p. 302-313.

Research output: Contribution to journalJournal articleResearchpeer-review

TY - JOUR

T1 - Evaluating Treatment Effects Using Data Envelopment Analysis on Matched Samples

T2 - European Journal of Operational Research

AU - Bogetoft,Peter

AU - Kromann,Lene

N1 - Published online: 14. March 2018

PY - 2018/10

Y1 - 2018/10

N2 - An intuitively obvious approach to evaluating the effects of a new business model is to compare the performance of firms using the business model (the treatment group) with the performance of a simi- lar group of firms that do not use the business model (the control group). Data Envelopment Analysis (DEA) can be a powerful tool in such comparisons because it allows us to estimate changes in average performance as well as in frontier performance. In this paper, we suggest using matching together with DEA as a way to ensure sub-sample homogeneity. The advantages of using a matched sample compared to a random sample of non-treated firms to remove sample size bias is documented using a simulation study. A real-world application is also provided. In the application, we study how information sharing has impacted the performance of Danish manufacturing firms. We match firms that use electronic informa- tion sharing to their “twin”firms that do not on the basis of firm characteristics. Before matching, there is a considerable difference in performance between the two groups. However, after matching, we can conclude that approximately 50% of the difference is the result of selection bias.

AB - An intuitively obvious approach to evaluating the effects of a new business model is to compare the performance of firms using the business model (the treatment group) with the performance of a simi- lar group of firms that do not use the business model (the control group). Data Envelopment Analysis (DEA) can be a powerful tool in such comparisons because it allows us to estimate changes in average performance as well as in frontier performance. In this paper, we suggest using matching together with DEA as a way to ensure sub-sample homogeneity. The advantages of using a matched sample compared to a random sample of non-treated firms to remove sample size bias is documented using a simulation study. A real-world application is also provided. In the application, we study how information sharing has impacted the performance of Danish manufacturing firms. We match firms that use electronic informa- tion sharing to their “twin”firms that do not on the basis of firm characteristics. Before matching, there is a considerable difference in performance between the two groups. However, after matching, we can conclude that approximately 50% of the difference is the result of selection bias.

KW - Data envelopment analysis

KW - Bias

KW - Matching

KW - Propensity score

KW - Data envelopment analysis

KW - Bias

KW - Matching

KW - Propensity score

UR - https://sfx-45cbs.hosted.exlibrisgroup.com/45cbs?url_ver=Z39.88-2004&url_ctx_fmt=info:ofi/fmt:kev:mtx:ctx&ctx_enc=info:ofi/enc:UTF-8&ctx_ver=Z39.88-2004&rfr_id=info:sid/sfxit.com:azlist&sfx.ignore_date_threshold=1&rft.object_id=954921393016

U2 - 10.1016/j.ejor.2018.03.013

DO - 10.1016/j.ejor.2018.03.013

M3 - Journal article

VL - 270

SP - 302

EP - 313

JO - European Journal of Operational Research

JF - European Journal of Operational Research

SN - 0377-2217

IS - 1

ER -