Evaluating Treatment Effects Using Data Envelopment Analysis on Matched Samples: An Analysis of Electronic Information Sharing and Firm Performance

Peter Bogetoft, Lene Kromann

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

Resumé

An intuitively obvious approach to evaluating the effects of a new business model is to compare the performance of firms using the business model (the treatment group) with the performance of a simi- lar group of firms that do not use the business model (the control group). Data Envelopment Analysis (DEA) can be a powerful tool in such comparisons because it allows us to estimate changes in average performance as well as in frontier performance. In this paper, we suggest using matching together with DEA as a way to ensure sub-sample homogeneity. The advantages of using a matched sample compared to a random sample of non-treated firms to remove sample size bias is documented using a simulation study. A real-world application is also provided. In the application, we study how information sharing has impacted the performance of Danish manufacturing firms. We match firms that use electronic informa- tion sharing to their “twin”firms that do not on the basis of firm characteristics. Before matching, there is a considerable difference in performance between the two groups. However, after matching, we can conclude that approximately 50% of the difference is the result of selection bias.
An intuitively obvious approach to evaluating the effects of a new business model is to compare the performance of firms using the business model (the treatment group) with the performance of a simi- lar group of firms that do not use the business model (the control group). Data Envelopment Analysis (DEA) can be a powerful tool in such comparisons because it allows us to estimate changes in average performance as well as in frontier performance. In this paper, we suggest using matching together with DEA as a way to ensure sub-sample homogeneity. The advantages of using a matched sample compared to a random sample of non-treated firms to remove sample size bias is documented using a simulation study. A real-world application is also provided. In the application, we study how information sharing has impacted the performance of Danish manufacturing firms. We match firms that use electronic informa- tion sharing to their “twin”firms that do not on the basis of firm characteristics. Before matching, there is a considerable difference in performance between the two groups. However, after matching, we can conclude that approximately 50% of the difference is the result of selection bias.
SprogEngelsk
TidsskriftEuropean Journal of Operational Research
Vol/bind270
Udgave nummer1
Sider302-313
Antal sider12
ISSN0377-2217
DOI
StatusUdgivet - okt. 2018

Bibliografisk note

Published online: 14. March 2018

Emneord

  • Data envelopment analysis
  • Bias
  • Matching
  • Propensity score

Citer dette

@article{d53fdb0741a542d28022bdd5d4d96b6f,
title = "Evaluating Treatment Effects Using Data Envelopment Analysis on Matched Samples: An Analysis of Electronic Information Sharing and Firm Performance",
abstract = "An intuitively obvious approach to evaluating the effects of a new business model is to compare the performance of firms using the business model (the treatment group) with the performance of a simi- lar group of firms that do not use the business model (the control group). Data Envelopment Analysis (DEA) can be a powerful tool in such comparisons because it allows us to estimate changes in average performance as well as in frontier performance. In this paper, we suggest using matching together with DEA as a way to ensure sub-sample homogeneity. The advantages of using a matched sample compared to a random sample of non-treated firms to remove sample size bias is documented using a simulation study. A real-world application is also provided. In the application, we study how information sharing has impacted the performance of Danish manufacturing firms. We match firms that use electronic informa- tion sharing to their “twin”firms that do not on the basis of firm characteristics. Before matching, there is a considerable difference in performance between the two groups. However, after matching, we can conclude that approximately 50{\%} of the difference is the result of selection bias.",
keywords = "Data envelopment analysis, Bias, Matching, Propensity score, Data envelopment analysis, Bias, Matching, Propensity score",
author = "Peter Bogetoft and Lene Kromann",
note = "Published online: 14. March 2018",
year = "2018",
month = "10",
doi = "10.1016/j.ejor.2018.03.013",
language = "English",
volume = "270",
pages = "302--313",
journal = "European Journal of Operational Research",
issn = "0377-2217",
publisher = "Elsevier",
number = "1",

}

Evaluating Treatment Effects Using Data Envelopment Analysis on Matched Samples : An Analysis of Electronic Information Sharing and Firm Performance. / Bogetoft, Peter; Kromann, Lene.

I: European Journal of Operational Research, Bind 270, Nr. 1, 10.2018, s. 302-313.

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

TY - JOUR

T1 - Evaluating Treatment Effects Using Data Envelopment Analysis on Matched Samples

T2 - European Journal of Operational Research

AU - Bogetoft,Peter

AU - Kromann,Lene

N1 - Published online: 14. March 2018

PY - 2018/10

Y1 - 2018/10

N2 - An intuitively obvious approach to evaluating the effects of a new business model is to compare the performance of firms using the business model (the treatment group) with the performance of a simi- lar group of firms that do not use the business model (the control group). Data Envelopment Analysis (DEA) can be a powerful tool in such comparisons because it allows us to estimate changes in average performance as well as in frontier performance. In this paper, we suggest using matching together with DEA as a way to ensure sub-sample homogeneity. The advantages of using a matched sample compared to a random sample of non-treated firms to remove sample size bias is documented using a simulation study. A real-world application is also provided. In the application, we study how information sharing has impacted the performance of Danish manufacturing firms. We match firms that use electronic informa- tion sharing to their “twin”firms that do not on the basis of firm characteristics. Before matching, there is a considerable difference in performance between the two groups. However, after matching, we can conclude that approximately 50% of the difference is the result of selection bias.

AB - An intuitively obvious approach to evaluating the effects of a new business model is to compare the performance of firms using the business model (the treatment group) with the performance of a simi- lar group of firms that do not use the business model (the control group). Data Envelopment Analysis (DEA) can be a powerful tool in such comparisons because it allows us to estimate changes in average performance as well as in frontier performance. In this paper, we suggest using matching together with DEA as a way to ensure sub-sample homogeneity. The advantages of using a matched sample compared to a random sample of non-treated firms to remove sample size bias is documented using a simulation study. A real-world application is also provided. In the application, we study how information sharing has impacted the performance of Danish manufacturing firms. We match firms that use electronic informa- tion sharing to their “twin”firms that do not on the basis of firm characteristics. Before matching, there is a considerable difference in performance between the two groups. However, after matching, we can conclude that approximately 50% of the difference is the result of selection bias.

KW - Data envelopment analysis

KW - Bias

KW - Matching

KW - Propensity score

KW - Data envelopment analysis

KW - Bias

KW - Matching

KW - Propensity score

UR - https://sfx-45cbs.hosted.exlibrisgroup.com/45cbs?url_ver=Z39.88-2004&url_ctx_fmt=info:ofi/fmt:kev:mtx:ctx&ctx_enc=info:ofi/enc:UTF-8&ctx_ver=Z39.88-2004&rfr_id=info:sid/sfxit.com:azlist&sfx.ignore_date_threshold=1&rft.object_id=954921393016

U2 - 10.1016/j.ejor.2018.03.013

DO - 10.1016/j.ejor.2018.03.013

M3 - Journal article

VL - 270

SP - 302

EP - 313

JO - European Journal of Operational Research

JF - European Journal of Operational Research

SN - 0377-2217

IS - 1

ER -