Evaluation Use in Evaluation Systems

The Case of the European Commission

Steven Højlund

    Research output: Book/ReportPh.D. thesisResearch

    5 Downloads (Pure)

    Abstract

    What effect do evaluation systems have on the use of evaluation? This is the research question guiding this PhD thesis. By answering this research question as well as three sub-questions, the thesis addresses three important gaps in the evaluation literature: the first gap is that evaluation theory does a poor job explaining non-use and justificatory uses of evaluation. The second gap is that evaluation theory does not account for the systemic context of evaluation in its more general explanations of evaluation use. Finally, the literature does not account empirically for the micro-level of evaluation use in evaluation systems. The thesis draws inspiration from organisational theory and in particular organisational institutionalism. Organisational institutionalism explains organisational action and change to be driven by legitimacy-seeking organisational behaviour. Organisations seek to legitimise themselves in order to survive in their environment. This theory is applied to the concept ‘evaluation system’. Hence, the assumption underlying this thesis is that organisations within an evaluation system are using evaluations to appear accountable rather than improve policies. The thesis investigates the European Union’s evaluation system with a particular focus on the European Commission. This is done in four articles. The first article is a theoretical article introducing organisational institutionalism to the evaluation literature in order to explain non-use and justificatory uses of evaluations. The second article is a historical analysis of the development of the European Commissions evaluation practices. The third article is a case-based analysis of evaluation use in the European Commission. The fourth article is also an empirical article on policy learning from evaluations in three different Directorate-Generals in the European Commission. The methodology used in the empirical articles is qualitative content analysis and the data were more than a hundred Commission documents and 58 interviews with Commission staff.
    Original languageEnglish
    Place of PublicationFrederiksberg
    PublisherCopenhagen Business School [Phd]
    Number of pages241
    ISBN (Print)9788793155909
    ISBN (Electronic)9788793155916
    Publication statusPublished - 2015
    SeriesPhD series
    Number04.2015
    ISSN0906-6934

    Cite this

    Højlund, S. (2015). Evaluation Use in Evaluation Systems: The Case of the European Commission. Frederiksberg: Copenhagen Business School [Phd]. PhD series, No. 04.2015
    Højlund, Steven. / Evaluation Use in Evaluation Systems : The Case of the European Commission. Frederiksberg : Copenhagen Business School [Phd], 2015. 241 p. (PhD series; No. 04.2015).
    @phdthesis{728e2f47bd14461eb41f49acb53b7227,
    title = "Evaluation Use in Evaluation Systems: The Case of the European Commission",
    abstract = "What effect do evaluation systems have on the use of evaluation? This is the research question guiding this PhD thesis. By answering this research question as well as three sub-questions, the thesis addresses three important gaps in the evaluation literature: the first gap is that evaluation theory does a poor job explaining non-use and justificatory uses of evaluation. The second gap is that evaluation theory does not account for the systemic context of evaluation in its more general explanations of evaluation use. Finally, the literature does not account empirically for the micro-level of evaluation use in evaluation systems. The thesis draws inspiration from organisational theory and in particular organisational institutionalism. Organisational institutionalism explains organisational action and change to be driven by legitimacy-seeking organisational behaviour. Organisations seek to legitimise themselves in order to survive in their environment. This theory is applied to the concept ‘evaluation system’. Hence, the assumption underlying this thesis is that organisations within an evaluation system are using evaluations to appear accountable rather than improve policies. The thesis investigates the European Union’s evaluation system with a particular focus on the European Commission. This is done in four articles. The first article is a theoretical article introducing organisational institutionalism to the evaluation literature in order to explain non-use and justificatory uses of evaluations. The second article is a historical analysis of the development of the European Commissions evaluation practices. The third article is a case-based analysis of evaluation use in the European Commission. The fourth article is also an empirical article on policy learning from evaluations in three different Directorate-Generals in the European Commission. The methodology used in the empirical articles is qualitative content analysis and the data were more than a hundred Commission documents and 58 interviews with Commission staff.",
    author = "Steven H{\o}jlund",
    year = "2015",
    language = "English",
    isbn = "9788793155909",
    publisher = "Copenhagen Business School [Phd]",
    address = "Denmark",

    }

    Højlund, S 2015, Evaluation Use in Evaluation Systems: The Case of the European Commission. PhD series, no. 04.2015, Copenhagen Business School [Phd], Frederiksberg.

    Evaluation Use in Evaluation Systems : The Case of the European Commission. / Højlund, Steven.

    Frederiksberg : Copenhagen Business School [Phd], 2015. 241 p. (PhD series; No. 04.2015).

    Research output: Book/ReportPh.D. thesisResearch

    TY - BOOK

    T1 - Evaluation Use in Evaluation Systems

    T2 - The Case of the European Commission

    AU - Højlund, Steven

    PY - 2015

    Y1 - 2015

    N2 - What effect do evaluation systems have on the use of evaluation? This is the research question guiding this PhD thesis. By answering this research question as well as three sub-questions, the thesis addresses three important gaps in the evaluation literature: the first gap is that evaluation theory does a poor job explaining non-use and justificatory uses of evaluation. The second gap is that evaluation theory does not account for the systemic context of evaluation in its more general explanations of evaluation use. Finally, the literature does not account empirically for the micro-level of evaluation use in evaluation systems. The thesis draws inspiration from organisational theory and in particular organisational institutionalism. Organisational institutionalism explains organisational action and change to be driven by legitimacy-seeking organisational behaviour. Organisations seek to legitimise themselves in order to survive in their environment. This theory is applied to the concept ‘evaluation system’. Hence, the assumption underlying this thesis is that organisations within an evaluation system are using evaluations to appear accountable rather than improve policies. The thesis investigates the European Union’s evaluation system with a particular focus on the European Commission. This is done in four articles. The first article is a theoretical article introducing organisational institutionalism to the evaluation literature in order to explain non-use and justificatory uses of evaluations. The second article is a historical analysis of the development of the European Commissions evaluation practices. The third article is a case-based analysis of evaluation use in the European Commission. The fourth article is also an empirical article on policy learning from evaluations in three different Directorate-Generals in the European Commission. The methodology used in the empirical articles is qualitative content analysis and the data were more than a hundred Commission documents and 58 interviews with Commission staff.

    AB - What effect do evaluation systems have on the use of evaluation? This is the research question guiding this PhD thesis. By answering this research question as well as three sub-questions, the thesis addresses three important gaps in the evaluation literature: the first gap is that evaluation theory does a poor job explaining non-use and justificatory uses of evaluation. The second gap is that evaluation theory does not account for the systemic context of evaluation in its more general explanations of evaluation use. Finally, the literature does not account empirically for the micro-level of evaluation use in evaluation systems. The thesis draws inspiration from organisational theory and in particular organisational institutionalism. Organisational institutionalism explains organisational action and change to be driven by legitimacy-seeking organisational behaviour. Organisations seek to legitimise themselves in order to survive in their environment. This theory is applied to the concept ‘evaluation system’. Hence, the assumption underlying this thesis is that organisations within an evaluation system are using evaluations to appear accountable rather than improve policies. The thesis investigates the European Union’s evaluation system with a particular focus on the European Commission. This is done in four articles. The first article is a theoretical article introducing organisational institutionalism to the evaluation literature in order to explain non-use and justificatory uses of evaluations. The second article is a historical analysis of the development of the European Commissions evaluation practices. The third article is a case-based analysis of evaluation use in the European Commission. The fourth article is also an empirical article on policy learning from evaluations in three different Directorate-Generals in the European Commission. The methodology used in the empirical articles is qualitative content analysis and the data were more than a hundred Commission documents and 58 interviews with Commission staff.

    UR - http://libsearch.cbs.dk/primo_library/libweb/action/dlDisplay.do?docId=CB6BAEE52B9AC21ACFB628157E167D28&vid=CBS&afterPDS=true

    M3 - Ph.D. thesis

    SN - 9788793155909

    BT - Evaluation Use in Evaluation Systems

    PB - Copenhagen Business School [Phd]

    CY - Frederiksberg

    ER -

    Højlund S. Evaluation Use in Evaluation Systems: The Case of the European Commission. Frederiksberg: Copenhagen Business School [Phd], 2015. 241 p. (PhD series; No. 04.2015).