Evaluation Use in Evaluation Systems: The Case of the European Commission

Steven Højlund

    Publikation: Bog/antologi/afhandling/rapportPh.d.-afhandling

    5 Downloads (Pure)

    Resumé

    What effect do evaluation systems have on the use of evaluation? This is the research question guiding this PhD thesis. By answering this research question as well as three sub-questions, the thesis addresses three important gaps in the evaluation literature: the first gap is that evaluation theory does a poor job explaining non-use and justificatory uses of evaluation. The second gap is that evaluation theory does not account for the systemic context of evaluation in its more general explanations of evaluation use. Finally, the literature does not account empirically for the micro-level of evaluation use in evaluation systems. The thesis draws inspiration from organisational theory and in particular organisational institutionalism. Organisational institutionalism explains organisational action and change to be driven by legitimacy-seeking organisational behaviour. Organisations seek to legitimise themselves in order to survive in their environment. This theory is applied to the concept ‘evaluation system’. Hence, the assumption underlying this thesis is that organisations within an evaluation system are using evaluations to appear accountable rather than improve policies. The thesis investigates the European Union’s evaluation system with a particular focus on the European Commission. This is done in four articles. The first article is a theoretical article introducing organisational institutionalism to the evaluation literature in order to explain non-use and justificatory uses of evaluations. The second article is a historical analysis of the development of the European Commissions evaluation practices. The third article is a case-based analysis of evaluation use in the European Commission. The fourth article is also an empirical article on policy learning from evaluations in three different Directorate-Generals in the European Commission. The methodology used in the empirical articles is qualitative content analysis and the data were more than a hundred Commission documents and 58 interviews with Commission staff.
    OriginalsprogEngelsk
    Udgivelses stedFrederiksberg
    ForlagCopenhagen Business School [Phd]
    Antal sider241
    ISBN (Trykt)9788793155909
    ISBN (Elektronisk)9788793155916
    StatusUdgivet - 2015
    NavnPhD series
    Nummer04.2015
    ISSN0906-6934

    Citer dette

    Højlund, S. (2015). Evaluation Use in Evaluation Systems: The Case of the European Commission. Frederiksberg: Copenhagen Business School [Phd]. PhD series, Nr. 04.2015
    Højlund, Steven. / Evaluation Use in Evaluation Systems : The Case of the European Commission. Frederiksberg : Copenhagen Business School [Phd], 2015. 241 s. (PhD series; Nr. 04.2015).
    @phdthesis{728e2f47bd14461eb41f49acb53b7227,
    title = "Evaluation Use in Evaluation Systems: The Case of the European Commission",
    abstract = "What effect do evaluation systems have on the use of evaluation? This is the research question guiding this PhD thesis. By answering this research question as well as three sub-questions, the thesis addresses three important gaps in the evaluation literature: the first gap is that evaluation theory does a poor job explaining non-use and justificatory uses of evaluation. The second gap is that evaluation theory does not account for the systemic context of evaluation in its more general explanations of evaluation use. Finally, the literature does not account empirically for the micro-level of evaluation use in evaluation systems. The thesis draws inspiration from organisational theory and in particular organisational institutionalism. Organisational institutionalism explains organisational action and change to be driven by legitimacy-seeking organisational behaviour. Organisations seek to legitimise themselves in order to survive in their environment. This theory is applied to the concept ‘evaluation system’. Hence, the assumption underlying this thesis is that organisations within an evaluation system are using evaluations to appear accountable rather than improve policies. The thesis investigates the European Union’s evaluation system with a particular focus on the European Commission. This is done in four articles. The first article is a theoretical article introducing organisational institutionalism to the evaluation literature in order to explain non-use and justificatory uses of evaluations. The second article is a historical analysis of the development of the European Commissions evaluation practices. The third article is a case-based analysis of evaluation use in the European Commission. The fourth article is also an empirical article on policy learning from evaluations in three different Directorate-Generals in the European Commission. The methodology used in the empirical articles is qualitative content analysis and the data were more than a hundred Commission documents and 58 interviews with Commission staff.",
    author = "Steven H{\o}jlund",
    year = "2015",
    language = "English",
    isbn = "9788793155909",
    series = "PhD series",
    number = "04.2015",
    publisher = "Copenhagen Business School [Phd]",
    address = "Denmark",

    }

    Højlund, S 2015, Evaluation Use in Evaluation Systems: The Case of the European Commission. PhD series, nr. 04.2015, Copenhagen Business School [Phd], Frederiksberg.

    Evaluation Use in Evaluation Systems : The Case of the European Commission. / Højlund, Steven.

    Frederiksberg : Copenhagen Business School [Phd], 2015. 241 s. (PhD series; Nr. 04.2015).

    Publikation: Bog/antologi/afhandling/rapportPh.d.-afhandling

    TY - BOOK

    T1 - Evaluation Use in Evaluation Systems

    T2 - The Case of the European Commission

    AU - Højlund, Steven

    PY - 2015

    Y1 - 2015

    N2 - What effect do evaluation systems have on the use of evaluation? This is the research question guiding this PhD thesis. By answering this research question as well as three sub-questions, the thesis addresses three important gaps in the evaluation literature: the first gap is that evaluation theory does a poor job explaining non-use and justificatory uses of evaluation. The second gap is that evaluation theory does not account for the systemic context of evaluation in its more general explanations of evaluation use. Finally, the literature does not account empirically for the micro-level of evaluation use in evaluation systems. The thesis draws inspiration from organisational theory and in particular organisational institutionalism. Organisational institutionalism explains organisational action and change to be driven by legitimacy-seeking organisational behaviour. Organisations seek to legitimise themselves in order to survive in their environment. This theory is applied to the concept ‘evaluation system’. Hence, the assumption underlying this thesis is that organisations within an evaluation system are using evaluations to appear accountable rather than improve policies. The thesis investigates the European Union’s evaluation system with a particular focus on the European Commission. This is done in four articles. The first article is a theoretical article introducing organisational institutionalism to the evaluation literature in order to explain non-use and justificatory uses of evaluations. The second article is a historical analysis of the development of the European Commissions evaluation practices. The third article is a case-based analysis of evaluation use in the European Commission. The fourth article is also an empirical article on policy learning from evaluations in three different Directorate-Generals in the European Commission. The methodology used in the empirical articles is qualitative content analysis and the data were more than a hundred Commission documents and 58 interviews with Commission staff.

    AB - What effect do evaluation systems have on the use of evaluation? This is the research question guiding this PhD thesis. By answering this research question as well as three sub-questions, the thesis addresses three important gaps in the evaluation literature: the first gap is that evaluation theory does a poor job explaining non-use and justificatory uses of evaluation. The second gap is that evaluation theory does not account for the systemic context of evaluation in its more general explanations of evaluation use. Finally, the literature does not account empirically for the micro-level of evaluation use in evaluation systems. The thesis draws inspiration from organisational theory and in particular organisational institutionalism. Organisational institutionalism explains organisational action and change to be driven by legitimacy-seeking organisational behaviour. Organisations seek to legitimise themselves in order to survive in their environment. This theory is applied to the concept ‘evaluation system’. Hence, the assumption underlying this thesis is that organisations within an evaluation system are using evaluations to appear accountable rather than improve policies. The thesis investigates the European Union’s evaluation system with a particular focus on the European Commission. This is done in four articles. The first article is a theoretical article introducing organisational institutionalism to the evaluation literature in order to explain non-use and justificatory uses of evaluations. The second article is a historical analysis of the development of the European Commissions evaluation practices. The third article is a case-based analysis of evaluation use in the European Commission. The fourth article is also an empirical article on policy learning from evaluations in three different Directorate-Generals in the European Commission. The methodology used in the empirical articles is qualitative content analysis and the data were more than a hundred Commission documents and 58 interviews with Commission staff.

    UR - http://libsearch.cbs.dk/primo_library/libweb/action/dlDisplay.do?docId=CB6BAEE52B9AC21ACFB628157E167D28&vid=CBS&afterPDS=true

    M3 - Ph.D. thesis

    SN - 9788793155909

    T3 - PhD series

    BT - Evaluation Use in Evaluation Systems

    PB - Copenhagen Business School [Phd]

    CY - Frederiksberg

    ER -

    Højlund S. Evaluation Use in Evaluation Systems: The Case of the European Commission. Frederiksberg: Copenhagen Business School [Phd], 2015. 241 s. (PhD series; Nr. 04.2015).