Authentic And Concurrent Evaluation-refining: An Evaluation Approach In Design Science Research

Carina Ihlström Eriksson, Maria Åkesson, Karlheinz Kautz

Publikation: Bidrag til bog/antologi/rapportKonferencebidrag i proceedingsForskningpeer review


This paper addresses the need for more detailed accounts for evaluation in design science research literature. By revisiting a design project regarding the future e-newspaper we give detailed descriptions of its authentic and concurrent evaluation approach by illustrating the what, why and how of all evaluation activities throughout the whole project. The project produced seven different
design artifacts that were evaluated. The utility and theoretical outcomes of the evaluation activities clearly influenced design decisions regarding newspaper design, user value and business model design as well as decisions on strategic levels. We emphasize a holistic and concurrent approach to evaluation compared to the general design science research thinking and argue that reflecting on how
to seek authenticity is important. By authenticity we refer to the notion of how closely an evaluation captures the context and actual use of an artifact. With the holistic approach we encourage evaluation to be inclusive of different aspects and relationships between stakeholder groups in the evaluation activities. Further we think that concurrency is not narrowed to evaluation but also
regards theorizing. While it makes sense for planning to distinguish between phases and stages of evaluation and theorizing, in practice they are intrinsically interlinked and concurrent.
TitelPACIS 2011 Proceedings
RedaktørerPeter B. Seddon, Shirley Gregor
Antal sider13
UdgivelsesstedAtlanta, GA
ForlagAssociation for Information Systems. AIS Electronic Library (AISeL)
KapitelPaper 82
ISBN (Elektronisk)9781846356441
StatusUdgivet - 2011
BegivenhedThe 15th Pacific Asia Conference on Information Systems. PACIS 2011 - Brisbane, Australien
Varighed: 7 jul. 201111 jul. 2011
Konferencens nummer: 15


KonferenceThe 15th Pacific Asia Conference on Information Systems. PACIS 2011
AndetQuality Research in Pacific Asia


  • Evaluation
  • Authentic
  • Concurrent
  • Design Science