Authentic And Concurrent Evaluation-refining: An Evaluation Approach In Design Science Research

Carina Ihlström Eriksson, Maria Åkesson, Karlheinz Kautz

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review


This paper addresses the need for more detailed accounts for evaluation in design science research literature. By revisiting a design project regarding the future e-newspaper we give detailed descriptions of its authentic and concurrent evaluation approach by illustrating the what, why and how of all evaluation activities throughout the whole project. The project produced seven different
design artifacts that were evaluated. The utility and theoretical outcomes of the evaluation activities clearly influenced design decisions regarding newspaper design, user value and business model design as well as decisions on strategic levels. We emphasize a holistic and concurrent approach to evaluation compared to the general design science research thinking and argue that reflecting on how
to seek authenticity is important. By authenticity we refer to the notion of how closely an evaluation captures the context and actual use of an artifact. With the holistic approach we encourage evaluation to be inclusive of different aspects and relationships between stakeholder groups in the evaluation activities. Further we think that concurrency is not narrowed to evaluation but also
regards theorizing. While it makes sense for planning to distinguish between phases and stages of evaluation and theorizing, in practice they are intrinsically interlinked and concurrent.
Original languageEnglish
Title of host publicationPACIS 2011 Proceedings
EditorsPeter B. Seddon, Shirley Gregor
Number of pages13
Place of PublicationAtlanta, GA
PublisherAssociation for Information Systems. AIS Electronic Library (AISeL)
Publication date2011
ChapterPaper 82
ISBN (Electronic)9781846356441
Publication statusPublished - 2011
EventThe 15th Pacific Asia Conference on Information Systems. PACIS 2011 - Brisbane, Australia
Duration: 7 Jul 201111 Jul 2011
Conference number: 15


ConferenceThe 15th Pacific Asia Conference on Information Systems. PACIS 2011
OtherQuality Research in Pacific Asia
Internet address

Cite this