Evaluating the Collaborative Critique Method

Tamara  Babaian; Wendy  Lucas; Mari-Klara Stein

doi:10.1145/2207676.2208366

Evaluating the Collaborative Critique Method

Tamara Babaian, Wendy Lucas , Mari-Klara Stein

Bentley University

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Abstract

We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system’s behavior and its impact on the user’s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system’s support for reducing the user’s cognitive and physical effort in the context of the interaction.

Original language	English
Title of host publication	CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Editors	Joseph A. Konstan , Ed H. Chi , Kristina Höök
Place of Publication	New York
Publisher	Association for Computing Machinery
Publication date	2013
Pages	2137-2164
ISBN (Print)	9781450310154
DOIs	https://doi.org/10.1145/2207676.2208366
Publication status	Published - 2013
Externally published	Yes
Event	The ACM Conference on Human Factors in Computing Systems. CHI 2012 - Austin, TX, United States Duration: 5 May 2012 → 10 May 2012 Conference number: 30 http://chi2012.acm.org/

Conference

Conference	The ACM Conference on Human Factors in Computing Systems. CHI 2012
Number	30
Country/Territory	United States
City	Austin, TX
Period	05/05/2012 → 10/05/2012
Internet address	http://chi2012.acm.org/

Access to Document

10.1145/2207676.2208366

http://esc-web.lib.cbs.dk/login?url=http://dl.acm.org/citation.cfm?id=2208366

Handle.net

Persistent link

Cite this

@inproceedings{5e2e0e19fea640199e3450d24fff34a4,

title = "Evaluating the Collaborative Critique Method",

abstract = "We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system{\textquoteright}s behavior and its impact on the user{\textquoteright}s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system{\textquoteright}s support for reducing the user{\textquoteright}s cognitive and physical effort in the context of the interaction.",

keywords = "Usability inspection methods, Human-computer collaboration, Complex systems, ERP",

author = "Tamara Babaian and Wendy Lucas and Mari-Klara Stein",

year = "2013",

doi = "10.1145/2207676.2208366",

language = "English",

isbn = "9781450310154",

pages = "2137--2164",

editor = "{Konstan }, { Joseph A. } and {Chi }, {Ed H. } and Kristina H{\"o}{\"o}k",

booktitle = "CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems",

publisher = "Association for Computing Machinery",

address = "United States",

note = "The ACM Conference on Human Factors in Computing Systems. CHI 2012 ; Conference date: 05-05-2012 Through 10-05-2012",

url = "http://chi2012.acm.org/",

}

Babaian, T, Lucas , W & Stein, M-K 2013, Evaluating the Collaborative Critique Method. in JA Konstan , EH Chi & K Höök (eds), CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . Association for Computing Machinery, New York, pp. 2137-2164, The ACM Conference on Human Factors in Computing Systems. CHI 2012, Austin, TX, United States, 05/05/2012. https://doi.org/10.1145/2207676.2208366

Evaluating the Collaborative Critique Method. / Babaian, Tamara ; Lucas , Wendy ; Stein, Mari-Klara.
CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . ed. / Joseph A. Konstan ; Ed H. Chi ; Kristina Höök. New York: Association for Computing Machinery, 2013. p. 2137-2164.

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

TY - GEN

T1 - Evaluating the Collaborative Critique Method

AU - Babaian, Tamara

AU - Lucas , Wendy

AU - Stein, Mari-Klara

N1 - Conference code: 30

PY - 2013

Y1 - 2013

N2 - We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system’s behavior and its impact on the user’s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system’s support for reducing the user’s cognitive and physical effort in the context of the interaction.

AB - We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system’s behavior and its impact on the user’s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system’s support for reducing the user’s cognitive and physical effort in the context of the interaction.

KW - Usability inspection methods

KW - Human-computer collaboration

KW - Complex systems

KW - ERP

U2 - 10.1145/2207676.2208366

DO - 10.1145/2207676.2208366

M3 - Article in proceedings

SN - 9781450310154

SP - 2137

EP - 2164

BT - CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

A2 - Konstan , Joseph A.

A2 - Chi , Ed H.

A2 - Höök, Kristina

PB - Association for Computing Machinery

CY - New York

T2 - The ACM Conference on Human Factors in Computing Systems. CHI 2012

Y2 - 5 May 2012 through 10 May 2012

ER -