Evaluating the Collaborative Critique Method

Tamara Babaian, Wendy Lucas , Mari-Klara Stein

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Abstract

We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system’s behavior and its impact on the user’s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system’s support for reducing the user’s cognitive and physical effort in the context of the interaction.
Original languageEnglish
Title of host publicationCHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Editors Joseph A. Konstan , Ed H. Chi , Kristina Höök
Place of PublicationNew York
PublisherAssociation for Computing Machinery
Publication date2013
Pages2137-2164
ISBN (Print)9781450310154
DOIs
Publication statusPublished - 2013
Externally publishedYes
EventThe ACM Conference on Human Factors in Computing Systems. CHI 2012 - Austin, TX, United States
Duration: 5 May 201210 May 2012
Conference number: 30
http://chi2012.acm.org/

Conference

ConferenceThe ACM Conference on Human Factors in Computing Systems. CHI 2012
Number30
CountryUnited States
CityAustin, TX
Period05/05/201210/05/2012
Internet address

Cite this

Babaian, T., Lucas , W., & Stein, M-K. (2013). Evaluating the Collaborative Critique Method. In J. A. Konstan , E. H. Chi , & K. Höök (Eds.), CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2137-2164). New York: Association for Computing Machinery. https://doi.org/10.1145/2207676.2208366
Babaian, Tamara ; Lucas , Wendy ; Stein, Mari-Klara. / Evaluating the Collaborative Critique Method. CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . editor / Joseph A. Konstan ; Ed H. Chi ; Kristina Höök. New York : Association for Computing Machinery, 2013. pp. 2137-2164
@inproceedings{5e2e0e19fea640199e3450d24fff34a4,
title = "Evaluating the Collaborative Critique Method",
abstract = "We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system’s behavior and its impact on the user’s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system’s support for reducing the user’s cognitive and physical effort in the context of the interaction.",
keywords = "Usability inspection methods, Human-computer collaboration, Complex systems, ERP",
author = "Tamara Babaian and Wendy Lucas and Mari-Klara Stein",
year = "2013",
doi = "10.1145/2207676.2208366",
language = "English",
isbn = "9781450310154",
pages = "2137--2164",
editor = "{Konstan }, { Joseph A. } and {Chi }, {Ed H. } and Kristina H{\"o}{\"o}k",
booktitle = "CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems",
publisher = "Association for Computing Machinery",
address = "United States",

}

Babaian, T, Lucas , W & Stein, M-K 2013, Evaluating the Collaborative Critique Method. in JA Konstan , EH Chi & K Höök (eds), CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . Association for Computing Machinery, New York, pp. 2137-2164, Austin, TX, United States, 05/05/2012. https://doi.org/10.1145/2207676.2208366

Evaluating the Collaborative Critique Method. / Babaian, Tamara ; Lucas , Wendy ; Stein, Mari-Klara.

CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . ed. / Joseph A. Konstan ; Ed H. Chi ; Kristina Höök. New York : Association for Computing Machinery, 2013. p. 2137-2164.

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

TY - GEN

T1 - Evaluating the Collaborative Critique Method

AU - Babaian, Tamara

AU - Lucas , Wendy

AU - Stein, Mari-Klara

PY - 2013

Y1 - 2013

N2 - We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system’s behavior and its impact on the user’s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system’s support for reducing the user’s cognitive and physical effort in the context of the interaction.

AB - We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system’s behavior and its impact on the user’s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system’s support for reducing the user’s cognitive and physical effort in the context of the interaction.

KW - Usability inspection methods

KW - Human-computer collaboration

KW - Complex systems

KW - ERP

U2 - 10.1145/2207676.2208366

DO - 10.1145/2207676.2208366

M3 - Article in proceedings

SN - 9781450310154

SP - 2137

EP - 2164

BT - CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

A2 - Konstan , Joseph A.

A2 - Chi , Ed H.

A2 - Höök, Kristina

PB - Association for Computing Machinery

CY - New York

ER -

Babaian T, Lucas W, Stein M-K. Evaluating the Collaborative Critique Method. In Konstan JA, Chi EH, Höök K, editors, CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . New York: Association for Computing Machinery. 2013. p. 2137-2164 https://doi.org/10.1145/2207676.2208366