Evaluating the Collaborative Critique Method

Tamara Babaian, Wendy Lucas , Mari-Klara Stein

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Abstract

We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system’s behavior and its impact on the user’s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system’s support for reducing the user’s cognitive and physical effort in the context of the interaction.
We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system’s behavior and its impact on the user’s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system’s support for reducing the user’s cognitive and physical effort in the context of the interaction.
LanguageEnglish
Title of host publicationCHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Editors Joseph A. Konstan , Ed H. Chi , Kristina Höök
Place of PublicationNew York
PublisherAssociation for Computing Machinery
Date2013
Pages2137-2164
ISBN (Print)9781450310154
DOIs
StatePublished - 2013
Externally publishedYes
EventThe ACM Conference on Human Factors in Computing Systems. CHI 2012 - Austin, TX, United States
Duration: 5 May 201210 May 2012
Conference number: 30
http://chi2012.acm.org/

Conference

ConferenceThe ACM Conference on Human Factors in Computing Systems. CHI 2012
Number30
CountryUnited States
CityAustin, TX
Period05/05/201210/05/2012
Internet address

Keywords

    Cite this

    Babaian, T., Lucas , . W., & Stein, M-K. (2013). Evaluating the Collaborative Critique Method. In . J. A. Konstan , E. H. Chi , & K. Höök (Eds.), CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2137-2164). New York: Association for Computing Machinery. DOI: 10.1145/2207676.2208366
    Babaian, Tamara ; Lucas , Wendy ; Stein, Mari-Klara. / Evaluating the Collaborative Critique Method. CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . editor / Joseph A. Konstan ; Ed H. Chi ; Kristina Höök. New York : Association for Computing Machinery, 2013. pp. 2137-2164
    @inproceedings{5e2e0e19fea640199e3450d24fff34a4,
    title = "Evaluating the Collaborative Critique Method",
    abstract = "We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system’s behavior and its impact on the user’s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system’s support for reducing the user’s cognitive and physical effort in the context of the interaction.",
    keywords = "Usability inspection methods, Human-computer collaboration, Complex systems, ERP",
    author = "Tamara Babaian and Wendy Lucas and Mari-Klara Stein",
    year = "2013",
    doi = "10.1145/2207676.2208366",
    language = "English",
    isbn = "9781450310154",
    pages = "2137--2164",
    editor = "{Konstan }, { Joseph A. } and {Chi }, {Ed H. } and Kristina H{\"o}{\"o}k",
    booktitle = "CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems",
    publisher = "Association for Computing Machinery",
    address = "United States",

    }

    Babaian, T, Lucas , W & Stein, M-K 2013, Evaluating the Collaborative Critique Method. in JA Konstan , EH Chi & K Höök (eds), CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . Association for Computing Machinery, New York, pp. 2137-2164, Austin, TX, United States, 05/05/2012. DOI: 10.1145/2207676.2208366

    Evaluating the Collaborative Critique Method. / Babaian, Tamara ; Lucas , Wendy ; Stein, Mari-Klara.

    CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . ed. / Joseph A. Konstan ; Ed H. Chi ; Kristina Höök. New York : Association for Computing Machinery, 2013. p. 2137-2164.

    Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    TY - GEN

    T1 - Evaluating the Collaborative Critique Method

    AU - Babaian,Tamara

    AU - Lucas , Wendy

    AU - Stein,Mari-Klara

    PY - 2013

    Y1 - 2013

    N2 - We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system’s behavior and its impact on the user’s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system’s support for reducing the user’s cognitive and physical effort in the context of the interaction.

    AB - We introduce a new usability walkthrough method called Collaborative Critique (CC), which is inspired by the human-computer collaboration paradigm of system-user interaction. This method applies a “collaboration lens” to assessing the system’s behavior and its impact on the user’s efforts in the context of the task being performed. We present findings from a laboratory evaluation of the CC method with usability practitioners, in which the results of the CC walkthrough were compared to a benchmark set of problems collected via user testing with two experimental Enterprise Resource Planning (ERP) system tasks.The development of this new usability evaluation method was driven by the need for an approach that assesses the adequacy of the system’s support for reducing the user’s cognitive and physical effort in the context of the interaction.

    KW - Usability inspection methods

    KW - Human-computer collaboration

    KW - Complex systems

    KW - ERP

    U2 - 10.1145/2207676.2208366

    DO - 10.1145/2207676.2208366

    M3 - Article in proceedings

    SN - 9781450310154

    SP - 2137

    EP - 2164

    BT - CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

    PB - Association for Computing Machinery

    CY - New York

    ER -

    Babaian T, Lucas W, Stein M-K. Evaluating the Collaborative Critique Method. In Konstan JA, Chi EH, Höök K, editors, CHI '12. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . New York: Association for Computing Machinery. 2013. p. 2137-2164. Available from, DOI: 10.1145/2207676.2208366