Cross cultural usability testing: The relationship between evaluator and test user

Torkil Clemmensen, Shivam Goyal

    Publikation: Working paperForskning

    Resumé

    In this paper, we present the results of a pilot study in Denmark of cross cultural effects on Think Aloud usability testing. We provide an overview of previous research on cross cultural usability evaluation with a special focus on the relationship between the evaluator and the test user. This relation was studied in an experiment with usability testing of a localized clipart application in which eight participants from Denmark and India formed pairs of evaluator-test user. The test users were asked to think aloud and the evaluators' role were to facilitate the test users thinking aloud and hereby identify usability problems with the clipart application. Data on the evaluators' and test users' behaviour were recorded and analyzed by coding and summarizing statistics on these behavioural events. The results show that Think Aloud Usability Test of a localized application is most effectively performed, in terms of number of think aloud events and number of usability problems found, when both the evaluators and the test users are local. These results are however limited to the Danish context and need to be investigated in other cultural settings.
    In this paper, we present the results of a pilot study in Denmark of cross cultural effects on Think Aloud usability testing. We provide an overview of previous research on cross cultural usability evaluation with a special focus on the relationship between the evaluator and the test user. This relation was studied in an experiment with usability testing of a localized clipart application in which eight participants from Denmark and India formed pairs of evaluator-test user. The test users were asked to think aloud and the evaluators' role were to facilitate the test users thinking aloud and hereby identify usability problems with the clipart application. Data on the evaluators' and test users' behaviour were recorded and analyzed by coding and summarizing statistics on these behavioural events. The results show that Think Aloud Usability Test of a localized application is most effectively performed, in terms of number of think aloud events and number of usability problems found, when both the evaluators and the test users are local. These results are however limited to the Danish context and need to be investigated in other cultural settings.
    SprogEngelsk
    Udgivelses stedKøbenhavn
    Antal sider20
    StatusUdgivet - 2005

    Emneord

    • Usability
    • Brugervenlighed-edb
    • Testning
    • Interkulturel kompetence
    • cross Cultural usability testing
    • international usability testing

    Citer dette

    @techreport{5b988410c02011db9769000ea68e967b,
    title = "Cross cultural usability testing: The relationship between evaluator and test user",
    abstract = "In this paper, we present the results of a pilot study in Denmark of cross cultural effects on Think Aloud usability testing. We provide an overview of previous research on cross cultural usability evaluation with a special focus on the relationship between the evaluator and the test user. This relation was studied in an experiment with usability testing of a localized clipart application in which eight participants from Denmark and India formed pairs of evaluator-test user. The test users were asked to think aloud and the evaluators' role were to facilitate the test users thinking aloud and hereby identify usability problems with the clipart application. Data on the evaluators' and test users' behaviour were recorded and analyzed by coding and summarizing statistics on these behavioural events. The results show that Think Aloud Usability Test of a localized application is most effectively performed, in terms of number of think aloud events and number of usability problems found, when both the evaluators and the test users are local. These results are however limited to the Danish context and need to be investigated in other cultural settings.",
    keywords = "Usability, Brugervenlighed-edb, Testning, Interkulturel kompetence, cross Cultural usability testing, international usability testing",
    author = "Torkil Clemmensen and Shivam Goyal",
    year = "2005",
    language = "English",
    type = "WorkingPaper",

    }

    Cross cultural usability testing : The relationship between evaluator and test user. / Clemmensen, Torkil; Goyal, Shivam.

    København, 2005.

    Publikation: Working paperForskning

    TY - UNPB

    T1 - Cross cultural usability testing

    T2 - The relationship between evaluator and test user

    AU - Clemmensen,Torkil

    AU - Goyal,Shivam

    PY - 2005

    Y1 - 2005

    N2 - In this paper, we present the results of a pilot study in Denmark of cross cultural effects on Think Aloud usability testing. We provide an overview of previous research on cross cultural usability evaluation with a special focus on the relationship between the evaluator and the test user. This relation was studied in an experiment with usability testing of a localized clipart application in which eight participants from Denmark and India formed pairs of evaluator-test user. The test users were asked to think aloud and the evaluators' role were to facilitate the test users thinking aloud and hereby identify usability problems with the clipart application. Data on the evaluators' and test users' behaviour were recorded and analyzed by coding and summarizing statistics on these behavioural events. The results show that Think Aloud Usability Test of a localized application is most effectively performed, in terms of number of think aloud events and number of usability problems found, when both the evaluators and the test users are local. These results are however limited to the Danish context and need to be investigated in other cultural settings.

    AB - In this paper, we present the results of a pilot study in Denmark of cross cultural effects on Think Aloud usability testing. We provide an overview of previous research on cross cultural usability evaluation with a special focus on the relationship between the evaluator and the test user. This relation was studied in an experiment with usability testing of a localized clipart application in which eight participants from Denmark and India formed pairs of evaluator-test user. The test users were asked to think aloud and the evaluators' role were to facilitate the test users thinking aloud and hereby identify usability problems with the clipart application. Data on the evaluators' and test users' behaviour were recorded and analyzed by coding and summarizing statistics on these behavioural events. The results show that Think Aloud Usability Test of a localized application is most effectively performed, in terms of number of think aloud events and number of usability problems found, when both the evaluators and the test users are local. These results are however limited to the Danish context and need to be investigated in other cultural settings.

    KW - Usability

    KW - Brugervenlighed-edb

    KW - Testning

    KW - Interkulturel kompetence

    KW - cross Cultural usability testing

    KW - international usability testing

    M3 - Working paper

    BT - Cross cultural usability testing

    CY - København

    ER -