Comparison of CTA and Textual Feedback in Usability Testing for Malaysian Users

Publikation: KonferencebidragPaperForskningpeer review

3 Downloads (Pure)

Resumé

Usability moderators found that the concurrent think-aloud (CTA) method has some cultural limitation that impacts usability testing with Malaysian users. This gives rise to proposing a new method called textual feedback. The research question is to determine whether there are any differences in terms of usability defects found by employing the new method. Due to the high power distance, it is hypothesized that the CTA method may not be sufficient and hence a textual feedback method is recommended instead. Hence, the objective of this study is to determine if there are any differences in usability defects from the concurrent think-aloud (CTA) method (Condition 2) and textual feedback method (Condition 1) within the same group of Malaysian users. A pair-wise t-test was used, whereby users were subjected to performing usability task using both methods. Results reveal that we can reject the null hypothesis of "no difference" in feedback and therefore conclude that textual feedback reported significantly more usability defects than CTA, as the difference is positive t(208) = 4.791, p=0.01.
OriginalsprogEngelsk
Publikationsdato2015
Antal sider6
StatusUdgivet - 2015
BegivenhedThe ACM Conference on Human Factors in Computing Systems. CHI 2015 - Seoul, Sydkorea
Varighed: 18 apr. 201523 apr. 2015
Konferencens nummer: 33
http://chi2015.acm.org/

Konference

KonferenceThe ACM Conference on Human Factors in Computing Systems. CHI 2015
Nummer33
LandSydkorea
By Seoul
Periode18/04/201523/04/2015
Internetadresse

Emneord

  • Human-centered computing
  • Human computer interaction (HCI)
  • HCI design and evaluation methods
  • Usability testing

Citer dette

Sivaji, A., Clemmensen, T., & Nielsen, S. F. (2015). Comparison of CTA and Textual Feedback in Usability Testing for Malaysian Users. Afhandling præsenteret på The ACM Conference on Human Factors in Computing Systems. CHI 2015, Seoul, Sydkorea.
Sivaji, Ashok ; Clemmensen, Torkil ; Nielsen, Søren Feodor. / Comparison of CTA and Textual Feedback in Usability Testing for Malaysian Users. Afhandling præsenteret på The ACM Conference on Human Factors in Computing Systems. CHI 2015, Seoul, Sydkorea.6 s.
@conference{1343b48f6f654affb6610e117f92428e,
title = "Comparison of CTA and Textual Feedback in Usability Testing for Malaysian Users",
abstract = "Usability moderators found that the concurrent think-aloud (CTA) method has some cultural limitation that impacts usability testing with Malaysian users. This gives rise to proposing a new method called textual feedback. The research question is to determine whether there are any differences in terms of usability defects found by employing the new method. Due to the high power distance, it is hypothesized that the CTA method may not be sufficient and hence a textual feedback method is recommended instead. Hence, the objective of this study is to determine if there are any differences in usability defects from the concurrent think-aloud (CTA) method (Condition 2) and textual feedback method (Condition 1) within the same group of Malaysian users. A pair-wise t-test was used, whereby users were subjected to performing usability task using both methods. Results reveal that we can reject the null hypothesis of {"}no difference{"} in feedback and therefore conclude that textual feedback reported significantly more usability defects than CTA, as the difference is positive t(208) = 4.791, p=0.01.",
keywords = "Human-centered computing, Human computer interaction (HCI), HCI design and evaluation methods, Usability testing",
author = "Ashok Sivaji and Torkil Clemmensen and Nielsen, {S{\o}ren Feodor}",
year = "2015",
language = "English",
note = "null ; Conference date: 18-04-2015 Through 23-04-2015",
url = "http://chi2015.acm.org/",

}

Sivaji, A, Clemmensen, T & Nielsen, SF 2015, 'Comparison of CTA and Textual Feedback in Usability Testing for Malaysian Users' Paper fremlagt ved The ACM Conference on Human Factors in Computing Systems. CHI 2015, Seoul, Sydkorea, 18/04/2015 - 23/04/2015, .

Comparison of CTA and Textual Feedback in Usability Testing for Malaysian Users. / Sivaji, Ashok; Clemmensen, Torkil; Nielsen, Søren Feodor.

2015. Afhandling præsenteret på The ACM Conference on Human Factors in Computing Systems. CHI 2015, Seoul, Sydkorea.

Publikation: KonferencebidragPaperForskningpeer review

TY - CONF

T1 - Comparison of CTA and Textual Feedback in Usability Testing for Malaysian Users

AU - Sivaji, Ashok

AU - Clemmensen, Torkil

AU - Nielsen, Søren Feodor

PY - 2015

Y1 - 2015

N2 - Usability moderators found that the concurrent think-aloud (CTA) method has some cultural limitation that impacts usability testing with Malaysian users. This gives rise to proposing a new method called textual feedback. The research question is to determine whether there are any differences in terms of usability defects found by employing the new method. Due to the high power distance, it is hypothesized that the CTA method may not be sufficient and hence a textual feedback method is recommended instead. Hence, the objective of this study is to determine if there are any differences in usability defects from the concurrent think-aloud (CTA) method (Condition 2) and textual feedback method (Condition 1) within the same group of Malaysian users. A pair-wise t-test was used, whereby users were subjected to performing usability task using both methods. Results reveal that we can reject the null hypothesis of "no difference" in feedback and therefore conclude that textual feedback reported significantly more usability defects than CTA, as the difference is positive t(208) = 4.791, p=0.01.

AB - Usability moderators found that the concurrent think-aloud (CTA) method has some cultural limitation that impacts usability testing with Malaysian users. This gives rise to proposing a new method called textual feedback. The research question is to determine whether there are any differences in terms of usability defects found by employing the new method. Due to the high power distance, it is hypothesized that the CTA method may not be sufficient and hence a textual feedback method is recommended instead. Hence, the objective of this study is to determine if there are any differences in usability defects from the concurrent think-aloud (CTA) method (Condition 2) and textual feedback method (Condition 1) within the same group of Malaysian users. A pair-wise t-test was used, whereby users were subjected to performing usability task using both methods. Results reveal that we can reject the null hypothesis of "no difference" in feedback and therefore conclude that textual feedback reported significantly more usability defects than CTA, as the difference is positive t(208) = 4.791, p=0.01.

KW - Human-centered computing

KW - Human computer interaction (HCI)

KW - HCI design and evaluation methods

KW - Usability testing

M3 - Paper

ER -

Sivaji A, Clemmensen T, Nielsen SF. Comparison of CTA and Textual Feedback in Usability Testing for Malaysian Users. 2015. Afhandling præsenteret på The ACM Conference on Human Factors in Computing Systems. CHI 2015, Seoul, Sydkorea.