A Textual Feedback Tool for Empowering Participants in Usability and UX Evaluations

Research output: Contribution to journalJournal articleResearchpeer-review

Abstract

The usability movement has historically always sought to empower end-users of computers, so that they understand what is happening and can control the outcome. In this paper, we develop and evaluate a ‘Textual feedback’ tool for usability and UX evaluation that can be used to empower well-educated, but low-status, users in UX evaluations in countries and contexts with high power distances. The proposed tool contributes to the HCI community’s pool of localized UX evaluation tools. We evaluate the tool with 40 users from two socio-economic groups in real-life UX usability evaluations setting in Malaysia. The results indicate that the Textual Feedback tool may help participants to give their thoughts in UX evaluation in high power distance contexts. In particular, the Textual Feedback tool helps high status females and low status males express more UX problems than they can do with traditional CTA alone. We found that classic concurrent think aloud UX evaluation works fine in high power contexts, but only with the addition of Textual feedback to mitigate the effects of socio-economic status in certain user groups. We suggest that future research on UX evaluation look more into how to empower certain user groups, such as low status female users, in UX evaluations done in high power distance contexts.
The usability movement has historically always sought to empower end-users of computers, so that they understand what is happening and can control the outcome. In this paper, we develop and evaluate a ‘Textual feedback’ tool for usability and UX evaluation that can be used to empower well-educated, but low-status, users in UX evaluations in countries and contexts with high power distances. The proposed tool contributes to the HCI community’s pool of localized UX evaluation tools. We evaluate the tool with 40 users from two socio-economic groups in real-life UX usability evaluations setting in Malaysia. The results indicate that the Textual Feedback tool may help participants to give their thoughts in UX evaluation in high power distance contexts. In particular, the Textual Feedback tool helps high status females and low status males express more UX problems than they can do with traditional CTA alone. We found that classic concurrent think aloud UX evaluation works fine in high power contexts, but only with the addition of Textual feedback to mitigate the effects of socio-economic status in certain user groups. We suggest that future research on UX evaluation look more into how to empower certain user groups, such as low status female users, in UX evaluations done in high power distance contexts.
LanguageEnglish
JournalInternational Journal of Human-Computer Interaction
Volume33
Issue number5
Pages357-370
Number of pages20
ISSN1044-7318
DOIs
StatePublished - 2017

Keywords

  • Empirical studies of user behaviour
  • Global and cultural considerations
  • Human-computer interaction in organizations and society
  • Human-computer interaction theory
  • Evaluation/methodology
  • User interface management systems (uims)

Cite this

@article{5feeb5bf754f4c66b5d13f2a5955d5ff,
title = "A Textual Feedback Tool for Empowering Participants in Usability and UX Evaluations",
abstract = "The usability movement has historically always sought to empower end-users of computers, so that they understand what is happening and can control the outcome. In this paper, we develop and evaluate a ‘Textual feedback’ tool for usability and UX evaluation that can be used to empower well-educated, but low-status, users in UX evaluations in countries and contexts with high power distances. The proposed tool contributes to the HCI community’s pool of localized UX evaluation tools. We evaluate the tool with 40 users from two socio-economic groups in real-life UX usability evaluations setting in Malaysia. The results indicate that the Textual Feedback tool may help participants to give their thoughts in UX evaluation in high power distance contexts. In particular, the Textual Feedback tool helps high status females and low status males express more UX problems than they can do with traditional CTA alone. We found that classic concurrent think aloud UX evaluation works fine in high power contexts, but only with the addition of Textual feedback to mitigate the effects of socio-economic status in certain user groups. We suggest that future research on UX evaluation look more into how to empower certain user groups, such as low status female users, in UX evaluations done in high power distance contexts.",
keywords = "Empirical studies of user behaviour, Global and cultural considerations, Human-computer interaction in organizations and society, Human-computer interaction theory, Evaluation/methodology, User interface management systems (uims), Empirical studies of user behaviour, Global and cultural considerations, Human-computer interaction in organizations and society, Human-computer interaction theory, Evaluation/methodology, User interface management systems (uims)",
author = "Ashok Sivaji and Torkil Clemmensen and Nielsen, {S{\o}ren Feodor}",
year = "2017",
doi = "10.1080/10447318.2016.1243928",
language = "English",
volume = "33",
pages = "357--370",
journal = "International Journal of Human-Computer Interaction",
issn = "1044-7318",
publisher = "Taylor & Francis",
number = "5",

}

A Textual Feedback Tool for Empowering Participants in Usability and UX Evaluations. / Sivaji, Ashok; Clemmensen, Torkil; Nielsen, Søren Feodor.

In: International Journal of Human-Computer Interaction, Vol. 33, No. 5, 2017, p. 357-370.

Research output: Contribution to journalJournal articleResearchpeer-review

TY - JOUR

T1 - A Textual Feedback Tool for Empowering Participants in Usability and UX Evaluations

AU - Sivaji,Ashok

AU - Clemmensen,Torkil

AU - Nielsen,Søren Feodor

PY - 2017

Y1 - 2017

N2 - The usability movement has historically always sought to empower end-users of computers, so that they understand what is happening and can control the outcome. In this paper, we develop and evaluate a ‘Textual feedback’ tool for usability and UX evaluation that can be used to empower well-educated, but low-status, users in UX evaluations in countries and contexts with high power distances. The proposed tool contributes to the HCI community’s pool of localized UX evaluation tools. We evaluate the tool with 40 users from two socio-economic groups in real-life UX usability evaluations setting in Malaysia. The results indicate that the Textual Feedback tool may help participants to give their thoughts in UX evaluation in high power distance contexts. In particular, the Textual Feedback tool helps high status females and low status males express more UX problems than they can do with traditional CTA alone. We found that classic concurrent think aloud UX evaluation works fine in high power contexts, but only with the addition of Textual feedback to mitigate the effects of socio-economic status in certain user groups. We suggest that future research on UX evaluation look more into how to empower certain user groups, such as low status female users, in UX evaluations done in high power distance contexts.

AB - The usability movement has historically always sought to empower end-users of computers, so that they understand what is happening and can control the outcome. In this paper, we develop and evaluate a ‘Textual feedback’ tool for usability and UX evaluation that can be used to empower well-educated, but low-status, users in UX evaluations in countries and contexts with high power distances. The proposed tool contributes to the HCI community’s pool of localized UX evaluation tools. We evaluate the tool with 40 users from two socio-economic groups in real-life UX usability evaluations setting in Malaysia. The results indicate that the Textual Feedback tool may help participants to give their thoughts in UX evaluation in high power distance contexts. In particular, the Textual Feedback tool helps high status females and low status males express more UX problems than they can do with traditional CTA alone. We found that classic concurrent think aloud UX evaluation works fine in high power contexts, but only with the addition of Textual feedback to mitigate the effects of socio-economic status in certain user groups. We suggest that future research on UX evaluation look more into how to empower certain user groups, such as low status female users, in UX evaluations done in high power distance contexts.

KW - Empirical studies of user behaviour

KW - Global and cultural considerations

KW - Human-computer interaction in organizations and society

KW - Human-computer interaction theory

KW - Evaluation/methodology

KW - User interface management systems (uims)

KW - Empirical studies of user behaviour

KW - Global and cultural considerations

KW - Human-computer interaction in organizations and society

KW - Human-computer interaction theory

KW - Evaluation/methodology

KW - User interface management systems (uims)

U2 - 10.1080/10447318.2016.1243928

DO - 10.1080/10447318.2016.1243928

M3 - Journal article

VL - 33

SP - 357

EP - 370

JO - International Journal of Human-Computer Interaction

T2 - International Journal of Human-Computer Interaction

JF - International Journal of Human-Computer Interaction

SN - 1044-7318

IS - 5

ER -