An Eye-tracking Study of Notational, Informational, and Emotional Aspects of Learning Analytics Representations

Ravi Vatrapu, Peter Reimann, Susan Bull , Matthew Johnson

    Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    Abstract

    This paper presents an eye-tracking study of notational, informational, and emotional aspects of nine different notational systems (Skill Meters, Smilies, Traffic Lights, Topic Boxes, Collective Histograms, Word Clouds, Textual Descriptors, Table, and Matrix) and three different information states (Weak, Average, & Strong) used to represent student's learning. Findings from the eye-tracking study show that higher emotional activation was observed for the metaphorical notations of traffic lights and smilies and collective representations. Mean view time was higher for representations of the "average" informational learning state. Qualitative data analysis of the think-aloud comments and post-study interview show that student participants reflected on the meaning-making opportunities and action-taking possibilities afforded by the representations. Implications for the design and evaluation of learning analytics representations and discourse environments are discussed.
    This paper presents an eye-tracking study of notational, informational, and emotional aspects of nine different notational systems (Skill Meters, Smilies, Traffic Lights, Topic Boxes, Collective Histograms, Word Clouds, Textual Descriptors, Table, and Matrix) and three different information states (Weak, Average, & Strong) used to represent student's learning. Findings from the eye-tracking study show that higher emotional activation was observed for the metaphorical notations of traffic lights and smilies and collective representations. Mean view time was higher for representations of the "average" informational learning state. Qualitative data analysis of the think-aloud comments and post-study interview show that student participants reflected on the meaning-making opportunities and action-taking possibilities afforded by the representations. Implications for the design and evaluation of learning analytics representations and discourse environments are discussed.
    LanguageEnglish
    Title of host publicationProceedings of the Third International Conference on Learning Analytics and Knowledge. LAK '13
    EditorsDan Suthers, Katrien Verbert, Erik Duval , Xavier Ochoa
    Place of PublicationNew York
    PublisherAssociation for Computing Machinery
    Date2013
    Pages125-134
    ISBN (Print)9781450317856
    DOIs
    StatePublished - 2013
    EventThe 3rd International Conference on Learning Analytics and Knowledge - University of Leuven, Leuven, Belgium
    Duration: 8 Apr 201312 Apr 2013
    Conference number: 3
    http://lakconference2013.wordpress.com/

    Conference

    ConferenceThe 3rd International Conference on Learning Analytics and Knowledge
    Number3
    LocationUniversity of Leuven
    CountryBelgium
    CityLeuven
    Period08/04/201312/04/2013
    Internet address
    SeriesACM International Conference Proceeding Series

    Cite this

    Vatrapu, R., Reimann, P., Bull , S., & Johnson , M. (2013). An Eye-tracking Study of Notational, Informational, and Emotional Aspects of Learning Analytics Representations. In D. Suthers, K. Verbert, E. Duval , & X. Ochoa (Eds.), Proceedings of the Third International Conference on Learning Analytics and Knowledge. LAK '13 (pp. 125-134). New York: Association for Computing Machinery. ACM International Conference Proceeding Series, DOI: 10.1145/2460296.2460321
    Vatrapu, Ravi ; Reimann, Peter ; Bull , Susan ; Johnson , Matthew. / An Eye-tracking Study of Notational, Informational, and Emotional Aspects of Learning Analytics Representations. Proceedings of the Third International Conference on Learning Analytics and Knowledge. LAK '13. editor / Dan Suthers ; Katrien Verbert ; Erik Duval ; Xavier Ochoa. New York : Association for Computing Machinery, 2013. pp. 125-134 (ACM International Conference Proceeding Series).
    @inproceedings{bc92c3df875940af963699036524dffd,
    title = "An Eye-tracking Study of Notational, Informational, and Emotional Aspects of Learning Analytics Representations",
    abstract = "This paper presents an eye-tracking study of notational, informational, and emotional aspects of nine different notational systems (Skill Meters, Smilies, Traffic Lights, Topic Boxes, Collective Histograms, Word Clouds, Textual Descriptors, Table, and Matrix) and three different information states (Weak, Average, & Strong) used to represent student's learning. Findings from the eye-tracking study show that higher emotional activation was observed for the metaphorical notations of traffic lights and smilies and collective representations. Mean view time was higher for representations of the {"}average{"} informational learning state. Qualitative data analysis of the think-aloud comments and post-study interview show that student participants reflected on the meaning-making opportunities and action-taking possibilities afforded by the representations. Implications for the design and evaluation of learning analytics representations and discourse environments are discussed.",
    author = "Ravi Vatrapu and Peter Reimann and Susan Bull and Matthew Johnson",
    year = "2013",
    doi = "10.1145/2460296.2460321",
    language = "English",
    isbn = "9781450317856",
    pages = "125--134",
    editor = "Dan Suthers and Verbert, {Katrien } and {Duval }, {Erik } and Ochoa, {Xavier }",
    booktitle = "Proceedings of the Third International Conference on Learning Analytics and Knowledge. LAK '13",
    publisher = "Association for Computing Machinery",
    address = "United States",

    }

    Vatrapu, R, Reimann, P, Bull , S & Johnson , M 2013, An Eye-tracking Study of Notational, Informational, and Emotional Aspects of Learning Analytics Representations. in D Suthers, K Verbert, E Duval & X Ochoa (eds), Proceedings of the Third International Conference on Learning Analytics and Knowledge. LAK '13. Association for Computing Machinery, New York, ACM International Conference Proceeding Series, pp. 125-134, Leuven, Belgium, 08/04/2013. DOI: 10.1145/2460296.2460321

    An Eye-tracking Study of Notational, Informational, and Emotional Aspects of Learning Analytics Representations. / Vatrapu, Ravi; Reimann, Peter; Bull , Susan; Johnson , Matthew.

    Proceedings of the Third International Conference on Learning Analytics and Knowledge. LAK '13. ed. / Dan Suthers; Katrien Verbert; Erik Duval ; Xavier Ochoa. New York : Association for Computing Machinery, 2013. p. 125-134.

    Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    TY - GEN

    T1 - An Eye-tracking Study of Notational, Informational, and Emotional Aspects of Learning Analytics Representations

    AU - Vatrapu,Ravi

    AU - Reimann,Peter

    AU - Bull ,Susan

    AU - Johnson ,Matthew

    PY - 2013

    Y1 - 2013

    N2 - This paper presents an eye-tracking study of notational, informational, and emotional aspects of nine different notational systems (Skill Meters, Smilies, Traffic Lights, Topic Boxes, Collective Histograms, Word Clouds, Textual Descriptors, Table, and Matrix) and three different information states (Weak, Average, & Strong) used to represent student's learning. Findings from the eye-tracking study show that higher emotional activation was observed for the metaphorical notations of traffic lights and smilies and collective representations. Mean view time was higher for representations of the "average" informational learning state. Qualitative data analysis of the think-aloud comments and post-study interview show that student participants reflected on the meaning-making opportunities and action-taking possibilities afforded by the representations. Implications for the design and evaluation of learning analytics representations and discourse environments are discussed.

    AB - This paper presents an eye-tracking study of notational, informational, and emotional aspects of nine different notational systems (Skill Meters, Smilies, Traffic Lights, Topic Boxes, Collective Histograms, Word Clouds, Textual Descriptors, Table, and Matrix) and three different information states (Weak, Average, & Strong) used to represent student's learning. Findings from the eye-tracking study show that higher emotional activation was observed for the metaphorical notations of traffic lights and smilies and collective representations. Mean view time was higher for representations of the "average" informational learning state. Qualitative data analysis of the think-aloud comments and post-study interview show that student participants reflected on the meaning-making opportunities and action-taking possibilities afforded by the representations. Implications for the design and evaluation of learning analytics representations and discourse environments are discussed.

    U2 - 10.1145/2460296.2460321

    DO - 10.1145/2460296.2460321

    M3 - Article in proceedings

    SN - 9781450317856

    SP - 125

    EP - 134

    BT - Proceedings of the Third International Conference on Learning Analytics and Knowledge. LAK '13

    PB - Association for Computing Machinery

    CY - New York

    ER -

    Vatrapu R, Reimann P, Bull S, Johnson M. An Eye-tracking Study of Notational, Informational, and Emotional Aspects of Learning Analytics Representations. In Suthers D, Verbert K, Duval E, Ochoa X, editors, Proceedings of the Third International Conference on Learning Analytics and Knowledge. LAK '13. New York: Association for Computing Machinery. 2013. p. 125-134. (ACM International Conference Proceeding Series). Available from, DOI: 10.1145/2460296.2460321