Evaluating the Effects of Interactivity in a Post-Editing Workbench

Nancy Underwood, Bartolomé Mesa-Lao, Mercedes Garcia Martinez, Michael Carl, Vicent Alabau, Jesus Gonzalez-Rubio, Luis A. Leiva, Germán Sanchis-Trilles, Daniel Ortíz-Martínez , Francisco Casacuberta

    Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    Abstract

    This paper describes the field trial and subsequent evaluation of a post-editing workbench which is currently under development in the EU-funded CasMaCat project. Based on user evaluations of the initial prototype of the workbench, this second prototype of the workbench includes a number of interactive features designed to improve productivity and user satisfaction. Using CasMaCat's own facilities for logging keystrokes and eye tracking, data were collected from nine post-editors in a professional setting. These data were then used to investigate the effects of the interactive features on productivity, quality, user satisfaction and cognitive load as reflected in the post-editors’ gaze activity. These quantitative results are combined with the qualitative results derived from user questionnaires and interviews conducted with all the participants.
    Original languageEnglish
    Title of host publicationProceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
    EditorsNicoletta Calzolari, Khalid Choukri , Thierry Declerck , Hrafn Loftsson , Bente Maegaard, Joseph Mariani , Asuncion Moreno , Jan Odijk , Stelios Piperidis
    Number of pages7
    Place of PublicationParis
    PublisherEuropean Language Resources Association
    Publication date2014
    Pages553-559
    ISBN (Print)9782951740884
    Publication statusPublished - 2014
    EventThe 9th International Conference on Language Resources and Evaluation. LREC 2014 - Reykjavik, Iceland
    Duration: 26 May 201431 May 2014
    Conference number: 9
    http://lrec2014.lrec-conf.org/en/

    Conference

    ConferenceThe 9th International Conference on Language Resources and Evaluation. LREC 2014
    Number9
    CountryIceland
    CityReykjavik
    Period26/05/201431/05/2014
    Internet address

    Cite this

    Underwood, N., Mesa-Lao, B., Martinez, M. G., Carl, M., Alabau, V., Gonzalez-Rubio, J., A. Leiva, L., Sanchis-Trilles, G., Ortíz-Martínez , D., & Casacuberta, F. (2014). Evaluating the Effects of Interactivity in a Post-Editing Workbench. In N. Calzolari, K. Choukri , T. Declerck , H. Loftsson , B. Maegaard, J. Mariani , A. Moreno , J. Odijk , & S. Piperidis (Eds.), Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14) (pp. 553-559). European Language Resources Association. http://www.lrec-conf.org/proceedings/lrec2014/summaries/289.html