Evaluating the Effects of Interactivity in a Post-Editing Workbench

Nancy Underwood, Bartolomé Mesa-Lao, Mercedes Garcia Martinez, Michael Carl, Vicent Alabau, Jesus Gonzalez-Rubio, Luis A. Leiva, Germán Sanchis-Trilles, Daniel Ortíz-Martínez , Francisco Casacuberta

    Publikation: Bidrag til bog/antologi/rapportKonferencebidrag i proceedingsForskningpeer review

    Abstrakt

    This paper describes the field trial and subsequent evaluation of a post-editing workbench which is currently under development in the EU-funded CasMaCat project. Based on user evaluations of the initial prototype of the workbench, this second prototype of the workbench includes a number of interactive features designed to improve productivity and user satisfaction. Using CasMaCat's own facilities for logging keystrokes and eye tracking, data were collected from nine post-editors in a professional setting. These data were then used to investigate the effects of the interactive features on productivity, quality, user satisfaction and cognitive load as reflected in the post-editors’ gaze activity. These quantitative results are combined with the qualitative results derived from user questionnaires and interviews conducted with all the participants.
    OriginalsprogEngelsk
    TitelProceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
    RedaktørerNicoletta Calzolari, Khalid Choukri , Thierry Declerck , Hrafn Loftsson , Bente Maegaard, Joseph Mariani , Asuncion Moreno , Jan Odijk , Stelios Piperidis
    Antal sider7
    UdgivelsesstedParis
    ForlagEuropean Language Resources Association
    Publikationsdato2014
    Sider553-559
    ISBN (Trykt)9782951740884
    StatusUdgivet - 2014
    BegivenhedThe 9th International Conference on Language Resources and Evaluation. LREC 2014 - Reykjavik, Island
    Varighed: 26 maj 201431 maj 2014
    Konferencens nummer: 9
    http://lrec2014.lrec-conf.org/en/

    Konference

    KonferenceThe 9th International Conference on Language Resources and Evaluation. LREC 2014
    Nummer9
    LandIsland
    ByReykjavik
    Periode26/05/201431/05/2014
    Internetadresse

    Emneord

    • Post-editing
    • Machine translation
    • Evaluation
    • Interactive translation prediction

    Citationsformater