Can you Trust Online Ratings?: Evidence of Systematic Differences in User Populations

Julie Wulff, Daniel Hardt

    Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    Abstract

    Do user populations differ systematically in the way they express and rate sentiment? We use large collections of Danish and U.S. reviews to investigate this question, and we find evidence of important systematic differences: first, positive ratings are far more common in the U.S. data than in the Danish data. Second, Danish reviewers tend to under-rate their own positive reviews compared to U.S. reviewers. This has potentially far-reaching implications for the interpretation of user ratings, the use of which has exploded in recent years.
    Do user populations differ systematically in the way they express and rate sentiment? We use large collections of Danish and U.S. reviews to investigate this question, and we find evidence of important systematic differences: first, positive ratings are far more common in the U.S. data than in the Danish data. Second, Danish reviewers tend to under-rate their own positive reviews compared to U.S. reviewers. This has potentially far-reaching implications for the interpretation of user ratings, the use of which has exploded in recent years.
    LanguageEnglish
    Title of host publicationECIS 2014 Proceedings
    EditorsMichel Avital, Jan Marco Leimeister, Ulrike Schultze
    Number of pages12
    Place of PublicationAtlanta, GA
    PublisherAssociation for Information Systems. AIS Electronic Library (AISeL)
    Date2014
    ISBN (Print)9780991556700
    StatePublished - 2014
    EventThe 22nd European Conference on Information Systems (ECIS) 2014: Digital Work, Digital Life - David Intercontinental Hotel, Tel Aviv, Israel
    Duration: 9 Jun 201411 Jun 2014
    Conference number: 22
    http://ecis2014.eu/

    Conference

    ConferenceThe 22nd European Conference on Information Systems (ECIS) 2014
    Number22
    LocationDavid Intercontinental Hotel
    CountryIsrael
    CityTel Aviv
    Period09/06/201411/06/2014
    Internet address
    SeriesProceedings of the European Conference on Information Systems
    ISSN0000-0034

    Keywords

      Cite this

      Wulff, J., & Hardt, D. (2014). Can you Trust Online Ratings? Evidence of Systematic Differences in User Populations. In M. Avital, J. M. Leimeister, & U. Schultze (Eds.), ECIS 2014 Proceedings Atlanta, GA: Association for Information Systems. AIS Electronic Library (AISeL). Proceedings of the European Conference on Information Systems
      Wulff, Julie ; Hardt, Daniel. / Can you Trust Online Ratings? Evidence of Systematic Differences in User Populations. ECIS 2014 Proceedings. editor / Michel Avital ; Jan Marco Leimeister ; Ulrike Schultze. Atlanta, GA : Association for Information Systems. AIS Electronic Library (AISeL), 2014. (Proceedings of the European Conference on Information Systems).
      @inproceedings{2c514dd4aa9a4ce2830d73a5fa7149ae,
      title = "Can you Trust Online Ratings?: Evidence of Systematic Differences in User Populations",
      abstract = "Do user populations differ systematically in the way they express and rate sentiment? We use large collections of Danish and U.S. reviews to investigate this question, and we find evidence of important systematic differences: first, positive ratings are far more common in the U.S. data than in the Danish data. Second, Danish reviewers tend to under-rate their own positive reviews compared to U.S. reviewers. This has potentially far-reaching implications for the interpretation of user ratings, the use of which has exploded in recent years.",
      keywords = "Online Reviews, Sentiment Analysis, Text Mining, Social Media",
      author = "Julie Wulff and Daniel Hardt",
      year = "2014",
      language = "English",
      isbn = "9780991556700",
      editor = "Avital, {Michel } and Leimeister, {Jan Marco } and Schultze, {Ulrike }",
      booktitle = "ECIS 2014 Proceedings",
      publisher = "Association for Information Systems. AIS Electronic Library (AISeL)",

      }

      Wulff, J & Hardt, D 2014, Can you Trust Online Ratings? Evidence of Systematic Differences in User Populations. in M Avital, JM Leimeister & U Schultze (eds), ECIS 2014 Proceedings. Association for Information Systems. AIS Electronic Library (AISeL), Atlanta, GA, Proceedings of the European Conference on Information Systems, Tel Aviv, Israel, 09/06/2014.

      Can you Trust Online Ratings? Evidence of Systematic Differences in User Populations. / Wulff, Julie; Hardt, Daniel.

      ECIS 2014 Proceedings. ed. / Michel Avital; Jan Marco Leimeister; Ulrike Schultze. Atlanta, GA : Association for Information Systems. AIS Electronic Library (AISeL), 2014.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

      TY - GEN

      T1 - Can you Trust Online Ratings?

      T2 - Evidence of Systematic Differences in User Populations

      AU - Wulff,Julie

      AU - Hardt,Daniel

      PY - 2014

      Y1 - 2014

      N2 - Do user populations differ systematically in the way they express and rate sentiment? We use large collections of Danish and U.S. reviews to investigate this question, and we find evidence of important systematic differences: first, positive ratings are far more common in the U.S. data than in the Danish data. Second, Danish reviewers tend to under-rate their own positive reviews compared to U.S. reviewers. This has potentially far-reaching implications for the interpretation of user ratings, the use of which has exploded in recent years.

      AB - Do user populations differ systematically in the way they express and rate sentiment? We use large collections of Danish and U.S. reviews to investigate this question, and we find evidence of important systematic differences: first, positive ratings are far more common in the U.S. data than in the Danish data. Second, Danish reviewers tend to under-rate their own positive reviews compared to U.S. reviewers. This has potentially far-reaching implications for the interpretation of user ratings, the use of which has exploded in recent years.

      KW - Online Reviews

      KW - Sentiment Analysis

      KW - Text Mining

      KW - Social Media

      M3 - Article in proceedings

      SN - 9780991556700

      BT - ECIS 2014 Proceedings

      PB - Association for Information Systems. AIS Electronic Library (AISeL)

      CY - Atlanta, GA

      ER -

      Wulff J, Hardt D. Can you Trust Online Ratings? Evidence of Systematic Differences in User Populations. In Avital M, Leimeister JM, Schultze U, editors, ECIS 2014 Proceedings. Atlanta, GA: Association for Information Systems. AIS Electronic Library (AISeL). 2014. (Proceedings of the European Conference on Information Systems).