Coding In-depth Semistructured Interviews: Problems of Unitization and Intercoder Reliability and Agreement

John L. Campbell, Charles Quincy, Jordan Osserman, Ove K. Pedersen

    Research output: Contribution to journalJournal articleResearchpeer-review

    Abstract

    Many social science studies are based on coded in-depth semistructured interview transcripts. But researchers rarely report or discuss coding reliability in this work. Nor is there much literature on the subject for this type of data. This article presents a procedure for developing coding schemes for such data. It involves standardizing the units of text on which coders work and then improving the coding scheme’s discriminant capability (i.e., reducing coding errors) to an acceptable point as indicated by measures of either intercoder reliability or intercoder agreement. This approach is especially useful for situations where a single knowledgeable coder will code all the transcripts once the coding scheme has been established. This approach can also be used with other types of qualitative data and in other circumstances.
    Many social science studies are based on coded in-depth semistructured interview transcripts. But researchers rarely report or discuss coding reliability in this work. Nor is there much literature on the subject for this type of data. This article presents a procedure for developing coding schemes for such data. It involves standardizing the units of text on which coders work and then improving the coding scheme’s discriminant capability (i.e., reducing coding errors) to an acceptable point as indicated by measures of either intercoder reliability or intercoder agreement. This approach is especially useful for situations where a single knowledgeable coder will code all the transcripts once the coding scheme has been established. This approach can also be used with other types of qualitative data and in other circumstances.
    LanguageEnglish
    JournalSociological Methods & Research
    Volume42
    Issue number3
    Pages294-320
    ISSN0049-1241
    DOIs
    StatePublished - 2013

    Keywords

      Cite this

      @article{c245541306784ecfaed98d6ec876d277,
      title = "Coding In-depth Semistructured Interviews: Problems of Unitization and Intercoder Reliability and Agreement",
      abstract = "Many social science studies are based on coded in-depth semistructured interview transcripts. But researchers rarely report or discuss coding reliability in this work. Nor is there much literature on the subject for this type of data. This article presents a procedure for developing coding schemes for such data. It involves standardizing the units of text on which coders work and then improving the coding scheme’s discriminant capability (i.e., reducing coding errors) to an acceptable point as indicated by measures of either intercoder reliability or intercoder agreement. This approach is especially useful for situations where a single knowledgeable coder will code all the transcripts once the coding scheme has been established. This approach can also be used with other types of qualitative data and in other circumstances.",
      keywords = "Qualitative methods, Coding, Intercoder reliability, Intercoder agreement, Interviews",
      author = "Campbell, {John L.} and Charles Quincy and Jordan Osserman and Pedersen, {Ove K.}",
      year = "2013",
      doi = "10.1177/0049124113500475",
      language = "English",
      volume = "42",
      pages = "294--320",
      journal = "Sociological Methods & Research",
      issn = "0049-1241",
      publisher = "Sage Publications, Inc.",
      number = "3",

      }

      Coding In-depth Semistructured Interviews : Problems of Unitization and Intercoder Reliability and Agreement. / Campbell, John L.; Quincy, Charles ; Osserman, Jordan ; Pedersen, Ove K.

      In: Sociological Methods & Research, Vol. 42, No. 3, 2013, p. 294-320.

      Research output: Contribution to journalJournal articleResearchpeer-review

      TY - JOUR

      T1 - Coding In-depth Semistructured Interviews

      T2 - Sociological Methods & Research

      AU - Campbell,John L.

      AU - Quincy,Charles

      AU - Osserman,Jordan

      AU - Pedersen,Ove K.

      PY - 2013

      Y1 - 2013

      N2 - Many social science studies are based on coded in-depth semistructured interview transcripts. But researchers rarely report or discuss coding reliability in this work. Nor is there much literature on the subject for this type of data. This article presents a procedure for developing coding schemes for such data. It involves standardizing the units of text on which coders work and then improving the coding scheme’s discriminant capability (i.e., reducing coding errors) to an acceptable point as indicated by measures of either intercoder reliability or intercoder agreement. This approach is especially useful for situations where a single knowledgeable coder will code all the transcripts once the coding scheme has been established. This approach can also be used with other types of qualitative data and in other circumstances.

      AB - Many social science studies are based on coded in-depth semistructured interview transcripts. But researchers rarely report or discuss coding reliability in this work. Nor is there much literature on the subject for this type of data. This article presents a procedure for developing coding schemes for such data. It involves standardizing the units of text on which coders work and then improving the coding scheme’s discriminant capability (i.e., reducing coding errors) to an acceptable point as indicated by measures of either intercoder reliability or intercoder agreement. This approach is especially useful for situations where a single knowledgeable coder will code all the transcripts once the coding scheme has been established. This approach can also be used with other types of qualitative data and in other circumstances.

      KW - Qualitative methods

      KW - Coding

      KW - Intercoder reliability

      KW - Intercoder agreement

      KW - Interviews

      U2 - 10.1177/0049124113500475

      DO - 10.1177/0049124113500475

      M3 - Journal article

      VL - 42

      SP - 294

      EP - 320

      JO - Sociological Methods & Research

      JF - Sociological Methods & Research

      SN - 0049-1241

      IS - 3

      ER -