Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

Click here to sign up for SAGE Journal Email Alerts today!

Sign In to gain access to subscriptions and/or personal tools.
Field Methods
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Hruschka, D. J.
Right arrow Articles by Carey, J. W.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

Reliability in Coding Open-Ended Data: Lessons Learned from HIV Behavioral Research

Daniel J. Hruschka

Centers for Disease Control and Prevention, Atlanta, Georgia, Emory University

Deborah Schwartz

Daphne Cobb St.John

Erin Picone-Decaro

Richard A. Jenkins

James W. Carey

Centers for Disease Control and Prevention, Atlanta, Georgia

Analysis of text from open-ended interviews has become an important research tool in numerous fields, including business, education, and health research. Coding is an essential part of such analysis, but questions of quality control in the coding process have generally received little attention. This article examines the text coding process applied to three HIV-related studies conducted with the Centers for Disease Control and Prevention considering populations in the United States and Zimbabwe. Based on experience coding data from these studies, we conclude that (1) a team of coders will initially produce very different codings, but (2) it is possible, through a process of codebook revision and recoding, to establish strong levels of intercoder reliability (e.g., most codes with kappa 0.8). Furthermore, steps can be taken to improve initially poor intercoder reliability and to reduce the number of iterations required to generate stronger intercoder reliability.

Key Words: intercoder agreement • interrater agreement • open-ended • qualitative • data • reliability

Field Methods, Vol. 16, No. 3, 307-331 (2004)
DOI: 10.1177/1525822X04266540
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
 Field MethodsHome page
R. Popping and C. W. Roberts
Coding Issues in Modality Analysis
Field Methods, August 1, 2009; 21(3): 244 - 264.
[Abstract] [PDF]

Home page
 AJPHHome page
R. C. Veniegas, U. H. Kao, R. Rosales, and M. Arellanes
HIV Prevention Technology Transfer: Challenges and Strategies in the Real World
Am J Public Health, April 1, 2009; 99(S1): S124 - S130.
[Abstract] [Full Text] [PDF]

Home page
 Field MethodsHome page
D. J. Hruschka, L. M. Sibley, N. Kalim, and J. K. Edmonds
When There Is More than One Answer Key: Cultural Theories of Postpartum Hemorrhage in Matlab, Bangladesh
Field Methods, November 1, 2008; 20(4): 315 - 337.
[Abstract] [PDF]

Home page
 GerontologistHome page
V. B. Mitrani, D. J. Feaster, B. E. McCabe, S. J. Czaja, and J. Szapocznik
Adapting the Structural Family Systems Rating to Assess the Patterns of Interaction in Families of Dementia Caregivers
Gerontologist, August 1, 2005; 45(4): 445 - 455.
[Abstract] [Full Text] [PDF]