Interrater and Intrarater Reliability in the Diagnosis and Staging of Endometriosis Public Deposited

http://ir.library.oregonstate.edu/concern/defaults/cj82k820n

To the best of our knowledge, one or more authors of this paper were federal employees when contributing to this work. This is the publisher’s final pdf. The published article is copyrighted by American Congress of Obstetricians and Gynecologists and can be found at:  http://www.acog.org/.

Descriptions

Attribute NameValues
Creator
Abstract or Summary
  • OBJECTIVE: To estimate the interrater and intrarater reliability of endometriosis diagnosis and severity of disease among gynecologic surgeons viewing operative digital images. METHODS: The study population comprised a random sample (n = 148 [36%]) of women who participated in the Endometriosis: Natural History, Diagnosis and Outcomes study. Four academic expert and four local, specialized expert surgeons reviewed the images, diagnosed the presence or absence of endometriosis for each woman, and rated severity using the revised American Society for Reproductive Medicine (ASRM) criteria. Interrater-level and intrarater-level agreement were calculated for both endometriosis diagnosis and staging. RESULTS: The interrater reliability for endometriosis diagnosis among the eight surgeons was substantial: Fleiss kappa = 0.69 (95% confidence interval [CI] 0.64-0.74). Surgeons agreed on revised ASRM endometriosis staging criteria after experienced assessment in a majority of cases (mean 61%, range 52-75%) with moderate interrater reliability: Fleiss kappa = 0.44 (95% CI 0.41-0.47). The intrarater reliability for experienced assessment compared with computer-assisted revised ASRM staging was almost perfect (mean weighted kappa = 0.95, range 0.89-0.99). CONCLUSION: Substantial reliability was found for revised ASRM endometriosis diagnosis, whereas moderate reliability was observed for staging. Almost perfect reliability was observed for surgeons' rating of disease severity compared with computerized-assisted, checklist-based staging. Findings suggest that reliability in endometriosis diagnosis is not greatly altered by location or composition of surgeons, supporting the conduct of multisite studies or compilation of endometriosis data across clinical centers. Although surgeons appear to be skilled at assessing endometriosis stage intuitively, how staging of disease burden correlates with clinical outcomes remains to be developed. (Obstet Gynecol 2012; 120: 104-12) DOI:10.1097/AOG. 0b013e31825bc6cf
Resource Type
DOI
Date Available
Date Issued
Citation
  • Schliep, K., Peterson, C., Stanford, J., Chen, Z., Zhang, B., Dorais, J., . . . Outc. (2012). Interrater and intrarater reliability in the diagnosis and staging of endometriosis. Obstetrics and Gynecology, 120(1), 104-112. doi:10.1097/AOG.0b013e31825bc6cf
Academic Affiliation
Series
Keyword
Rights Statement
Funding Statement (additional comments about funding)
Publisher
Peer Reviewed
Language
Replaces
Additional Information
  • description.provenance : Approved for entry into archive by Deborah Campbell(deborah.campbell@oregonstate.edu) on 2013-09-23T18:20:06Z (GMT) No. of bitstreams: 1 ZhangBoPublicHealthHumanSciencesInterraterIntraraterReliability.pdf: 209650 bytes, checksum: b90aa02c9d71352b25926cce9b62a4db (MD5)
  • description.provenance : Submitted by Deborah Campbell (deborah.campbell@oregonstate.edu) on 2013-09-23T18:19:51Z No. of bitstreams: 1 ZhangBoPublicHealthHumanSciencesInterraterIntraraterReliability.pdf: 209650 bytes, checksum: b90aa02c9d71352b25926cce9b62a4db (MD5)
  • description.provenance : Made available in DSpace on 2013-09-23T18:20:06Z (GMT). No. of bitstreams: 1 ZhangBoPublicHealthHumanSciencesInterraterIntraraterReliability.pdf: 209650 bytes, checksum: b90aa02c9d71352b25926cce9b62a4db (MD5) Previous issue date: 2012-07

Relationships

Parents:

This work has no parents.

Last modified

Downloadable Content

Download PDF

Items