Inter-observer variability within BI-RADS and RANZCR mammographic density assessment schemes

Christine N. Damases; Claudia Mello-Thoms; Mark F. McEntee

doi:10.1117/12.2214932

Inter-observer variability within BI-RADS and RANZCR mammographic density assessment schemes

Christine N. Damases
, Claudia Mello-Thoms
, Mark F. McEntee

University of Sydney

Research output: Chapter in Book/Report/Conference proceedings › Conference proceeding › peer-review

Abstract

This study compares variability associated with two visual mammographic density (MD) assessment methods using two separate samples of radiologists. The image test-set comprised of images obtained from 20 women (age 42-89 years). The images were assessed for their MD by twenty American Board of Radiology (ABR) examiners and twenty-six radiologists registered with the Royal Australian and New Zealand College of Radiologists (RANZCR). Images were assessed using the same technology and conditions, however the ABR radiologists used the BI-RADS and the RANZCR radiologists used the RANZCR breast density synoptic. Both scales use a 4-point assessment. The images were then grouped as low- and high-density; low including BIRADS 1 and 2 or RANZCR 1 and 2 and high including BI-RADS 3 and 4 or RANZCR 3 and 4. Four-point BI-RADS and RANZCR showed no or negligible correlation (ρ=-0.029; p<0.859). The average inter-observer agreement on the BI-RADS scale had a Kappa of 0.565; [95% CI = 0.519-0.610], and ranged between 0.328-0.669 while the inter-observer agreement using the RANZCR scale had a Kappa of 0.360; [95% CI = 0.308-0.412] and a range of 0.078-0.499. Our findings show a wider range of inter-observer variability among RANZCR registered radiologists than the ABR examiners.

Original language	English
Title of host publication	Medical Imaging 2016
Subtitle of host publication	Image Perception, Observer Performance, and Technology Assessment
Editors	Craig K. Abbey, Matthew A. Kupinski
Publisher	SPIE
ISBN (Electronic)	9781510600225
DOIs	https://doi.org/10.1117/12.2214932
Publication status	Published - 2016
Externally published	Yes
Event	Medical Imaging 2016: Image Perception, Observer Performance, and Technology Assessment - San Diego, United States Duration: 2 Mar 2016 → 3 Mar 2016

Publication series

Name	Progress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume	9787
ISSN (Print)	1605-7422

Conference

Conference	Medical Imaging 2016: Image Perception, Observer Performance, and Technology Assessment
Country/Territory	United States
City	San Diego
Period	2/03/16 → 3/03/16

Keywords

Breast density
Inter-observer agreement
Visual assessment methods

Access to Document

10.1117/12.2214932

Cite this

Damases, C. N., Mello-Thoms, C., & McEntee, M. F. (2016). Inter-observer variability within BI-RADS and RANZCR mammographic density assessment schemes. In C. K. Abbey, & M. A. Kupinski (Eds.), Medical Imaging 2016: Image Perception, Observer Performance, and Technology Assessment Article 97871C (Progress in Biomedical Optics and Imaging - Proceedings of SPIE; Vol. 9787). SPIE. https://doi.org/10.1117/12.2214932

Damases, Christine N. ; Mello-Thoms, Claudia ; McEntee, Mark F. / Inter-observer variability within BI-RADS and RANZCR mammographic density assessment schemes. Medical Imaging 2016: Image Perception, Observer Performance, and Technology Assessment. editor / Craig K. Abbey ; Matthew A. Kupinski. SPIE, 2016. (Progress in Biomedical Optics and Imaging - Proceedings of SPIE).

@inproceedings{27799cb4faf147abae6fa1df03806cf4,

title = "Inter-observer variability within BI-RADS and RANZCR mammographic density assessment schemes",

abstract = "This study compares variability associated with two visual mammographic density (MD) assessment methods using two separate samples of radiologists. The image test-set comprised of images obtained from 20 women (age 42-89 years). The images were assessed for their MD by twenty American Board of Radiology (ABR) examiners and twenty-six radiologists registered with the Royal Australian and New Zealand College of Radiologists (RANZCR). Images were assessed using the same technology and conditions, however the ABR radiologists used the BI-RADS and the RANZCR radiologists used the RANZCR breast density synoptic. Both scales use a 4-point assessment. The images were then grouped as low- and high-density; low including BIRADS 1 and 2 or RANZCR 1 and 2 and high including BI-RADS 3 and 4 or RANZCR 3 and 4. Four-point BI-RADS and RANZCR showed no or negligible correlation (ρ=-0.029; p<0.859). The average inter-observer agreement on the BI-RADS scale had a Kappa of 0.565; [95\% CI = 0.519-0.610], and ranged between 0.328-0.669 while the inter-observer agreement using the RANZCR scale had a Kappa of 0.360; [95\% CI = 0.308-0.412] and a range of 0.078-0.499. Our findings show a wider range of inter-observer variability among RANZCR registered radiologists than the ABR examiners.",

keywords = "Breast density, Inter-observer agreement, Visual assessment methods",

author = "Damases, \{Christine N.\} and Claudia Mello-Thoms and McEntee, \{Mark F.\}",

note = "Publisher Copyright: {\textcopyright} 2016 SPIE.; Medical Imaging 2016: Image Perception, Observer Performance, and Technology Assessment ; Conference date: 02-03-2016 Through 03-03-2016",

year = "2016",

doi = "10.1117/12.2214932",

language = "English",

series = "Progress in Biomedical Optics and Imaging - Proceedings of SPIE",

publisher = "SPIE",

editor = "Abbey, \{Craig K.\} and Kupinski, \{Matthew A.\}",

booktitle = "Medical Imaging 2016",

address = "United States",

}

Damases, CN, Mello-Thoms, C & McEntee, MF 2016, Inter-observer variability within BI-RADS and RANZCR mammographic density assessment schemes. in CK Abbey & MA Kupinski (eds), Medical Imaging 2016: Image Perception, Observer Performance, and Technology Assessment., 97871C, Progress in Biomedical Optics and Imaging - Proceedings of SPIE, vol. 9787, SPIE, Medical Imaging 2016: Image Perception, Observer Performance, and Technology Assessment, San Diego, United States, 2/03/16. https://doi.org/10.1117/12.2214932

Inter-observer variability within BI-RADS and RANZCR mammographic density assessment schemes. / Damases, Christine N.; Mello-Thoms, Claudia; McEntee, Mark F.
Medical Imaging 2016: Image Perception, Observer Performance, and Technology Assessment. ed. / Craig K. Abbey; Matthew A. Kupinski. SPIE, 2016. 97871C (Progress in Biomedical Optics and Imaging - Proceedings of SPIE; Vol. 9787).

Research output: Chapter in Book/Report/Conference proceedings › Conference proceeding › peer-review

TY - GEN

T1 - Inter-observer variability within BI-RADS and RANZCR mammographic density assessment schemes

AU - Damases, Christine N.

AU - Mello-Thoms, Claudia

AU - McEntee, Mark F.

PY - 2016

Y1 - 2016

N2 - This study compares variability associated with two visual mammographic density (MD) assessment methods using two separate samples of radiologists. The image test-set comprised of images obtained from 20 women (age 42-89 years). The images were assessed for their MD by twenty American Board of Radiology (ABR) examiners and twenty-six radiologists registered with the Royal Australian and New Zealand College of Radiologists (RANZCR). Images were assessed using the same technology and conditions, however the ABR radiologists used the BI-RADS and the RANZCR radiologists used the RANZCR breast density synoptic. Both scales use a 4-point assessment. The images were then grouped as low- and high-density; low including BIRADS 1 and 2 or RANZCR 1 and 2 and high including BI-RADS 3 and 4 or RANZCR 3 and 4. Four-point BI-RADS and RANZCR showed no or negligible correlation (ρ=-0.029; p<0.859). The average inter-observer agreement on the BI-RADS scale had a Kappa of 0.565; [95% CI = 0.519-0.610], and ranged between 0.328-0.669 while the inter-observer agreement using the RANZCR scale had a Kappa of 0.360; [95% CI = 0.308-0.412] and a range of 0.078-0.499. Our findings show a wider range of inter-observer variability among RANZCR registered radiologists than the ABR examiners.

AB - This study compares variability associated with two visual mammographic density (MD) assessment methods using two separate samples of radiologists. The image test-set comprised of images obtained from 20 women (age 42-89 years). The images were assessed for their MD by twenty American Board of Radiology (ABR) examiners and twenty-six radiologists registered with the Royal Australian and New Zealand College of Radiologists (RANZCR). Images were assessed using the same technology and conditions, however the ABR radiologists used the BI-RADS and the RANZCR radiologists used the RANZCR breast density synoptic. Both scales use a 4-point assessment. The images were then grouped as low- and high-density; low including BIRADS 1 and 2 or RANZCR 1 and 2 and high including BI-RADS 3 and 4 or RANZCR 3 and 4. Four-point BI-RADS and RANZCR showed no or negligible correlation (ρ=-0.029; p<0.859). The average inter-observer agreement on the BI-RADS scale had a Kappa of 0.565; [95% CI = 0.519-0.610], and ranged between 0.328-0.669 while the inter-observer agreement using the RANZCR scale had a Kappa of 0.360; [95% CI = 0.308-0.412] and a range of 0.078-0.499. Our findings show a wider range of inter-observer variability among RANZCR registered radiologists than the ABR examiners.

KW - Breast density

KW - Inter-observer agreement

KW - Visual assessment methods

UR - https://www.scopus.com/pages/publications/84976300420

U2 - 10.1117/12.2214932

DO - 10.1117/12.2214932

M3 - Conference proceeding

AN - SCOPUS:84976300420

T3 - Progress in Biomedical Optics and Imaging - Proceedings of SPIE

BT - Medical Imaging 2016

A2 - Abbey, Craig K.

A2 - Kupinski, Matthew A.

PB - SPIE

T2 - Medical Imaging 2016: Image Perception, Observer Performance, and Technology Assessment

Y2 - 2 March 2016 through 3 March 2016

ER -

Inter-observer variability within BI-RADS and RANZCR mammographic density assessment schemes

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this