Interobserver agreement in neonatal seizure identification.

Typeset version

 

TY  - JOUR
  - Malone, A.,Ryan, C. A.,Fitzgerald, A.,Burgoyne, L.,Connolly, S.,Boylan, G. B.
  - 2009
  - September
  - Epilepsia
  - Interobserver agreement in neonatal seizure identification.
  - Validated
  - ()
  - 50
  - 9
  - 2097
  - 101
  - OBJECTIVES: Accurate diagnosis of neonatal seizures is critically important and is often made clinically, without EEG (electroencephalography) monitoring. This observational study aimed to determine the accuracy and interobserver reliability of healthcare professionals in distinguishing clinically manifested seizures from other neonatal movements, when presented with clinical histories and digital video recordings only. METHODS: Twenty digital video recordings of paroxysmal movements in term and preterm infants were selected from a video-EEG database. The movements were categorized as seizure and nonseizure using EEG. Health care professionals (n = 137) from eight neonatal intensive care units (NICUs) were shown the video recordings with additional relevant clinical data, excluding EEG findings. The observers were asked to indicate which movements they considered to be seizure or nonseizure. A multirater Kappa statistic was used to assess agreement between observers and with the true diagnosis. RESULTS: Twenty video clips (11 seizure, 9 nonseizure) were evaluated by 91 doctors and 46 other professionals. The average number of correctly identified events was 10/20. Clonic seizures were correctly identified most frequently (range 36.5-95.6% of observers). Subtle seizures were poorly identified (range 20.4-49.6% of observers). The interobserver agreement (Kappa) for doctors and other health care professionals was poor at 0.21 and 0.29, respectively. Agreement with the correct diagnosis was also poor at 0.09 for doctors and -0.02 for other healthcare professionals. DISCUSSION: It is often impossible to accurately differentiate between seizure-related and nonseizure movements in infants using clinical evaluation alone. In addition, doctors do not have a higher capacity for discriminating between neonatal paroxysmal events than other health care professionals. Until reliable continuous neurologic monitoring of newborn babies is available, it is likely that some babies with seizures will remain undetected and others with nonseizure movements will continue to be treated with potentially harmful anticonvulsants.
  - 1528-1167 (Electronic) 00
  - http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve;db=PubMed;dopt=Citation;list_uids=19490044
DA  - 2009/09
ER  - 
@article{V33349138,
   = {Malone,  A. and Ryan,  C. A. and Fitzgerald,  A. and Burgoyne,  L. and Connolly,  S. and Boylan,  G. B. },
   = {2009},
   = {September},
   = {Epilepsia},
   = {Interobserver agreement in neonatal seizure identification.},
   = {Validated},
   = {()},
   = {50},
   = {9},
  pages = {2097--101},
   = {{OBJECTIVES: Accurate diagnosis of neonatal seizures is critically important and is often made clinically, without EEG (electroencephalography) monitoring. This observational study aimed to determine the accuracy and interobserver reliability of healthcare professionals in distinguishing clinically manifested seizures from other neonatal movements, when presented with clinical histories and digital video recordings only. METHODS: Twenty digital video recordings of paroxysmal movements in term and preterm infants were selected from a video-EEG database. The movements were categorized as seizure and nonseizure using EEG. Health care professionals (n = 137) from eight neonatal intensive care units (NICUs) were shown the video recordings with additional relevant clinical data, excluding EEG findings. The observers were asked to indicate which movements they considered to be seizure or nonseizure. A multirater Kappa statistic was used to assess agreement between observers and with the true diagnosis. RESULTS: Twenty video clips (11 seizure, 9 nonseizure) were evaluated by 91 doctors and 46 other professionals. The average number of correctly identified events was 10/20. Clonic seizures were correctly identified most frequently (range 36.5-95.6% of observers). Subtle seizures were poorly identified (range 20.4-49.6% of observers). The interobserver agreement (Kappa) for doctors and other health care professionals was poor at 0.21 and 0.29, respectively. Agreement with the correct diagnosis was also poor at 0.09 for doctors and -0.02 for other healthcare professionals. DISCUSSION: It is often impossible to accurately differentiate between seizure-related and nonseizure movements in infants using clinical evaluation alone. In addition, doctors do not have a higher capacity for discriminating between neonatal paroxysmal events than other health care professionals. Until reliable continuous neurologic monitoring of newborn babies is available, it is likely that some babies with seizures will remain undetected and others with nonseizure movements will continue to be treated with potentially harmful anticonvulsants.}},
  issn = {1528-1167 (Electronic) 00},
   = {http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve;db=PubMed;dopt=Citation;list_uids=19490044},
  source = {IRIS}
}
AUTHORSMalone, A.,Ryan, C. A.,Fitzgerald, A.,Burgoyne, L.,Connolly, S.,Boylan, G. B.
YEAR2009
MONTHSeptember
JOURNAL_CODEEpilepsia
TITLEInterobserver agreement in neonatal seizure identification.
STATUSValidated
TIMES_CITED()
SEARCH_KEYWORD
VOLUME50
ISSUE9
START_PAGE2097
END_PAGE101
ABSTRACTOBJECTIVES: Accurate diagnosis of neonatal seizures is critically important and is often made clinically, without EEG (electroencephalography) monitoring. This observational study aimed to determine the accuracy and interobserver reliability of healthcare professionals in distinguishing clinically manifested seizures from other neonatal movements, when presented with clinical histories and digital video recordings only. METHODS: Twenty digital video recordings of paroxysmal movements in term and preterm infants were selected from a video-EEG database. The movements were categorized as seizure and nonseizure using EEG. Health care professionals (n = 137) from eight neonatal intensive care units (NICUs) were shown the video recordings with additional relevant clinical data, excluding EEG findings. The observers were asked to indicate which movements they considered to be seizure or nonseizure. A multirater Kappa statistic was used to assess agreement between observers and with the true diagnosis. RESULTS: Twenty video clips (11 seizure, 9 nonseizure) were evaluated by 91 doctors and 46 other professionals. The average number of correctly identified events was 10/20. Clonic seizures were correctly identified most frequently (range 36.5-95.6% of observers). Subtle seizures were poorly identified (range 20.4-49.6% of observers). The interobserver agreement (Kappa) for doctors and other health care professionals was poor at 0.21 and 0.29, respectively. Agreement with the correct diagnosis was also poor at 0.09 for doctors and -0.02 for other healthcare professionals. DISCUSSION: It is often impossible to accurately differentiate between seizure-related and nonseizure movements in infants using clinical evaluation alone. In addition, doctors do not have a higher capacity for discriminating between neonatal paroxysmal events than other health care professionals. Until reliable continuous neurologic monitoring of newborn babies is available, it is likely that some babies with seizures will remain undetected and others with nonseizure movements will continue to be treated with potentially harmful anticonvulsants.
PUBLISHER_LOCATION
ISBN_ISSN1528-1167 (Electronic) 00
EDITION
URLhttp://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve;db=PubMed;dopt=Citation;list_uids=19490044
DOI_LINK
FUNDING_BODY
GRANT_DETAILS