Interrater Reliability of Visually Evaluated High Frequency Oscillations

Publication date: Available online 30 December 2016
Source:Clinical Neurophysiology
Author(s): Aaron M Spring, Daniel J Pittman, Yahya Aghakhani, Jeffrey Jirsch, Neelan Pillay, Luis E Bello-Espinosa, Colin Josephson, Paolo Federico
ObjectiveHigh frequency oscillations (HFOs) and interictal epileptiform discharges (IEDs) have been shown to be markers of epileptogenic regions. However, there is currently no 'gold standard' for identifying HFOs. Accordingly, we aimed to formally characterize the interrater reliability of HFO markings to validate the current practices.MethodsA morphology detector was implemented to detect events (candidate HFOs, lower-threshold events, and distractors) from the intracranial EEG (iEEG) of ten patients. Six electroencephalographers visually evaluated these events for the presence of HFOs and IEDs. Interrater reliability was calculated using pairwise Cohen's Kappa (κ) and intraclass correlation coefficients (ICC).ResultsThe HFO evaluation distributions were significantly different for most pairs of reviewers (p < 0.05; 11/15 pairs). Interrater reliability was poor for HFOs alone (κmean = 0.403; ICC = 0.401) and HFO+IEDs (κmean = 0.568; ICC = 0.570).ConclusionsThe current practice of using two visual reviewers to identify HFOs is prone to bias arising from the poor agreement between reviewers, limiting the extrinsic validity of studies using these markers.SignificanceThe poor interrater reliability underlines the need for a framework to reconcile the important findings of existing studies. The present epoched design is an ideal candidate for the implementation of such a framework.



http://ift.tt/2iMt1RR