HBM 2005 Abstracts: Previous | Next Click here for a PDF of this poster.


Inter-rater Reproducibility of 3D Cortical and Subcortical Landmark Points
Kristi Boesen1, Stephen Frey3, Jill Huang1, Jurgen Germann3, Joshua Stern1, D. Louis Collins3, Alan C. Evans3, David Rottenberg1,2
1Department of Neurology, University of Minnesota (UM), Minneapolis, USA, 2Department of Radiology, University of Minnesota (UM), Minneapolis, USA,
3McConnell Brain Imaging Centre, Montreal Neurological Institute (MNI), McGill University, Montreal, Quebec, Canada

Table 1. Reproducibility Statistics (mm)
Cortical Points L Median R Median L Mean R Mean
Inferior frontal sulcus 0.97 1.17 1.84 1.90
Occipital pole posterior 0.89 0.96 1.06 1.11
Frontal pole anterior 1.10 1.46 1.38 1.81
Temporal lobe anterior 1.14 1.23 1.49 1.65
Calcarine fissure anterior 1.27 1.25 1.43 1.37
Central sulcus dorsal 0.76 0.72 0.85 0.85
Central sulcus ventral 1.95 2.11 2.52 2.60
Olfactory sulcus rostral 0.85 0.94 1.04 1.06
Sylvian fissure 1.27 1.34 0.32 1.50
Superior temporal sulcus 1.33 1.51 0.58 2.07
Collateral sulcus 1.55 1.87 2.35 2.34
Superior frontal sulcus caudal 1.91 1.67 3.16 2.71
Superior frontal sulcus rostral 6.26 6.64 7.31 7.51
Subcortical Points Median Mean
AC point 0.64 0.82
PC point 0.64 0.69
Lateral ventricle anterior L 0.63 0.68
Lateral ventricle anterior R 0.65 0.75
Lateral ventricle posterior L 0.74 1.78
Lateral ventricle posterior R 0.88 2.82
CC anterior 0.82 0.86
CC posterior 0.86 0.90
CC ventral extent of splenium 0.73 0.76
Thalamus center 0.70 0.75
Abbreviations: L, left; R, right; AC, anterior commissure; PC posterior commissure; CC, corpus callosum.

Objective: Accurate, reproducible landmarking of the cortical surface is difficult due to variability in indivdual patterns of sulcation and gyration, and no previous study has generated cortical landmarks with sufficient inter-rater reproducibility to be useful for the quantitative evaluation of intersubject registration algorithms. Two recent attempts at landmarking employed reconstructed cortical surfaces [1,2] with landmarks based on visible sulcal intersections or visually extrapolated intersections assumed to lie on the adjacent cortical surface. For the two raters in [1] the Euclidean distance between individual and mean landmark positions for 12 x 2 landmarks (12 landmarks per hemisphere) averaged 6.0 mm; intra-rater variability averaged 3.7 mm. Repeatability in [2] based on replicate measurements by a single rater ranged from 0.25 to 1.55 mm. In both studies [1,2] the distribution of landmarks included few landmarks on the parietal and occipital surfaces, and none on the temporal surfaces. In another study [3] 128 x 2 landmarks were defined on ten anatomic reference planes; intra-rater reliability of these points involving a single repeat labeling of each landmark on a single reference brain yielded an RMS error of 1.6 mm.

Methods: Four raters at UM and MNI independently identified 13 x 2 cortical and 10 sub-cortical point landmarks on 37 high-quality1.5T T1-weighted MRI volumes (voxel dimensions 1 x 1 x 1 mm) based on a detailed written protocol. Prior to landmarking MRI volumes were corrected for intensity non-uniformity, intensity normalized, and transformed into unscaled Talairach space [4]. Using REGISTER visualization software (MNI), landmarks were identified by 3D navigation within the MRI volumes and their (x, y, z) coordinates were recorded for subsequent statistical analysis.

To calculate inter-rater reproducibility, we computed the distance from the four raters' points to the centroid of those four points for each landmark/volume combination, yielding 5,328 distances. Protocols for 6 x 2 landmarks were revised, and the resulting 1,776 points were re-labeled. To minimize the effect of possible careless errors, an "outlier index" was computed for each landmark/volume combination: the three distances between a given rater's point and those of the other three raters were averaged and subtracted from the mean of the three distances between the other three raters. Possible outliers were identified based on an outlier index > 2 mm, and raters were asked to re-examine their own outlier points without being told how to adjust them. Of the 433 possible outliers identified, 233 were adjusted leading to a mean improvement of 10.5 mm with respect to the centroid of the other three raters' points.

Results & Discussion: Preliminary reproducibility statistics for the 5,328 distances are listed in Tables 1 and 2. The median distance to centroid for cortical and non-cortical landmark points, respectively, was 1.24 and 0.68 mm.

Conclusions: Our results suggest that a large number of distributed cortical and subcortical landmarks are highly reproducible across raters, sites, and subjects and can serve as well-characterized points of reference for future developmental, neuroanatomical, and disease-related studies as well as goodness-of-warp metrics.

References & Acknowledgements:
1. Maudgil DD, et al. (1998). J. Anat 193:559-571.
2. Free SL, et al. (2001). NeuroImage 13:801-813.
3. Grachev ID, et al. (1999). NeuroImage 9:250-268.
4. Collins DL, et al. (1994). JCAT 18:192-205.

Supported by NIH Grant P20 EB002013.