HBM 2005 Abstracts: Previous | Next Click here for a PDF of this poster.

Quantitative Evaluation of Surface Extraction Reproducibility
Timothy Jarvis1, Kirt Schaper1, Kelly Rehm2, David Rottenberg1,2
1Department of Neurology, University of Minnesota, USA, 2Department of Radiology, University of Minnesota, USA


Objective: Surface extraction techniques play an increasingly important role in mapping patterns of change in healthy and diseased brains. Surface-based characteristics such as area, volume, gyrification, or cortical thickness may help to quantify changes in the underlying parenchyma. Although previous studies have often employed statistical filtering to identify cortical areas that exhibit a significant amount of change, no systematic attempt has been made to account for the variability introduced by the surface extraction technique itself. This variability can be ignored when the number of subjects is large but poses significant problems for longitudinal studies of single subjects. In such cases large variability precludes the ability to draw conclusions concerning anatomical change. Based on repeat MRI brain scans from the same subject over a period of weeks to months we measured the variability of six cortical extraction techniques by computing the coefficient of variation for a set of surface metrics.

Methods: A set of MRI brain volumes was analyzed for each of two normal subjects. The first set consisted of six T1-weighted volumes acquired on a Phillips 1.5T scanner (1 mm3 voxels). The second consisted of eight T1-weighted MRI volumes acquired on a Siemens 4T scanner (also 1 mm3 voxels). All volumes were non-uniformity corrected using N3 [1], and stripped using BET2 [2]; to ensure consistency all required manual steps were performed by the same person. Surfaces were generated using six different packages: FreeSurfer [3], SurfRelax [4], CLASP [5], BrainVisa [6], BrainVoyager [7], and SureFit [8]. For each package we calculated surface area, surface volume, normalized shape index (SI, the deviation of an object from a sphere), and gyrification index (GI, the inner-to-outer cortical surface area ratio) [9]. Cortical thickness was approximated by the surface separation (SS, the mean of the closest distance from the white surface to the gray surface for each vertex).

Results & Discussion: The coefficients of variation for each surface metric are presented in Table 1, and Figs. 1 and 2. It should be noted that the metrics listed do not refer to the accuracy of a given method, only to its precision. Metrics involving gray surfaces were not computed for BrainVoyager and SureFit; BrainVoyager creates a gray surface for reference purposes only and SureFit only creates a layer 4 mid-cortical surface.


Conclusions: The performance of each surface extraction method varied within and between subjects, although packages tended to perform consistently across most metrics. FreeSurfer performed best overall but also required the greatest amount of manual interaction. BrainVisa tended to have the highest variability, but this may arise from the relatively low number of triangles in the final tessellations.

References & Acknowledgements:
1. Sled, JG. et al. (1998) TMI 17(1):87-97.
2. Smith, SM. (2002) HBM 17:143-155.
3. Dale AM. et al. (1999). NeuroImage 9:179-194.
4. Larsson J. (2001). PhD Thesis. Karolinska Institute.
5. Kim JS, et al. (2004). Submitted to NeuroImage.
6. Cointepas Y. et al. (2001). NeuroImage 13(6):S98.
7. Kriegeskorte N & Goebel R. (2001). NeuroImage 14:329-346.
8. Van Essen DC. et al. (2001). J Am Med Inform Assoc. 8:443-459.
9. Zilles, K. (1988) Anat Embryol 179(2):173-9.

Supported by NIH Grant P20 EB002013.


Table 1: Coefficients of Variance
Subject Method White
Vol.
White
Area
White
SI
Gray
Vol.
Gray
Area
Gray
SI
SS GI
1 FreeSurfer 0.83% 1.60% 0.21% 0.56% 0.67% 0.34% 0.75% 1.28%
SurfRelax 2.03% 3.28% 0.19% 1.02% 0.70% 0.32% 2.79% 1.64%
CLASP 0.70% 1.16% 0.50% 1.98% 0.94% 0.93% 1.05% 3.98%
BrainVisa 1.29% 3.98% 0.70% 2.65% 1.29% 1.75% 2.96% 5.57%
BrainVoyager 0.87% 3.72% 0.87%
SureFit 0.71% 1.97% 0.71%
2 FreeSurfer 1.60% 0.92% 0.70% 1.13% 1.72% 0.39% 2.58% 3.46%
SurfRelax 2.08% 2.56% 0.46% 1.49% 1.83% 0.17% 0.89% 3.33%
CLASP 2.73% 3.35% 0.55% 2.75% 2.74% 1.05% 1.24% 3.73%
BrainVisa 4.14% 5.95% 1.07% 3.63% 3.46% 2.85% 5.99% 3.52%
BrainVoyager 2.93% 3.01% 0.65%
SureFit 2.50% 2.34% 0.74%
BrainVoyager creates a gray surface which is intended to be used for reference purposes only.
SureFit creates only a layer 4 mid-cortical surface.