|
|
||||||||
1From the Orbital Centre, Department of Ophthalmology, and the 3Department of Endocrinology and Metabolism, Academic Medical Centre, University of Amsterdam, Amsterdam, The Netherlands; and the 2Department of Radiology, University Medical Centre, University of Utrecht, Utrecht, The Netherlands.
| Abstract |
|---|
|
|
|---|
METHODS. The authors calculated these volumes with the use of a manual segmentation technique on CT scans with commercially available software. Two observers (one of them masked) calculated the orbital soft tissue volumes in a CT scan of a phantom constructed of dry skull, butter, and chicken muscle. These calculations were compared with previously taken standard volume measurements of these materials. Repetitive calculations on one CT scan by the same observer were compared. Soft tissue volumes taken from 10 orbital CT scans were calculated by two observers and compared. From the data acquired, intraobserver and interobserver variability was calculated.
RESULTS. Outcomes of these calculations using this software approximated the volumes of the phantom measured with standardized techniques. Accuracy of the phantom calculations between the two observers varied from +0.7% to –0.7% for FV and between –1.5% and –2.2% for MV. Mean differences between the repeated calculations were smaller than 5%. The intraclass correlation coefficient varied from 0.961 to 0.999.
CONCLUSIONS. Calculating orbital soft tissue volume using a manual segmentation technique for CT scans is a reliable and accurate tool.
Most investigators calculate orbital volume using software that is either custom built or provided by the CT scanner manufacturer. In the literature,2 different methods such as manual outlining (a technique usually referred to as manual segmentation), computer-assisted segmentation, and computer-assisted border detection are used. However, these techniques have been poorly validated. Ramieri et al.3 used commercially available software (Mimics; Materialise, Louvain, Belgium) to calculate orbital bony volume (OV) and fat volume (FV) in patients with enophthalmia after blow out fractures. Their calculations were comparable to those of other authors, but they did not validate their method.
Mimics (Materialise) software is an image-processing package with three-dimensional (3D) image visualization function that interfaces with all common scanner formats; it is a general purpose segmentation program for gray value images and can process any number of 2D image slices. The software enables the user to control and correct the segmentation of CT data and MRI data. No technical knowledge is needed for creating 3D images on a display screen resulting from computerized reconstructions of medical objects.4 The focus of the Materialise company is to build software for industrial purposes, but for their medical division they developed software for the manufacturing of physical models by means of stereolithography prosthesis manufacturing, dental implant planning and placement, orthopedic and major facial reconstructions after cancer surgery, and reconstructive surgery in case of congenital deformity. Until now, Mimics (Materialise) had not been used for the calculation of extraocular muscle volume (MV).
The purpose of this study was to investigate the usefulness of the Mimics (Materialise) software for the calculation of orbital soft tissue volume by validation of this method and to determine the intraobserver and interobserver variability of the calculations.
| Patients, Materials, and Methods |
|---|
|
|
|---|
Patients
Spiral CT scans of 10 orbits of eight patients with a variety of orbital diseases (e.g., Graves orbitopathy, phthisis bulbi, orbital trauma, choroidal melanoma, optical nerve glioma) were selected randomly from our outpatient clinic; normal orbits were used except for the four orbits of the patients with Graves orbitopathy. The Medical Ethical Commission considered this not subject to consent, and the research adhered to the tenets of the Declaration of Helsinki. CT scans had been obtained in the course of routine clinical care using a multislice spiral CT scanner (Mx8000 IDT; Philips, Eindhoven, The Netherlands). Continuous scanning with a slice thickness of 1.3 mm and a slice increment of 0.7 mm had been applied. Patients were in the supine position, with the scan plane parallel to the plane containing the lines interconnecting the outer external meatus and the lateral eye corner on each side of the head. No gantry tilt was applied. Patients were asked to look at a fixed point. Axial images were burned on a CD-ROM and were loaded into a workstation (XW 4300; Hewlett-Packard, Wilmington, DE) situated in the ophthalmological department and independent of the CT scanner. Mimics (Materialise) version 9.11 was used to calculate the orbital soft tissue volume.4
Measurement Methods
A soft tissue window (grayscale) setting was used to discriminate among orbital muscle, fat, and bone tissue. Orbital soft tissue CT numbers were set at –200 to +100 Hounsfield units (HU) for bony orbital volume, –200 to –30 HU for fat tissue, and –30 to +100 HU for muscle tissue. The optimum threshold was the CT number halfway between the CT numbers of the tissues to be separated. As a result, the tissues of interest were highlighted on the display in specific colors using so-called masks. A mask contained tissue with the chosen CT number in all the slices of the three image stacks and changed color each time a major process, such as region growing or subtraction, was completed. Region growing (computer-assisted separation of different tissues) and manually deleting tissues were used until only the tissue of interest remained. The volume of the 3D reconstruction was expressed in cubic millimeters to two decimals. Three-dimensional visual control of the measurements could be performed at any moment during the measurements. This allowed the observer to visually check the result of the calculations. Instead of outlining the structures of interest in every slice, as most investigators (summarized in Bijlsma et al.2 ) have done, the structures that were not relevant were deleted using a variety of tools. The program showed axial, coronal, and sagittal images on the same display screen (Figs. 1 2l 2m 2n) . Segmentation performed in one image stack automatically appeared in the other two. To get a good result, the observer had to work with all three image stacks. The software calculated the tissue volume by means of voxel addition and reconstructed a 3D image that was displayed on the computer screen.
|
|
Bony orbital volume is measured as follows:
Fat volume is measured as follows:
Extraocular muscle volume is measured as follows:
Phantom Calculations
For the calculations of the FV and MV of the phantom, measurements were obtained by an unmasked observer (NR) and a masked observer (PK). PK was masked for the volume used in the phantom. The accuracy of the volume calculations using manual segmentation and the Mimics (Materialise) software was assessed by comparing the known volumes of the phantom with those calculated by the two observers.
Intraobserver and Interobserver Variability
For intraobserver variability, observer NR calculated the volume of one patient with a normal orbit on 10 consecutive working days. Intraobserver variability was expressed using the coefficient of variation, here calculated as the SD divided by 100x the mean of the measurements, for the percentage x100%.
For interobserver variability, the calculations of two observers were analyzed. NR calculated the FV, MV, and OV, of 10 orbits twice with an interval of 2 to 10 days. Thereafter, the second observer PK performed the same calculations independently on the same orbits.
Statistical Analysis
A statistical computer program (SPSS 12.0.2 for Windows; SPSS Inc., Chicago, IL) was used for statistical analysis. Intraclass correlation coefficients and their 95% confidence intervals were calculated for all parameters to determine the intraobserver and interobserver variability (two-way mixed-effects model; 0 = no agreement, 1 = perfect agreement between measurement occasions or observers). Absolute magnitude of the measurement error between the observers was calculated with the method Bland and Altman.6
| Results |
|---|
|
|
|---|
Intraobserver Variability
For the orbital fat, muscle, and bony volumes of one orbit, observer NR found the respective values of 18.58 ± 0.11 mL (range, 18.38–18.76), 3.03 ± 0.05 mL (range, 2.97–3.10), and 25.17 ± 0.06 mL (range, 25.10–25.24). Mean differences expressed in percentages were 0.6% for FV, 1.65% for MV, and 0.24% for OV. Intraobserver variability of the two calculations on the 10 different orbits was 0.97% for FV (range, 0.2–2.0), 2.6% for MV (range, 0.3–4.0), and 0.98% for OV (range, 0.3–2.7).
Interobserver Variability
Interobserver variability is shown in Table 1 . Note the good agreement between the two observers, though in the Bland and Altman plots, observer PK calculated the OV volume consistently smaller than did observer NR (0.1–0.6 mL; Fig. 3 ). The results of observer PK ameliorated over time (Fig. 2) .
|
|
| Discussion |
|---|
|
|
|---|
Compared with our validation, previous validations were less sophisticated. Other investigators used a variety of calibration materials, such as silicone blocks (Forbes et al.7 8 ) or glass strips (Krahe et al.9 ). Lutzemberger and Salvetti10 used rabbit muscle for their validation, which best resembled the human in vivo situation thus far. We validated the software by constructing a phantom. Given that orbital fat is soft, we chose full cream butter that can be cut in blocks in the solid state after cooling and that is soft at room temperature. Muscles can be inserted in the soft material. The calculations of a masked observer differed minimally from the known volume (fat, 0.7%; muscle, –2.2%).
Mimics (Materialise) is a user-friendly program with a steep learning curve. By using a sequence of colored masks, the observer can always go back to the previous mask in case of a mistake or a computer problem. The 3D reconstructions enable the user to check at any moment the correctness of the segmentations, and there is no need for the user of this program to understand its technical details. Because Mimics (Materialise) can use CD-ROMs or DVDs for loading images, it can process any stack of images and is therefore independent of a scanner. The workstation and the program can be used outside the radiology department.
Because there is no consensus about how to measure orbital soft tissue in patient scans, there is no standard program for comparison. For instance, calculation of the OV requires a cutoff of the bony volume at the orbital aditus. This cutting process results in a larger volume if it is performed with sagittal images rather than axial images. Given that calculations in the literature7 8 9 10 11 are based on axial images, we decided to use axial images as well. It is difficult to separate the tendon of a rectus muscle from the eyeball, so we did not include it and cut the muscle short the moment it touched the eyeball. The most difficult part for the calculation procedure is the superior complex. It is difficult to separate the rectus superior from the levator palpebrae muscle. We chose the trochlea as landmark. Above the trochlea, no superior rectus is present. This seems justified because the bulk of the levator lies behind the cutting point where the rectus superior and the levator touch the eyeball.
Intraobserver/Interobserver Variability
The calculations of fat by the two observers showed great similarity and could detect small changes in FV. OV also showed little difference, but, according to the Bland and Altman plot, the calculated volumes of PK were constantly smaller than the calculated volumes of NR, which meant that the landmarks of the bony orbit were different between the two observers. MV is difficult to calculate. For the measurements of MV and OV, some knowledge of anatomy is necessary. The differences between the two observers were largely attributed to a lack of knowledge of the anatomy of the orbit. In addition, the results of the second observer ameliorated during the course of the experiment, so the measurements were within the target of 5% difference. It is imperative that borders be set and measurements be carried out according to a strict protocol. Intraobserver variability was also tested in repetitive calculations. This was possible because measurements of a stack of images can be deleted completely without any trace.
| Conclusions |
|---|
|
|
|---|
| Acknowledgements |
|---|
| Footnotes |
|---|
Submitted for publication August 9, 2007; revised October 30, 2007; accepted February 29, 2008.
Disclosure: N.I. Regensburg, None; P.H.B. Kok, None; F.W. Zonneveld, None; L. Baldeschi, None; P. Saeed, None; W.M. Wiersinga, None; M.P. Mourits, None
The publication costs of this article were defrayed in part by page charge payment. This article must therefore be marked "advertisement" in accordance with 18 U.S.C.
1734 solely to indicate this fact.
Corresponding author: Noortje I. Regensburg, Orbital Centre, Department of Ophthalmology, Academic Medical Centre, University of Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands; n.i.regensburg{at}amc.uva.nl.
| References |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |