|
|
||||||||
1From the Department of Optometry and Visual Science, City University, Northampton Square, London, United Kingdom; 2Department of Ophthalmology, St. Marys Hospital, London, United Kingdom; the 3Departments of Physics and 8Bioengineering, Imperial College London, London, United Kingdom; 4Department of Ophthalmology, Western Eye Hospital, London, United Kingdom; the 5Division of Pediatric Ophthalmology, The Childrens Hospital of Philadelphia, Philadelphia, Pennsylvania; 6Scheie Eye Institute, University of Pennsylvania Health System, Philadelphia, Pennsylvania; and 7Department of Surgery, Alberta Childrens Hospital, Calgary, Alberta, Canada.
| Abstract |
|---|
|
|
|---|
METHODS. The Computer-Aided Image Analysis of the Retina (CAIAR) program was developed to enable semiautomatic detection of retinal vasculature and measurement of vessel tortuosity and width from digital images. CAIAR was tested for accuracy and reproducibility of tortuosity and width measurements by using computer-generated vessel–like lines of known frequency, amplitude, and width. CAIAR was then tested by using clinical digital retinal images for correlation of vessel tortuosity and width readings compared with expert ophthalmologist grading.
RESULTS. When applied to 16 computer-generated sinusoidal vessels, the tortuosity measured by CAIAR correlated very well with the known values. Width measures also increased as expected. When the CAIAR readings were compared with five expert ophthalmologists grading of 75 vessels on 10 retinal images, moderate correlation was found in 10 of the 14 tortuosity output calculations (Spearman
= 0.618–0.673). Width was less well correlated (
= 0.415).
CONCLUSIONS. The measures of tortuosity and width in CAIAR were validated using sequential model vessel analysis. On comparison of CAIAR output with assessments made by expert ophthalmologists, CAIAR correlates moderately with tortuosity grades, but less well with width grades. CAIAR offers the opportunity to develop an automated image analysis system for detecting the vascular changes at the posterior pole, which are becoming increasingly important in diagnosing treatable ROP.
Retinovascular diseases are established candidates for this line of study, and diabetic retinopathy has been a focus of interest in the development of image analysis tools. A niche also exists for an automated technique for assessing the retina of the pediatric age group in infants at risk of retinopathy of prematurity (ROP).
ROP is categorized by zone and stage and by the presence of plus disease. Plus disease is an indicator of ROP severity and may present a constellation of signs including retinal arterial tortuosity and venous dilation at the posterior pole, vitreous haze, and iris rigidity. Plus disease is difficult to quantify, since the diagnosis is based on a 20-year-old reference photograph.1 A reference photograph with less severe changes than that included in the International Classification of ROP (ICROP)1 was used for treatment trials including the Multicenter Trial of Cryotherapy for ROP (CRYO-ROP)2 and the Early Treatment of ROP randomized trial (ETROP).3 Preplus disease, described as vascular abnormalities at the posterior pole that are insufficient to diagnose plus disease but that demonstrate more arterial tortuosity and venous dilation than normal, was added to the classification of ROP in 2005.4 The diagnostic challenge that this disease presents is illustrated by the lack of interobserver repeatability of disease presence and absence by a panel of expert readers.5 6
To overcome the inherent inaccuracies in qualitative evaluation, several groups are exploring the use of automated techniques.7 8 9 10 11 Various methods have been applied to retinal images, all of which use image segmentation to detect various parameters of the image automatically. Trials have been conducted on techniques of retinal image segmentation to localize retinal blood vessels for quantification such as vessel tracking, neural networking, and morphologic processing.12 Imaging the retina in premature infants is considerably more challenging than in adult subjects. Factors such as cloudy media, small pupils, uneven illumination from an annular light source, and difficulty in examining an extremely preterm infant combine to limit the quality of the images obtained. Studies specifically aimed at analysis of the preterm retina have provided promising methods of vessel analysis,7 8 9 10 11 yet none has advanced to the stage that it can be used as a reliable clinical tool.
One example of such vessel analysis software is Retinal Image multiScale Analysis (RISA), which is a method of blood vessel segmentation based on the scale space analysis of the first and second derivative of the intensity image, which gives information about its topology and overcomes the problem of variation in contrast in preterm infant retinal images.13
The ability to quantify the parameters of increasing vascular width and tortuosity specific to the development of plus disease of ROP has been proven with RISA.9 10 13 Other similar software with slightly different methods of vessel localization and alternate methods for calculating tortuosity and width have been used to study the vasculature parameter changes and have shown them to be quantifiable.7 8 14
In this study, the performance of a novel computer analysis program, Computer-Aided Image Analysis of the Retina (CAIAR) (Ng et al., manuscript submitted) is assessed. It semiautomatically identifies the retinal vessels, with provision for human pixel editing if any vessels are inappropriately represented by CAIAR. It subsequently automatically measures the width and tortuosity of each vessel found. Segmentation of the digital image to localize arteries and veins is achieved using filtered detection measurements based on maximum likelihood estimation of vessel parameters from an image.
We have studied the accuracy of CAIAR vessel width and tortuosity determined by CAIAR in two ways: by providing the program with computer-generated sinusoidal model vessels of known width and both frequency and amplitude of tortuosity and by using digital images obtained from preterm infants who have had width and tortuosity of peripapillary vessels graded by experts.
| Methods |
|---|
|
|
|---|
Program for Vessel Analysis of Digital Images
Vessel Localization.
CAIAR computer software is under development at Imperial College London. The vessel-detection system is based on maximum likelihood model-fitting in a scale space framework. It employs filters that are sensitive to image structures at four different scales and models that are fitted to the filter outputs, to estimate the most likely vessel configuration. The estimated model of Gaussian profile, with parameters of height, width, and orientation are computed at each location in the image as illustrated in Figure 1 . Finally, a verification stage is performed by measuring the contrast in a cross section perpendicular to the direction of the vessel and checking that the maximum contrast to the background is in the center of the proposed vessel. This measurement is obtained by using an isotropic second derivative of a Gaussian filter.
|
l) from the division of the segment into two subsegments and calculating the increase in total chord length from one level of subdivision to another. Each of these two measures can be normalized, either by the chord length or the square of the chord length. Finally, we investigated the use of the maximum, mean, and sum of the normalized measures to give a total of 12 estimates of overall tortuosity. We also investigate two of the most promising formulas for tortuosity measures as proposed by Hart,15 giving a total of 14 methods of calculating tortuosity.
|
Testing CAIAR Tortuosity and Width Measurements Using Model Vessels
The effectiveness of CAIAR was first tested on a series of model vessels computer generated by a program written in Java. The program generates a 246 x 246-pixel image of a 1-pixel-wide sinusoidal line by plotting the following formula for 20 < x > 226:
![]() |
Tortuosity.
Modeled vessels of a frequency of 5, 10, and 20 pixels and amplitude of 2, 4, 6, and 8 pixels were created in all possible combinations.
Width.
Width measurements were assessed directly from model straight vessels of widths from 1 to 10 pixels.
Both tortuosity and width vessel model images were analyzed by CAIAR, and the outcomes of 14 CAIAR tortuosity measurements and 2 CAIAR width measurements were analyzed.
Validation of Tortuosity and Width Measurements of Vessels on Clinical Digital Retinal Images by CAIAR
Digital retinal images obtained with a digital fundus camera (RetCam 130; Clarity Medical Systems Inc., Pleasanton, CA) during routine screening for ROP at St. Marys Hospital (London, UK) and Albertas Childrens Hospital (Calgary, Alberta, Canada) were analyzed. Ten images were selected with a fair representation of wide and narrow, tortuous and straight vessels. The images were of adequate contrast quality for CAIAR analysis and visualization of the main artery and main vein in at least 3 quadrants was necessary for inclusion. Figures 3A and 3B illustrate the diversity of vascular width and tortuosity in infants with and without ROP. Each image was cropped to 60° to prevent bias from viewing peripheral ROP changes (Fig. 4A) .
|
|
These 10 images were also graded by five expert ophthalmologists who regularly undertake ROP screening in ward rounds and have published papers on ROP. They each graded one vein and one artery from each quadrant of each image for tortuosity and width on an 11-point Likert scale (0–10).
The results of CAIAR software and the assessments by the experts were then compared for tortuosity and width of each artery and each vein on each of the 10 images, to validate the CAIAR values in a clinical setting.
Statistical Analysis
The frequency, amplitude, and width of model vessels were correlated to CAIAR output using the Spearman rank correlation test (
). The vessel width and tortuosity estimates obtained using CAIAR to analyze digital fundus images were rank correlated with the average grading by experts also using Spearmans
.
| Results |
|---|
|
|
|---|
|
|
|
|
The tortuosity result for each of the eight vessels, as designated by the expert graders, is illustrated superimposed on the original image in Figures 4C , and Figure 4D shows superimposed CAIAR tortuosity results. At this point, the vessel analysis program does not distinguish between arteries and veins and may pick up more or fewer than two vessels per quadrant. This analysis can be edited manually to allow no more than two vessels to be analyzed per quadrant.
Table 2 shows the correlations for tortuosity with grades from experts in ROP. All were statistically significant (P < 0.0001), ranging from
= 0.492 for T14 to
= 0.673 for calculation T9.
|
= –0.113, P < 0.334). However, the LoG output which is based solely on image contrast rather than any geometric property, reveals a moderate but statistically significant correlation with width grades from the experts (
= 0.415, P < 0.0001). | Discussion |
|---|
|
|
|---|
We have also demonstrated that tortuosity can be measured automatically from digital retinal images by using CAIAR, and from the model it can be extrapolated that it can be measured across a wide range of amplitudes and frequencies. With CAIAR, it is possible to detect small changes in frequency and amplitude, and 10 of the 14 tortuosity measures tested correlate well with the clinicians grading.
Image capture in preterm infants is a challenge in itself. Undoubtedly, not all images acquired by the fundus camera (RetCam 130; Clarity Medical Systems Inc.) are of adequate quality for analysis. In routine practice, we have adopted a five-image protocol in which the first image has the optic disc at its center. (This image is used as a baseline for image quality with respect to focusing and illumination.) When this image has been obtained, the remaining four peripheral images are captured.16 In our experience, it is rare not to have an adequate posterior pole image from both eyes of each infant screened. The incidence of poor-quality images is far higher when viewing the peripheral retina.
Width changes are difficult to detect accurately on digital images with automated systems, since width estimates are sensitive to the imaging process and are likely to be more affected by poor image quality—an inherent problem when imaging premature infants—than are tortuosity measures. A 10% change in width is more difficult to detect than a similar change in tortuosity. Width changes measured by CAIAR and compared with expert grader readings correlate very poorly. This may be the result of image-quality limitations, or could be due to shortcomings in the observer grading system. As it is challenging for a computer program to distinguish the accuracy of vessel width, so it may also be challenging for the human eye to be sensitive to such small changes. As there is no gold standard for plus disease assessment, inaccuracies are also likely to develop in assessing a new grading system.17 Chapman et al.18 compared the sensitivity of various methods of measuring retinal width. They found the sliding linear regression filter to be more accurate, compared to Gaussian profile fitting. They also tested a standard edge detection algorithm, which was the least accurate.
Images captured by the another fundus camera (NM200D; Nidek, Inc., Aichi, Japan) were analyzed with vascular imaging semiautomated software (VesselMap; Imedos, Jena, Germany), to estimate retinal vessel diameter to a level sufficient to observe a significant increase in retinal vein diameter with plus disease compared to that without plus disease.19 The vascular imaging software has also shown a significant decrease in retinal vein and artery diameters after laser treatment of ROP.20 The increased resolution of the NM200D images (Nidek) may explain the success of this system; however, the dichotomous detection found to be significant in these papers is somewhat less challenging than the grading system we are developing with CAIAR.
CAIAR tortuosity readings T1–6 correlate well with increasing amplitude and frequency of computer-generated lines with perfect rank correlation. As these parameters are suggestive of increasing tortuosity, it may be expected that these same six tortuosity readings would give the best correlations with expert clinical grading. Indeed, the results of T1–6 show good correlation with clinical grading, yet T7–12 also have good correlation, with T9 having the highest correlation. This finding suggests that the ophthalmologists notion of tortuosity is not based solely on regular amplitude and frequency changes. The computer generated vessels analyzed were all uniform in their sinusoids; however, retinal vessels are not so well proportioned. The somewhat unexpectedly higher results for the formulas less well correlated by model vessel analysis (Tables 1 2) may be in part explained by a higher level of processing by a human observer enabling more complex judgment of less uniform vessels than the computerized system. These results also suggest that T7–12 equations are closer to the human perception of tortuosity—a far-from-defined entity. These equations are all based on segment-wise tortuosity measures compared with the level-wise measures of T1–6. The significance of the segment-wise derivations is that they use the local increase in total chord length from one segment into two, as opposed to the total increase in chord length from one level to another to approximate tortuosity, which appears to be more akin to the ophthalmologists conception of tortuosity (see the Appendix).
The tortuosity indices derived from the formulas of Hart et al.15 (T13 and T14) are less well correlated with both model vessel output and clinical expert grades than are T1–12. The published high receiver operating curve characteristics of these formulas to clinical judgment may have been artificially high, because the vessels were only assessed as a dichotomy: tortuous and nontortuous. The more robust testing of their formulas on our finer scale suggests that it is less well suited to clinical tortuosity grading than is T1–12.
The problem of defining tortuosity is not a trivial one. We have found more than six mathematical definitions of tortuosity in the literature, all giving slightly different results for different controlled examples of tortuosity (e.g., sinusoidal, helical, and random). The algorithm has been expanded to calculate all the different mathematical derivations, but there is not yet agreement about what experts mean by tortuosity and hence no way to decide which of many measures fit best with the experts evaluations.
Although the diagnosis of plus disease is currently challenging, its importance as realized in the ETROP randomized trial cannot be ignored, and the present results suggest that these vascular changes are now important in grading ROP and are a major factor in decisions about ROP treatment.3 Unlike the peripheral ROP lesions, which require indirect ophthalmoscopy, the changes in plus disease, because they occur in the posterior pole region, are easier to detect by alternative examination techniques including digital imaging. The vascular changes located at the posterior pole therefore offer great hope of a grading tool that would enable grading to be performed uniformly and reproducibly and facilitate staging remotely by a nonophthalmologist, thereby opening up realistic screening programs, even in those areas where ophthalmic expertise is limited. It has already been shown that nonophthalmologists can successfully acquire digital images adequate for use in a screening program.21 22
Other analysis tools have been used with digital images to quantify and grade plus disease in infants at risk for ROP. The output from RISA has been tested in two previous reports.9 10 One showed a trend for increasing venous and arterial width and significant increase in arterial tortuosity with increasingly severe ROP.9 The other showed a significant increase in arterial and venous tortuosity and width in images with plus disease compared with those without plus disease.10 Vessel width has also been shown to be increased by 15% in plus compared to no plus images using vascular analysis software (VesselMap; Imedos), a less automated system developed purely for width measurement.19
ROPtool, developed in the Duke Eye Center (Durham, NC), uses centerline extraction to model tubular objects on an image and thereby to localize and quantify retinal vasculature in preterm infants. Wallace et al.,7 using this method, report a 95% sensitivity and 78% specificity for diagnosing tortuosity significant for plus disease compared with two expert readers assessments.
A difference in the tortuosity (1.125 vs. 1.097, significant at 95% level) and width (96.8 vs. 86.4, significant at 99% level) measurements have also been illustrated between those infants who did and those who did not require treatment for ROP, according to a semiautomated program developed in Dublin.8 The segmentation technique for localization of vasculature in this program involves morphologic processing to emphasize linear structures, a second derivative operator that helps define thin structures, and a final morphologic filtering stage.8
Another group based in Thailand has developed an algorithm specifically for RetCam130 images (Clarity Medical Systems, Inc.). The program uses a statistically optimized LoG filter for image edge detection, followed by medial axis skeletonization and Otsus thresholding algorithm for production of a binary image. The resultant image is then pruned and undergoes iterative spur removal.11
The ability of observers to discern clinically relevant increments in blood vessel diameter and tortuosity is considerable.23 However, agreeing on the presence or absence of plus disease provides a greater challenge.5 This is probably at least in part because there is no gold standard for plus disease measurement, and when a "fuzzy gold standard" is used, test accuracy can be greatly affected.17 With advancing digital imaging techniques it has been possible to quantify the changes of vessel width and tortuosity associated with various parameters of ROP.7 8 9 10 19 Unlike current subjective clinical standards based on comparison with an image, automatic image analysis of vascular tortuosity could provide a more ideal reproducible, objective, and standardized way of grading ROP. Automated screening tools could also enable a swift advancement in the possibilities of ophthalmic telemedicine and remote monitoring and grading. ROP has already been proven a suitable disease for telemedicine applications.24 Further research applications of CAIAR and other retinal vessel analysis tools would be in studying retinal vessel changes in animal models of ROP. This has been successfully used to investigate the potential of rod photoreceptor function in predicting the blood vessel abnormalities in ROP.24 This study demonstrates the feasibility of the CAIAR analytic software in grading the tortuosity and width of model vessels and demonstrates correlation of CAIAR measurements to expert grading of actual images of infants at risk for ROP, leading toward a simple clinical tool for diagnosing plus disease of ROP within the foreseeable future.
| Appendix 1 |
|---|
|
|
|---|
![]() |
The total chord length at each level or step of subdivision over the whole vessel (e.g., 1, 2, 4, 8 segments), is given by
![]() |
The tortuosity across the whole vessel caused by the increasing levels of subdivision is given by
![]() |
Finally, the two measures are either normalized by the chord length(s) or the square of the (sum of) the chord length(s).
During subdivision of a segment, the subsegments with chord lengths that are less than 4 pixels are rejected, and further subdivision is stopped for that subsegment. At the end of the subdivision process, there are N subsegments and M layers. We derived 12 different measures of overall vessel tortuosity, as follows:
We also provide two of Harts best-performing tortuosity measurements15 as a comparison,
![]() |
![]() |
![]() |
|
| Footnotes |
|---|
Submitted for publication October 19, 2007; revised January 4 and February 8, 2008; accepted June 19, 2008.
Disclosure: C.M. Wilson, None; K.D. Cocker, None; M.J. Moseley, None; C. Paterson, None; S.T. Clay, None; W.E. Schulenburg, None; M.D. Mills, None; A.L. Ells, Clarity Medical Systems (C); K.H. Parker, None; G.E. Quinn, None; A.R. Fielder, None; J. Ng, None
The publication costs of this article were defrayed in part by page charge payment. This article must therefore be marked "advertisement" in accordance with 18 U.S.C.
1734 solely to indicate this fact.
Corresponding author: Clare M. Wilson, Department of Optometry and Visual Science, City University, Northampton Square, London EC1V OHB, United Kingdom; clarewil25{at}yahoo.com.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
D. K. Wallace, M. El-Dairi, and S. F. Freedman Technological Advances in Pediatric Eye Care Arch Ophthalmol, June 1, 2009; 127(6): 805 - 806. [Full Text] [PDF] |
||||
![]() |
C. G. Owen, A. R. Rudnicka, R. Mullen, S. A. Barman, D. Monekosso, P. H. Whincup, J. Ng, and C. Paterson Measuring Retinal Vessel Tortuosity in 10-Year-Old Children: Validation of the Computer-Assisted Image Analysis of the Retina (CAIAR) Program Invest. Ophthalmol. Vis. Sci., May 1, 2009; 50(5): 2004 - 2010. [Abstract] [Full Text] [PDF] |
||||
![]() |
C Dhaliwal, E Wright, C Graham, N McIntosh, and B W Fleck Wide-field digital retinal imaging versus binocular indirect ophthalmoscopy for retinopathy of prematurity screening: a two-observer prospective, randomised comparison Br J Ophthalmol, March 1, 2009; 93(3): 355 - 359. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. R. Fielder, P. L. Hildebrand, A. Ells, B. Lorenz, M. T. Trese, A. Capone Jr, R. A. Gordon, C. Wilson, B. W. Fleck, and M. F. Chiang Systematic Review of Digital Imaging Screening Strategies for Retinopathy of Prematurity Pediatrics, February 1, 2009; 123(2): e360 - e361. [Full Text] [PDF] |
||||
![]() |
B. W. Fleck and N. McIntosh Retinopathy of Prematurity: Recent Developments NeoReviews, January 1, 2009; 10(1): e20 - e30. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |