|
|
||||||||
1 From the Medical Imaging Unit, Department of Physics, Kings College; and the 2 Department of Ophthalmology, St. Thomas Hospital, London, United Kingdom.
| Abstract |
|---|
|
|
|---|
METHODS. Images are analyzed by a set protocol of defining the area of the posterior capsule, removing the Purkinje light reflexes by intensity segmentation, contrast enhancement, filtering to enhance low-density PCO, and variance analysis using a co-occurrence matrix to assess texture. The accuracy of the system was tested for validity and repeatability.
RESULTS. The software developed has been demonstrated to be an objective method of quantifying PCO. In validation tests, the image analysisderived measure of PCO showed good agreement with clinically derived measures of PCO. Clinicians assessed PCO on a computer screen image and also under slit lamp examination (Pearson correlation coefficient for both methods >0.92). The entire acquisition and analysis system was demonstrated to have a confidence limit for 2 SDs of 9.8% for group data.
CONCLUSIONS. This system is capable of producing an accurate and reproducible measure of PCO that is relevant to assessing techniques of PCO prevention.
| Introduction |
|---|
|
|
|---|
Nd:YAG capsulotomy rates have commonly been used as a measure of PCO, but these are a poor method of assessment, because they are subjective and dependent on when the patient asks for treatment and the surgeon offers it, as well as equipment availability and financial factors. Clinical scoring systems depend on the experience of the examiner and are subjective and qualitative.6 7 Retroillumination images can provide an objective way of examining the posterior capsule to give a measurement of PCO. Previous systems had the drawback of being film based, which requires even illumination, consistent processing, and a panel of experienced assessors to grade the image.8 9 This type of system has recently been refined by scanning color photographs into a computer and using a mouse and a graphics software package to manually outline and grade the area of opacity.10
The theoretical advantage of using computer software to analyze images is that observer bias can be reduced and accuracy increased. PCO can take 1 to 3 years before vision is affected. Image analysis offers the potential to shorten the follow-up time for studies of PCO prevention strategies. Retroillumination imaging systems have been used for the assessment of cataract by intensity thresholding, in which the gray scale value of each pixel under scrutiny is used to determine whether it is clear or opaque.11 12 This method requires the change from clear to opaque to be defined individually for each pixel relative to background illumination. It creates problems, in that retroillumination images have inherently uneven backgrounds within and between individuals caused by different degrees of pupil dilation, fundus pigmentation, and uneven reflectance from the retina and optic disc, which have to be compensated for by image manipulation. Intensity thresholding is accurate only when the transition from clear to opaque changes the image from light to dark. Intensity thresholding fails in areas of early lens epithelial proliferation where the image is of intensity similar to that of the clear areas, or in more advanced cases in which the thickness of the opacification causes internal reflection and highlights (Fig. 1) . This, combined with the necessity for correction of the variation in background illumination and the low resolution of some imaging systems, leads to difficulty in accurate assessment of PCO.
|
| Methods |
|---|
|
|
|---|
Image Acquisition
The St. Thomas Hospital digital retroillumination camera system
obtains evenly illuminated images of the posterior capsule through a
dilated pupil and stores the images on computer.13
The
settings in the camera system of flash intensity, beam width, camera
aperture, and shutter speed are fixed and ensure that the exposure is
standardized between patients. A digital camera (model DCS 420; Eastman
Kodak, Rochester, NY) with a chip size of 1024 x 1536 pixels
captures the image. Each pixel contains 8 bits of useful information
with a resolution of 25,000 pixels/mm2. The image
is checked on the monitor to ensure adequate centration and focusing
and is then archived as tagged image files (.tif). Images are
transferred from the clinic for analysis using a file-transfer protocol
(FTP) site on the Internet.
Image Analysis Overview
The software program is based on TRACEE, a dedicated image
analysis program (available at no cost at www.ph.kcl.ac.uk) enhanced
with dedicated modules written for specific procedures.
We define the area of interest as that part of the posterior capsule that is behind the optic of the IOL and is not obscured by the anterior capsule. If the capsule lies off the anterior surface of the implant, then the outer edge of the IOL defines the area. This area is called the mask. All images then undergo a protocol of processing steps with identical parameters for each image, consisting of removal of the Purkinje light reflexes, contrast enhancement, filtering, and texture segmentation. Finally, the co-occurrence matrix is matched to the raw image and the area of opacification converted to binary to provide the percentage of PCO.
Defining the Mask
The mask is defined on a 21-in. monitor using a mouse and a
graphic icon to draw around the area of interest. The mask is
then saved as a general image file (.gif). Figure 2A
shows the raw image of Figure 1
with a mask applied. The area
peripheral to this is eliminated from subsequent calculations. The mask
area is a useful tool that can be used to assess capsular
movement relative to the optic over time or to capsular phimosis or
retraction.
|
Contrast Enhancement
After the area of interest is defined, the image is contrast
enhanced. Instead of applying one particular contrast enhancement
function across the entire image, our technique uses a local
calculation of the mean ± SD over a defined area surrounding each
pixel.18
The function applied to the image is given in equation 1
, in which
w is a square patch area with dimensions of 99 x 99
pixels. The patch surrounds the pixel under operation. The
average intensity within area w is
<f>w, where f is
the value of the pixel intensity that is currently in operation,
w is the SD over area w,
fmin is the minimum intensity value of
the whole image, and fmax is the
maximum intensity value of the whole image.
![]() |
![]() | (1) |
Figure 2C shows the contrast-enhanced image of Figure 2B . It is important to mask the Purkinje reflexes before contrast enhancement to avoid shadowing effects surrounding the bright reflections.
Mean Filtering
Some images contain areas of opacification that have texture
similar to that of the transparent areas. An example of this type of
opacification is shown in the top expanded area of Figure 1
. It is
difficult to identify these areas correctly as transparent or opaque
using co-occurrence segmentation. Filtering was developed to enhance
the texture of these areas of opacity. Figures 3A
and 3B
show an example of a faint opaque and a transparent region from
Figure 1 . The images are shown expanded so that the intensity of the
gray levels and their structure are clearly visible. These show that
although the overall intensity levels of the opaque and transparent
areas are the same, the difference between them is that they are
arranged differently. Pixels in the opaque region with similar gray
levels are more likely to clump into 10 or more in comparison with
those in the transparent region that tend to be more evenly scattered.
|
Quantitative experiments were performed to determine the optimal size and type of the filter. Images were selected with substantial areas of early lens epithelial cell proliferation that produced very thin layers of opacification that the texture segmentation found difficult to classify correctly as opaque. Mean and median filters of various sizes were applied to the contrast-enhanced images before the texture segmentation analysis was performed to identify PCO. The percentage area correctly recognized as opaque in the opaque areas was recorded, and in the transparent areas the percentage area correctly recognized as transparent was recorded similarly. The performance of the system as a whole was summarized as a verdict value, defined as a multiplication of the opaque and transparent percentages, scaled to a maximum performance target of 1.
Consideration of the verdict values showed that a mean filter is optimal in comparison with a median filter, and the optimal filter size of filter was shown to be 3 x 1 pixels. However, this type of filter is asymmetric and may not be appropriate for detecting PCO where there is a strong directional bias (as is the case when there are folds within the capsule). A 4 x 4-pixel filter was consistently close in performance to the 3 x 1-pixel filter and has the advantage of being less directional. It was therefore judged to be the most appropriate. This result was verified by running the filter on a library of images so that a qualitative judgment could be made on whether the filter improved performance of opacification recognition. Compared with the situation in which the image was left unfiltered, the use of a 4 x 4 mean filter greatly improved recognition of opaque and transparent regions.
Texture Segmentation
After these preprocessing steps, the image is classified
into areas of opacity and transparency using a technique known as image
segmentation. An increase in opacification of the posterior capsule is
characterized by an increase in the texture (i.e., structural detail)
of the image. Paplinski and Boyce19
have shown that
texture performs well as a method of detecting opacification.
If the intensity values vary substantially over an area, that area must be textured. A directional variance filter is applied to the image to extract information on its texture. The region from which the local variance is calculated is asymmetric with a defined directionality, and the values within the region are weighted, resulting in a variance filter.
The structure of the filter is derived from the work of Canny20 on optimized edge operators. To create the two-dimensional filter shown in Figure 4 , we initially used a one-dimensional PetrouKittler edge filter. This filter is optimized for the ramp edges that are prevalent in our images. To expand this edge filter to two dimensions, a further gaussian filter is applied in the direction orthogonal to the edges to be detected.
|
![]() | (2) |
is the normalization constant, and the pixel vector
u is specified by its radial and angular components
r and
. The angular spread of the filter is controlled by
the variance parameter c
, and
s(r) represents the form of the PetrouKittler
one-dimensional edge filter. This combination of filters produces the bow-tieshaped filter shown in Figure 4 . The long axis of the bow tie is horizontal, and the values recorded for each pixel in the bow tie are weighted relative to its position. The representation of the filter in Figure 4 shows varying gray scales assigned to the surrounding pixels, which represent the weight of the filter given to each of these pixels. Those pixels marked white have the highest weighting.
Each pair of pixels in the image (marked as pixels 1 and 2 in Fig. 4 ) are assigned two variance values, that of right variance, where the bow-tieshaped filter extends to the right, and that of left variance, where it extends to the left. The two values of variance give information, not only on the texture values surrounding each pixel, but also on the edge values. Values of the variance calculated by applying the filter to the image are represented as a co-occurrence matrix21 that displays the values of variance obtained from the image. Figure 5 shows a typical co-occurrence matrix with a horizontal scale of right variance and a vertical scale for left variance. The largest peak of the co-occurrence matrix (the black region) represents the transparent, low-textured region, whereas the dark gray area represents the wide range of textured regions associated with opaque areas of the posterior capsule. The square root of the matrix shown in Figure 5 has been calculated three times so that the detail of the matrix may be viewed more clearly.
|
Although the gaussian distributions are fitted over the entire surface of the matrix, the leading diagonal is a useful area to analyze to assess the accuracy to which the gaussian distributions have been fitted. Figure 6 shows a graph representing the leading diagonal of the co-occurrence matrix of Figure 5 . The solid line represents the peak within the co-occurrence matrix (shown in black on Fig. 5 ). The dashed peak shows a linear combination of distributions fitted to the original peak. The dotted line running along the bottom of the graph represents the error between the original and gaussian fit and shows a low residual error due to noise and the peak of the co-occurrence matrix not being exactly gaussian in shape.
|
The classes that correspond to the opaque areas of the image are grouped together, and those that correspond to transparent areas are grouped to produce a simple black-and-white classification of the image. Figure 7 shows the final segmentation of Figure 2A . The white area shows the transparent regions of the posterior capsule, the black area shows the opaque regions, and the gray area shows the area outside the mask and the Purkinje light reflexes that are excluded from the analysis. A visual inspection indicates that the segmentation matches both the transparent and opaque regions of the raw image to a high degree of accuracy. The final output of this program is a calculation of the percentage area of opacification based on the number of opaque pixels within the mask area compared with the total number of pixels within the mask area, in the case of Figure 7 giving a value of 64% opacification. Figures 8A and 8B and Figures 9A and 9B demonstrate eyes with less (45%) and more (89%) opacification.
|
|
|
To assess the ability of the computer image analysis system to recognize clinical PCO, two independent experienced and masked clinicians viewed 24 patients on the slit lamp and estimated the percentage PCO on the posterior capsule. The clinical results were compared with the percentage-derived computer segmentation performed later by an independent masked operator.
The validity of the findings of the computer image analysis system in recognizing PCO in the retroillumination images was assessed by three experienced clinicians who independently viewed 30 retroillumination images chosen to represent the complete spectrum of PCO from zero to complete PCO. The images were viewed by the clinicians on a computer monitor and scored for percentage of PCO coverage. Results were compared with the percentage of PCO derived independently by the masked computer operator.
Repeatability of the System
A third data set was used to assess the repeatability of the
entire image acquisition and analysis system, consisting of images of
32 eyes of individual patients taken 1 week apart. The data set
included equal numbers of patients exhibiting mild, moderate, and
severe opacification. Images were taken 1 week apart, because over a
week, the degree of PCO would be unlikely to change but head position,
fixation, pupil dilation, and focus could vary.
Interoperator Reproducibility of the System
A fourth set of 30 images were analyzed by two different operators
under double-masked conditions to assess the interoperator
reproducibility of the image analysis software. Potential
operator-dependent variables are the definition of the mask area and
the final segmentation of the image that is partly operator dependent,
because one of a given set of presented possibilities must be selected.
All the four data sets used in these tests were from separate groups of patients. Except for the slit lamp validation set, in which two of the patients had both eyes photographed, all other patients in the four data sets had just one eye photographed. The age of the patients in all four data sets ranged from 50 to 80 years.
Statistics
All the data were analyzed using commercial software (Excel;
Microsoft, Redmond, WA). The Pearson correlation coefficient
(r) was calculated to test the validation and the
repeatability of the system. The BlandAltman23
method of
assessing agreement between two methods of clinical measurement was
used to analyze repeatability.
| Results |
|---|
|
|
|---|
|
|
|
|
| Discussion |
|---|
|
|
|---|
Nd:YAG laser capsulotomy rates have been used in many studies to compare the influence of various factors on PCO. These are subjective and also only give an indication of opacification that affects vision. It usually takes several years for PCO to develop to such a degree after surgery means that long-term follow-up is required before the influence of factors on PCO is known. Many attempts have therefore been made to provide a more objective method of assessment. Apart from one technique that relies on backscattering of light,24 these have all used retroillumination imaging of the posterior capsule.10 11 12 For image analysis the raw image must be of the highest quality possible with high resolution, correct exposure, focus, and even illumination, because the analysis cannot compensate for information that is not present. Our system has been purposely designed to meet these criteria. Direct image acquisition allows image quality to be checked immediately, and the system has a resolution of 25,000 pixels/mm2.
The analysis of retroillumination images presents unique problems: They are of low contrast, with complex features and indistinct and incomplete boundaries. A simple overlay grid scoring system25 has been used. A more sophisticated system uses computer graphics to outline areas of opacity on color images.10 This, however, relies on a skilled operator to outline the areas of opacity that can have complex honeycomb features (Fig. 1) . Intensity thresholding is a simple image analysis technique that requires each pixel in the image to be assigned a gray-scale value. This is compared with a baseline measurement, and pixels darker than this threshold are defined as opaque. This method has been used successfully in the Oxford Cataract Camera (Marcher Enterprises, Hereford, UK) and the Nidek Anterior Segment Analyser (Nidek, Gamagori, Japan) to quantify cataract. We have tried this technique to measure PCO and have found that it has serious inherent problems. Pixel intensity depends on the degree of illumination that itself is dependent on such variables as pupillary dilation, fundus pigmentation, or artifacts from fixation off the visual axis so that substantial variations can occur across an image or between consecutive images. Measurement of opacification requires the definition of the threshold at which the change from clear to opaque occurs, and small changes in this can cause wide variations. A method using software to compensate for changes in illumination has recently been described.12 However, many images also contain areas of PCO with intensity values of levels similar to that in clear areas, or images may have brighter values than clear areas due to reflection of light within the thickness of the lens epithelial cell membrane (Fig. 1) . Intensity thresholding cannot deal, by definition, with these situations.
These problems are resolved by using measures of texture for the analysis that are independent of illumination. Texture is a measure of the variation of intensity between a given pixel and its adjacent files. Opacification is characterized by an increase in texture, whereas clear areas are featureless. This article has shown that this works well in clinical practice. The major disadvantage is that the software programs for this system are sophisticated and require considerable computing capacity. However, despite the computing capacity required, the system is reasonably fast and simple to operate. The image analysis procedure requires operator input for approximately 2 minutes with a processing time of approximately 3 minutes, so that an image can be analyzed in approximately 5 minutes. The program runs on a workstation (02 1200MHz; Silicon Graphics, Mountain View, CA) under a UNIX environment. An operator can be trained to use the system in 2 to 3 weeks. Approximately 2 to 3 weeks training is also required for training the photographer to obtain high-quality retroillumination images, but once this is accomplished, images are acquired in less than 5 minutes.
We found a high degree of correlation between experienced clinicians viewing PCO on the slit lamp or the contrast-enhanced image and the area of PCO derived by the software program. The human eye is extremely good at detecting PCO, especially when the image can be viewed on a computer monitor at leisure, and the contrast enhancement program makes areas of flat plaquelike PCO more apparent. When the capsule is either totally clear or opaque there is, of course, no difficulty in establishing the percentage opacification clinically, but it becomes more difficult and subjective to do this clinically at intermediate percentages when there are complex patterns of lens epithelial cell growth (Fig. 2C) .
A major variability in imaging is pupillary dilation. We therefore tested the reproducibility of our system by imaging of the same eye 1 week later, PCO being unlikely to alter in this time, and found an excellent correlation between the first and second images (r = 0.99). In another series of images, interoperator variability was shown to be low. Using the BlandAltman23 method of assessing reproducibility there was a confidence limit for 2 SDs of 9.8% for group data on 32 eyes.
Our system has a shallow depth of focus, but any opacity within the focal range will contribute to the retroillumination image. In practice, anterior vitreous opacity does not appear to cause much artifact, but it is important to exclude any patients with severe vitreous or corneal opacity from PCO studies. A major problem with our system is that the Purkinje reflexes lie centrally in the image. Because we use axial illumination, and they are of high intensity, they cannot be removed by polarized filters. We remove them by image processing, and data are lost in these areas. This is an area that we are currently working to improve. Another problem is the definition of the area of PCO to be studied. In this study we defined the posterior capsule as that area lying inside the rhexis or the edge of the lens optic if the rhexis lay off the implant. This has the advantage that early PCO can be detected because it begins in the peripheral areas. Other investigators have used an area centered on the visual axis defined by using either the intraocular lens edge or pupil margin. All these methods have potential pitfalls as the rhexis size can increase or decrease after surgery, the lens can tilt or decenter, or the pupil may dilate unevenly. Our software has the potential to define a mask based on any of these parameters, and the most suitable can be chosen for a particular study.
Our current program provides an overall percentage of the area of the posterior capsule that is opaque, and this has been a useful tool in investigating various strategies to limit PCO. Ideally, it would be helpful also to have some measure of the severity of PCO, because it is possible to have a thin lens epithelial membrane that covers most of the surface of the posterior capsule and the visual axis without affecting vision. High-percentage opacification measurements do not necessarily correlate with visual function. Visual degradation of the image is produced by forward light scattering into the eye, and areas of PCO that appear to be severe or dense on clinical examination may in fact be less visually damaging than apparently less dense areas, because they attenuate rather than scatter light. We believe therefore, that measurements of PCO severity are misleading unless they are correlated to changes in visual function.
In conclusion, the software described in this article provides an objective and reproducible method to quantify PCO and should prove useful in the investigation of strategies to limit this important complication of cataract surgery.
| Acknowledgements |
|---|
| Footnotes |
|---|
Submitted for publication November 15, 1999; revised March 15 and June 6, 2000; accepted June 9, 2000.
Commercial relationships policy: C (DJS, JFB); N (all others).
Corresponding author: David J. Spalton, St. Thomas Hospital, Lambeth Palace Road, London SE1 7EH, UK.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
N Lois, R Dawson, J Townend, A D McKinnon, G C Smith, R v. Hof, N Van Rooijen, and J V Forrester Effect of short-term macrophage depletion in the development of posterior capsule opacification in rodents Br. J. Ophthalmol., November 1, 2008; 92(11): 1528 - 1533. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Grewal, R. Jain, G. S. Brar, and S. P. S. Grewal Pentacam Tomograms: A Novel Method for Quantification of Posterior Capsule Opacification Invest. Ophthalmol. Vis. Sci., May 1, 2008; 49(5): 2004 - 2008. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Moreno-Montanes, A. Alvarez, and M. J. Maldonado Objective Quantification of Posterior Capsule Opacification after Cataract Surgery, with Optical Coherence Tomography Invest. Ophthalmol. Vis. Sci., November 1, 2005; 46(11): 3999 - 4006. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. R. Meacock, D. J. Spalton, J. Boyce, and J. Marshall The Effect of Posterior Capsule Opacification on Visual Function Invest. Ophthalmol. Vis. Sci., November 1, 2003; 44(11): 4665 - 4669. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. Findl, W. Buehl, H. Siegl, and A. Pinz Removal of Reflections in the Photographic Assessment of PCO by Fusion of Digital Retroillumination Images Invest. Ophthalmol. Vis. Sci., January 1, 2003; 44(1): 275 - 280. [Abstract] [Full Text] [PDF] |
||||
![]() |
T M Aslam, B Dhillon, N Werghi, A Taguri, and A Wadood Systems of analysis of posterior capsule opacification Br. J. Ophthalmol., October 1, 2002; 86(10): 1181 - 1186. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |