|
|
||||||||
From the Department of Ophthalmology, Herlev Hospital, University of Copenhagen, Copenhagen, Denmark.
| Abstract |
|---|
|
|
|---|
METHODS. Forty-degree stereo fundus photographs of the macular field, and RTA scans in 99 eyes of 53 diabetic patients were compared in both location and area of retinal thickening. The deviation in retinal thickness on RTA from the mean retinal thickness ±2 SD in healthy controls was mapped in a spreadsheet and printed, assuming the same size as the grid with the subjectively assessed retinal thickening. Location was evaluated as retinal thickening being present or absent in nine subfields. Area was one of four categories: No retinal thickening, <1 disc area (DA), <2 DA, or <3 DA. Statistics:
-statistic.
RESULTS. Exact agreement on location was found in 632 of 891 observations (70.9%).
= 0.17 (95% CI: 0.080.25). Pooling observations for subfields 2 to 5 (inner circle), and 6 to 9 (outer circle) showed exact agreement = 75.8% and
= 0.10 (95% CI: 0.060.25) and exact agreement = 65.2% and
= 0.24 (95% CI: 0.130.34), respectively. Twelve eyes, in which both methods assessed the same amount of retinal thickening, showed no agreement on location, and were compared only on location of retinal thickening. Exact agreement on area was found in 44 of 87 (50.6%) eyes. Weighted Kappa = 0.34 (95% CI: 0.230.45).
CONCLUSIONS. The degree of agreement between subjectively (with stereo fundus photographs) and objectively (with RTA) assessed location and area of retinal thickening was poor, and fair, respectively.
| Methods |
|---|
|
|
|---|
Two eyes were diagnosed on fundus examination with CSME meeting the ETDRS criteria of retinal thickening
500 µm from the center of the fovea.2 Two eyes had previously had focal laser photocoagulation for CSME, and both eyes were clinically assessed as still having retinal thickening. The remaining eyes were diagnosed on fundus examination with nonclinically significant macular edema (defined as retinal thickening present at or within 2 disc diameters (DD) from the fovea, but not meeting the criteria of CSME, n = 85), or with no definite retinal thickening (n = 10).
The control group consisted of 51 eyes (27 right eyes and 24 left eyes) of 30 healthy controls; mean age, 48.4 years (range, 2175 years); female/male ratio, 15/15.
Stereo Fundus Photography
ETDRS 7-standard 40° field stereo fundus photographs were obtained in all patients with a Canon CF 60 UVi fundus camera by a photographer certified for stereo fundus photography with this camera by the Fundus Photography Reading Center, University of Wisconsin, Madison, WI. Photographs in which sufficient stereo effect, clarity, and correct positioning had not been obtained (because of poor patient cooperation, excessive tearing, poorly dilated pupils, or unclear media) led to exclusion.
The stereo color slides were mounted in transparent slide holders in stereo pairs, and retinal thickening was evaluated in ETDRS-standard field 2 (centered on the macula) of each photograph set. Retinal thickening was evaluated with a stereo viewer and assessed with respect to area and location of retinal thickening by the author (CS). These assessments were drawn on transparent maps, one map for each eye. For improving the assessment of the retinal thickening in the fundus photos, a detailed grid (Fig. 1) , calibrated for 40° fundus photographs was used (kindly provided by the Fundus Photography Reading Center).
|
Comparison of Location of Retinal Thickening
The transparent subjectively assessed retinal thickening maps were compared to the RTA deviation map, and the area or areas definitely thickened on RTA were added to the transparent map. For the purpose of analyzing the degree of agreement on location of retinal thickening, the fundus was divided into 9 subfields as shown in Figure 2 and as previously described by several authors.13 14 15 16
|
Reproducibility of the RTA in one subfield of repeated scans showed a coefficient of variance of 9.3%, approximately 1520 µm, which was within the same range as findings of other authors.4 17 18 The highest accuracy of the assessment is obtained after correction for the refractive power of the eye, compared to the axial length. This analysis feature was not available in the current analysis version of the RTA, and as all eyes included were within ± 4.0 diopters, the effect of the correction of optical power and axial length would be of marginally importance. An updated analysis version of the RTA has become commercially available, since the analysis of these data. Test samples run with the new software version 3.2, analysis version 7.2, on the present study material and control group showed quantitatively differences between the two analysis versions from 5 to 10 µm. Qualitatively, no differences were found.
Comparison of Objective and Subjective Methods
Comparison between an objective and a subjective method presents some problems. A major advantage of the RTA is the systematic procedurecovering the posterior polewith equal distances between the measuring points, yielding a large number of calculated values. In this study, deviation of retinal thickness from healthy controls was used to assess areas with definite retinal thickening, rather than assessing the exact retinal thickness in the study eyes, and hereby allowing for a comparison to stereo fundus photography. Thus the numerical data of the exact retinal thickness was converted into categorical data, that is, exceeding the retinal thickness of healthy controls +2 SD or not. This compromise was taken, since assessment of the exact thickness is not possible in stereo fundus photographs. The standard deviations for each of the 900 values obtained for all nine fixations ranged from 12 µm to 45 µm with a mean of 24.7 µm in both right and left eyes. In the fovea, the standard deviations ranged from 20 µm to 30 µm. Figure 3 shows the mean normal retinal thickness values of all left eyes of healthy controls.
|
Statistics
The Kappa statistic (
) is interpreted as the chance corrected proportional agreement between two groups. The weighted kappa (
(w)) is the weighted proportional agreement corrected for chance.19 The usage of the
(w) is preferable to
for the comparison of area of retinal thickening, because the degree of disagreement is taken into account. Thus in this data set, the categories are ordered and disagreements are given weights according to the size of the discrepancy. Weights applied were full for exact agreement, two-thirds for one-step disagreement, one-third for two-step disagreement, and no credit for three-step disagreement. However, the comparison of location of retinal thickening yielded only two categories. Thus, weighted kappa analysis was not required. Additionally, McNemars test was performed as a test for bias in symmetry of the disagreements. The Kappa statistic has a maximum of 1.00 when agreement is perfect, and
= 0 indicates no agreement better than chance. Only guidelines to interpretation can be given, and those given by Landis and Koch20 suggest that
= 0.610.80 indicates that agreement between groups is "substantial", and
= 0.811.00 indicates that agreement is "almost perfect." Although the degree of acceptable agreement depends on circumstances, for most purposes
or
(w) <0.5 will indicate poor agreement.
| Results |
|---|
|
|
|---|
= 0.17 (95% CI: 0.080.25). By subfield the exact agreement ranged from 60.6% to 78.8%, and kappa values ranged from 0 to 0.26. McNemars test for symmetry of the data showed that two subfields (2 and 7) had significant bias in the symmetry of the observations of discrepancies in favor of retinal thickening being present in stereo fundus photographs and absent on RTA. Four subfields (1, 4, 5, and 6) were also biased in favor of stereo fundus photographs on discrepancies, yet not significantly. One subfield (9) showed no disagreement on discrepancies, and in two subfields (3 and 8) the discrepancies were biased in favor of RTA, more often showing retinal thickening compared to stereo fundus photos, but not significantly. The results are shown in Table 1 .
|
= 0.10 (95% CI: 0.060.25) and outer circle: exact agreement = 65.2% and
= 0.24 (95% CI: 0.130.34), respectively (Table 2) . Based on the fact that the majority of eyes have nonclinically significant macular edema, and no retinal thickening in the center of the fovea, and thus would skew a pooling analysis, subfield 1 was omitted.
|
Comparison of Area of Retinal Thickening
Exact agreement on area of retinal thickening was found in 44 of 87 (50.6%) eyes,
(w)= 0.34 (95% CI: 0.230.45). The result of the assessment is shown in Table 2 . Two eyes with CSME showed retinal thickening with central (i.e., foveal) involvement on fundus photographs. Foveal thickening was detected by RTA in only one of these two eyes with CSME. Six eyes, which had no detectable retinal thickening as determined by stereo fundus photographs, showed no retinal thickening by RTA either. Additionally, 18 eyes showed definite retinal thickening on subjective evaluation of stereo fundus photography, yet no retinal thickening was detected on RTA. A scatter plot on area of retinal thickening is shown in Figure 4 and the Spearman coefficient of correlation (rs) was 0.46.
|
| Discussion |
|---|
|
|
|---|
Exact agreement of location of retinal thickening was 70.9% and
was 0.17. On area of retinal thickening, exact agreement was 50.6% and weighted
was 0.34. Thus poor agreement was found between the two methods, and in 17 eyes no edema was found with RTA in contrast to the fundus photographs. The lack of sensitivity could be due to the control group, as the standard variation in healthy subjects is approximately 15%20% of the mean retinal thickness. Part of this could be due to excessive scatter, particularly in elderly subjects where some degree of nuclear sclerosis will always be present even if the media is considered clear clinically. In the present study the variation in the most peripheral part of the slits was up to 44 µm. A considerable interpersonal variation has also been found by Landau et al.21 and Neubauer et al.22 Pulito and co-workers23 report a 34% waste of study eyes due to light scatter. On the other hand, the evaluation of fundus photographs may easily be biased by the presence or absence of hard exudates, and in some cases be overinterpreted. Additionally, in cases where the edema is already resolved, hard exudates may stay for many weeks before dissolution.
Is RTA More or Less Sensitive in Detecting Retinal Thickening than Stereo Fundus Photos?
As indicated in Table 1 , McNemars test was performed to assess significant bias to one side. Only two subfields (2 and 7) showed significant bias. In subfield 2, it was in favor of fundus photographs showing retinal thickening more often than RTA, and in subfield 7, the case was the reverse. The table of frequencies on the comparison of area of retinal thickening (Table 3) shows that in 23 eyes stereo fundus photographs revealed more retinal thickening than RTA, and in 20 eyes RTA showed more retinal thickening than what was found by subjective evaluation of the same eyes. This difference of three eyes between the two methods is hardly evidence of one method being more sensitive than the other. However, 17 eyes, in which fairly small focal edemas (<1 DA in size) were found by stereo fundus photos, no retinal thickening was found by RTA. Pires and co-workers24 report RTA to be a more sensitive tool in detecting localized increases in retinal thickness. The work of Pires and co-workers comprise 28 eyes where 36% had no clinically visible retinopathy; the increases in thickness measured with the RTA had a very high variance. With eyes suggested to have an increased retinal thickness as high as 73.5% in the fovea, it seems unlikely that these eyes with an increased retinal thickness, assessed with RTA, can maintain visual acuity of 20/20 as suggested by Pires et al.24
|
A potential source of error in RTA may be the presence of hard exudates, which tends to induce reflexes in the RTA slit, making it impossible for the algorithm to resolve the width of the slit. Yoshida25 also reports that backscattering from hard exudates induces obscurity to the vitreoretinal interface in the RTA. Additionally, the algorithm will skip many hard exudates as "unresolved points." A possible remedy to help solve this problem could be to analyze the slope on the intensity curve instead of making the algorithm trying to fit a peak of intensity profile of the retinal pigment epithelium that is not well defined. Scanning laser tomography employs a technique similar to that of RTA in using the reflectance profile of the retina which is postprocessed with a mathematical algorithm defining the anterior and posterior retinal border from predefined rules for the location of the specific surface in relation to the slope of the reflectance profile. However the two instruments have different optical systems, and scatter is not reported as a major problem with this scanning laser tomograph using a confocal aperture8 9 10 11 ; therefore changing the optics in RTA may also avoid the scatter problem.
Undersampling may also be a problem during analysis of RTA data. The information in one slit of 2 mm is smoothed by the software algorithm and given as only ten measuring points. Thus the true values of thickness might be undersampled by the smoothing mechanism in the algorithm.
In this study only whites participated (controls and study patients), and often whites have a low content of pigment in the pigment epithelium. This can cause a low signal from the RPE and reduce the ability of the software algorithm to detect the posterior signal, which is the edge of the RPE, and thus the registration of an inaccurate width of the slit may occur.
Lens opacities can potentially induce light scatter to the RTA slits and decrease the clarity of the fundus photographs. In RTA, nuclear and posterior subcapsular cataract seem to be of minor importance, whereas cortical cataracts induce light scattering, resulting in inaccurate assessment of the width of the slit. In this study, eyes with clinically significant lens opacities were excluded, due to both poor photograph quality and poor quality of the RTA scans. Insufficient lubrication of the cornea or corneal dystrophy also induce light scatter to the slit, resulting in a falsely high value of retinal thickness. One patient had mild corneal dystrophy in both eyes, and RTA in both eyes showed extremely high values of retinal thickness and an excessive amount of unresolved measuring points. Both eyes of this patient were excluded.
In the present study it is possible that focal edema assuming a fairly small size in extent was not detected by RTA, due to the addition of 2 standard deviations to the mean value of healthy controls. However this leaves little explanation of the 20 eyes in which the RTA detected definite retinal thickening to a greater extent than what was assessed in the same eyes by subjective evaluation of stereo fundus photographs. It is a fair claim to make on an objective tool that it can indeed detect retinal thickening where it supposedly is present and detected by the means that are currently considered "gold standard" (fundus photos), irrespective of the extent of retinal thickening. It has even been claimed by Pires and co-workers24 that RTA can detect retinal thickening in eyes with no visible retinopathy (ETDRS retinopathy level 10) or mild retinopathy (level 20 or 35). It is impossible for the human eye to detect changes of <100 µm on stereo fundus photos5 or in binocular slit-lamp biomicroscopy.26 Thus the subtle focal pathology seen in nonclinically significant macular edema must presumably assume a size (i.e., height) greater than 100 µm in order for the observer to become aware of its presence, and it seems to be a fair claim of an objective tool to be able to detect retinal thickening to a similar degree to that of the human eye.
RTA is a noninvasive, patient- and operator-friendly technique, which has the advantage of quantitating retinal thickness in a standardized manner. It has been shown reproducible by several authors.6 12 The results of this study showed that RTA assessment of retinal thickening corresponded poorly on location of retinal thickening to the subjective assessment of retinal thickening by grading of stereo fundus photos, and fair on area of retinal thickening.
| Footnotes |
|---|
Disclosure: C. Strøm, None; B. Sander, None
The publication costs of this article were defrayed in part by page charge payment. This article must therefore be marked "advertisement" in accordance with 18 U.S.C.
1734 solely to indicate this fact.
Corresponding author: Birgit Sander, Department of Ophthalmology, 54E6, Herlev Hospital, University of Copenhagen, Herlev Ringvej 75, DK-2730 Herlev, Denmark; bisan{at}herlevhosp.kbhamt.dk.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
K A Goatman A reference standard for the measurement of macular oedema. Br. J. Ophthalmol., September 1, 2006; 90(9): 1197 - 1202. [Abstract] [Full Text] [PDF] |
||||
Read all eLetters
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |