|
|
||||||||
1From the Laboratory Biology, Engineering, and Imaging of Corneal Graft, Faculty of Medicine, Saint Étienne, France; 2Centre of Medical Engineering, École Nationale Supérieure des Mines de Saint-Etienne, Saint Étienne, France; 3French Blood Center/Eye Bank of Saint Étienne, Saint Étienne, France; and 4French Blood Centre/Eye Bank of Grenoble, Saint Ismier, France.
| Abstract |
|---|
|
|
|---|
METHODS. Seven observers of two eye banks determined the endothelial cell density (ECD) of 30 corneas through a grid overlay placed on endothelial photographs using two manual modes, unaided (naked-eye) and pointing (point-out). ECD was measured with the analyzer, first in automated mode, where analysis was completely machine determined, and then in touched-up mode, where the observer selected the analysis zone and corrected poorly drawn cell borders. Interobserver variability of ECD for the different methods was compared. Reproducibility of morphometry parameters was determined for the touched-up mode.
RESULTS. Interobserver variability was ±19.2% (95% confidence interval [CI], 13.025.4) and ±17.6% (95% CI, 11.923.3) for the naked-eye and point-out mode, respectively, whereas the touched-up mode gave the least variability of ±9.6% (95% CI, 6.512.7), confirmed by the highest intraclass correlation coefficient of 0.95 (95% CI, 0.910.97). Interobserver variability increased with worsening image quality. Manual modes underestimated ECD (naked-eye by a mean 10.7% [SD, 2.9%]; point-out by a mean 6.9% [SD, 2.3%]), whereas the automated mode overestimated ECD by a mean 14.7% (SD, 24.3%). Reproducibility of morphometric parameters by the touched-up mode was acceptable but was influenced by endothelial pleomorphism.
CONCLUSIONS. Manual counting shows systematic underestimation of ECD with high interobserver variability. The analyzer in automated mode overestimates ECD and is absolutely unreliable. Detection of cell contours by the specific algorithm, combined with manual correction by a skilled technician, appears to be the most reliable method of ECD and morphometry determination.
Throughout Europe, manual counting is more commonly performed by observation through a calibrated reticule fitted in the eyepiece or by printouts of endothelial images, with cells pointed out on a grid overlay of a known surface area. Manual methods are subject to instrument- and observer-related variations. We previously reported on the unacceptable lack of reliability of manual counts in 21 French eye banks with interbank and intrabank (i.e., intertechnician) variations; 59% of the counts varied more than 10% of the actual ECD, and the deviation ranged between 82% overestimation and 42% underestimation. This was attributed mainly to a lack of microscope calibration and the use of different counting strategies.4 5
Computer-assisted analyzers with digitized light microscopy images have been used for endothelial evaluation since the mid-1980s.6 7 8 Recent years have seen the introduction of digital image acquisition and improved computer algorithms, which allow a reliable estimation of endothelial parameters.9 10 Recently, a fully automated analyzer based on Fourier transformation of endothelial images without cell contour recognition was validated and is an encouraging sign for the modernization of eye bank endothelial assessment techniques.10 The tri-image analyzer Sambacornea (Sambatechnologies, Meylan, France), which was based on a prototype developed at our research laboratory in collaboration with the Centre of Medical Engineering of Saint Étienne, measures ECD by automatic cell contour recognition.9 Application of this algorithm, in combination with observer-mediated manual corrections tested on standard microlithographic mosaics with mathematically predetermined cell densities mimicking the human endothelium, has been shown to be accurate.11 Nevertheless, regarding routine application on organ-cultured corneas, the usefulness of the analyzer to reduce the interobserver variability and its comparison with manual counting methods remained to be evaluated. Given that automated and semiautomated counting methods exist in the analyzer, the purpose of this study was to investigate their reproducibility in comparison with the two manual counting methods.
| Materials and Methods |
|---|
|
|
|---|
Manual Counting: Naked Eye and Point-Out
Seven skilled observers, each having performed more than 500 counts and affiliated with either of two eye banks (Grenoble and Saint Étienne), participated in the study. Because our study required multiple observers of different eye banks to perform counts on the same cornea, manual counting in real time using the light microscope was not feasible. Hence, the eye bank counting procedureprintouts of endothelial images with a transparent calibrated grid overlay (Fig. 1) was simulated for study purposes. In the naked-eye mode, the printed grid was accurately aligned over each endothelial photograph, and 10 nonadjacent reticule units, where cells were most clearly visible (four on image 1 and three each on images 2 and 3) were chosen and their coordinates noted. Accurate alignment, though theoretically not necessary for the naked-eye mode, was essential to ensure counting of identical zones with the second method. Cells were counted with the fixed-frame technique, whereby those within the reticule unit (except those touching the adjacent right and bottom borders) were included. Counting was based on a visual impression using only a manual counter, without any pointing device. Counting was repeated using another method, the point-out mode, whereby cells contained in the same 10 reticule units on the three images were counted using the fixed-frame technique, this time pointing out individual cells with a marker. All 30 corneas were serially counted first with naked-eye mode and then with the point-out mode to avoid any observer bias caused by memorization. Between 250 and 400 cells (2540 cells per reticule unit) were counted for each cornea, depending on the ECD, to maintain uniformity with the computer-assisted analysis. The mean of the 10 reticule unit counts for a particular cornea was obtained, and from that the ECD was calculated as follows: ECD (cells/mm2) = (mean cell count x 106)/(1202.6)2. No quantitative morphometric evaluation was possible for either manual method.
|
First, each image was analyzed by the automated mode, where the algorithm itself selected the counting zone and subsequently performed thresholding and contour recognition, technical details of which are mentioned elsewhere.9 The procedure required no human participation. Cells with probable errors in contour recognition were eliminated by the software from the final analysis. Second, images were analyzed with the touched-up mode, where the observer selected the counting zones as free forms, carefully avoiding the stromal folds caused by swelling in organ culture storage and liable to produce an artifactual counting error. This zone was next subjected to manual threshold adjustments and contour recognition by the algorithm, followed by manual correction of poorly recognized cell contours, if necessary. For each method, the software calculated the mean cell area from which the ECD, the SD, and the coefficient of variation (CV) of cell area were calculated (Fig. 2) . Numbers of cells with six neighbors gave the percentage of hexagonality.
|
To assess the interobserver agreement for analysis of morphometry parameters (CV and hexagonality) determined only for the touched-up mode with the analyzer, the same Bland-Altmanlike method was used whereby for each cornea, the variation against the mean (in percentage) for each observer was plotted against the mean for seven observers.13 The limits of agreement, calculated as mean ± 2 SD of the difference, delineated the interval containing 95% of the values. Statistical data were then analyzed (SPSS 11.5; SPSS Inc., Chicago, IL).
| Results |
|---|
|
|
|---|
|
Reproducibility of Morphometry Assessment with the Touched-Up Mode
Considering that ECD evaluation by the automated mode of the Sambacornea analyzer was not reliable, only morphometry data obtained with the touched-up mode is presented here. Interobserver variations of ±6.9% (95% CI [4.69.1]) for CV and ±7.0% (95% CI [4.79.3]) for hexagonality were observed. No correlation was found between image quality and variation of CV or hexagonality (data not shown).
| Discussion |
|---|
|
|
|---|
The automated mode of the analyzer Sambacornea produces significant overestimation and high SD, especially for lower ECDs, and is definitely not reliable, as has also been noted in previous specular microscopy studies using automated modes.16 17 18 The lack of reliability may be attributed to several factors. Software, especially for images with poor quality and lack of sufficient contrast, fails to correctly identify the cell borders, resulting in the recognition of cells of abnormal size (too big or too long) that actually represent poorly separated cells. Zones with the best contrast are favored by the software for analysis; this often includes areas of corneal folding, which give an overestimation because of parallax error. Images used for analysis with the computer algorithm are widefield (1000 µm x 750 µm with the microscope used here and depending on microscope type) and tend to include areas with stromal folds. Ruggeri et al.,10 using images with a still wider field (1256 µm x 940 µm), reported good correlation between manual and fully automated counts. The authors used only good quality images for correct functioning of their algorithm. They also used a modified manual count technique, taking into account an analysis zone seven times larger (approximately 314 µm x 235 µm) than the routine zone as the reference in their study.
Semiautomated counting with the analyzer, with the observer selecting the counting zone, choosing the best threshold levels, and retracing the cell contours, overcomes most of the drawbacks observed with the automated and manual techniques. Unlike what occurs with the automated mode, with the semiautomated mode the counting zone is delineated by the technician as a free form. Therefore, choice of an optimally visible zone (or zones considered representative of the rest of the central cornea, even if it is not optimally discernible) and circumvention of stromal folds is possible, limiting the necessity of manual retouch and improving the performance of the algorithm. Manual correction of cell contours incorrectly drawn by the algorithm further improves the reliability of the procedure; hence, human judgment and intervention contribute to reducing the software-induced errors.
Underestimation with manual fixed-frame counting compared with an endothelial analyzer using a semiautomated approach with manual correction has been demonstrated.7 9 Unacceptable interbank and intrabank variations in manual counts noted in our previous studies were attributed to improper microscope calibration and differences in counting strategy.4 5 Both factors were neutralized in the present study because, for the manual counts, images taken after appropriate microscope calibration were analyzed by all observers with the same fixed-frame counting strategy. For computer-assisted analysis, the same three images were used, as was the touched-up mode, whose exactness had already been established.11 Moreover, we counted more or less uniform samples (250400 cells) for manual and semiautomated counts, which should have reduced the variability. In spite of these, the differences in reproducibility observed between the two manual modes and the semiautomated mode were important and could be logically explained by several factors.
One factor could have been the choice of counting zone used by various observers for the different counting modes. This, however, seems less contributive because in all three modes, zones in which the cells were optimally visible were selected by the observers and were nearly identical because of the careful avoidance of stromal folds. This factor is supported by the high degree of correlation found among the seven observers for the different modes (0.95 for semiautomated versus 0.82 for point-out versus 0.79 for naked eye).
Another factor lay in the counting strategy itself, which was directly related to the human factor and likely played a major role. The fixed-frame strategy was used for manual counting and was only a convenient approximation of the real count (designed in the beginning to count numerous floating cells in a hemocytometer and later adapted to contiguous objects19 ). The fixed-frame technique is thought to be associated with an inherent variability given the small counting unit (<10,000 µm2), and it is particularly liable to show underestimations for corneas with high ECDs.4 20 For manual counts, errors occur even for expert personnel, whether they count in real time under a light microscope or in a deferred manner on endothelial images displayed on a computer monitor. The fixed-frame strategy is influenced by inconsistencies on the part of the observer regarding the inclusion of cells lying close to or touching the reticule margins. This is important because missing even a single cell out of an average 25 to 40 cells in the 100 µm x 100 µm reticule would result in an underestimation of 2.5% to 4%.
The Sambacornea algorithm makes use of a variable-frame technique, where the analysis zone is selected manually as a free form, contrary to the principle used in other endothelial analyzers where only a fixed frame7 8 or the entire field10 is analyzed. This variable frame totally suppresses the specific source of variability described, but the differences in extent and nature of manual corrections between observers, especially with images of poor quality and corneas with irregular endothelia, are also liable to induce new variations. In our study, the interobserver variability for ECD assessment increased with the worsening of image quality. This is in agreement with findings reported by the Cornea Donor Study Group.21 22 Image quality is dependent on multiple factors, such as response of ECs to osmotic challenge, corneal folding, and microscope field-depth problems. Ruggeri et al.10 advocated completely automated cell counts with their analyzer using only good quality images after excluding images that could not be processed. To enable its application in eye banks, where poor quality images are not uncommon, the touched-up mode of the analyzer, which allows human intervention to compensate for deficiencies in image quality, is a definite advantage.
Another advantage of the Sambacornea analyzer over manual modes is the possibility of morphometry assessment (CV and percentage hexagonality), which is considered a reflection of the functional properties of the ECs.23 24 25 This is the only analyzer described in the published literature, other than that described by Barisani-Asenbauer,7 that allows morphometric evaluation because the algorithm functions on the principle of contour detection. However, it remains susceptible to interobserver variations, especially for corneas with high pleomorphism and polymegathism. Though this susceptibility may be partly ascribed to differences in manual corrections between observers for poorly visualized but relatively regular mosaics, for corneas with polymegathous endothelia, the calculation of CV has been known to deviate between 6% and 8% from the mean, even if a large sample (nearly 100 cells) is counted.26 In the absence of any absolute cutoff levels for morphometric criteria of eye bank corneas, the variations shown by the touched-up mode could be considered to be within clinically acceptable limits.
In conclusion, we recommend a semiautomated, not a fully automated, approach to obtain reliable endothelial assessment. We insist on the role of an eye bank technician to guide the evaluation process, especially in the choice of an analysis zone and the correction of cell contours, if necessary. We also recognize the importance of image quality because that influences the reliability and, hence, the need to optimize image quality using the best settings of the microscope and the imaging device. Further research is under way to explore endothelial assessment using three-dimensional corneal imaging, which will allow a reliable and less observer-dependent evaluation by facilitating counting on the slopes and depths of corneal folds.
| Acknowledgements |
|---|
| Footnotes |
|---|
Disclosure: N. Deb-Joardar, None; G. Thuret, None; Y. Gavet, None; S. Acquart, None; O. Garraud, None; H. Egelhoffer, None; P. Gain, None
The publication costs of this article were defrayed in part by page charge payment. This article must therefore be marked "advertisement" in accordance with 18 U.S.C.
1734 solely to indicate this fact.
Corresponding author: Philippe Gain, Service dOphtalmologie (pavillon 50A), CHU de Bellevue, 25, Boulevard Pasteur, F-42055 Saint-Étienne Cedex 2, France; philippe.gain{at}univ-st-etienne.fr.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
M. Zhao, G. Thuret, S. Piselli, A. Pipparelli, S. Acquart, M. Peoc'h, J.-M. Dumollard, and P. Gain Use of Poloxamers for Deswelling of Organ-Cultured Corneas Invest. Ophthalmol. Vis. Sci., February 1, 2008; 49(2): 550 - 559. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. Deb-Joardar, G. Thuret, M. Zhao, S. Acquart, M. Peoc'h, O. Garraud, and P. Gain Comparison of Two Semiautomated Methods for Evaluating Endothelial Cells of Eye Bank Corneas Invest. Ophthalmol. Vis. Sci., July 1, 2007; 48(7): 3077 - 3082. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |