|
|
||||||||
From the Centre for Eye Research Australia, The University of Melbourne, Melbourne, Victoria, Australia.
| Abstract |
|---|
|
|
|---|
METHODS. The IVI is a 32-item questionnaire developed to measure the impact of vision impairment on restriction of participation in daily activities in five domains of functioning. Each item is rated on a six-level scale from "no difficulty" to "cant do because of vision." The IVI was administered by trained interviewers to 115 people with impaired vision (visual acuity less than 6/12 or visual field deficit) who attended the Royal Victorian Eye and Ear Hospital, a vision rehabilitation agency, or a self-help group for people with impaired vision. Data were also collected on demographic characteristics of participants, cause of vision impairment, and distance and near vision. General health status was assessed with the Short Form-12 (SF-12) of the Physical and Mental Health Summary Scales. A subset of participants completed the IVI twice, either 1 to 2 weeks apart or by different forms of administration (different interviewers or self).
RESULTS. Internal consistency of total and domain average IVI scores was high (
= 0.800.96) and sequential elimination of items did not affect consistency. Total and domain average IVI scores correlated moderately with both near and distance vision (r = 0.210.31) but did not correlate with physical or general health or comorbidity. Total and domain average IVI scores correlated most closely with global measures of restriction of participation (r = 0.440.82). Principal-components analysis confirmed that all IVI items contribute to one underlying theme and tended to confirm two of the five domains: emotional reaction to vision loss and mobility. The first three components explained 43%, 8%, and 6% of the variation in the data. Guttman split-half reliability coefficients between different forms of administration and over time ranged from 0.73 to 0.94 for domain and total IVI scores. Mean absolute difference for domain and total scores between administrations was less than 1 step for all domains and the total score.
CONCLUSIONS. This study provides support that the IVI has sufficient internal and construct validity to measure the effect of vision impairment on restriction of participation in daily activities. The IVI demonstrates acceptable reliability over a short period and yields consistent results between interviewers. The IVI can also be self-administered with assurance that the results will be comparable to those that would have been obtained by a trained interviewer. Therefore, the psychometric characteristics of the IVI support its use in assessment of the vision rehabilitation needs of people with impaired vision. Its stability over time indicates that it has potential to evaluate outcomes of intervention.
| Introduction |
|---|
|
|
|---|
In vision rehabilitation, an instrument to specifically address restriction of participation (handicap) is necessary to add to measures of impairment such as visual acuity and subjective or objective measures of activity limitation. Restriction of participation is the limitation on activities that a person needs or wants to do that is experienced as a result of impairment or disability.17 Ability to perform activities is important in an individuals life, to the extent that those activities are necessary or desirable to the individual. For example, loss of the ability to thread a needle is more important to a person who sews than to one who does not. From individual response to loss of particular abilities arises the need to assess vision-related rehabilitation needs of individuals from the individuals point of view, in terms of the importance of participating in activities.
The Impact of Vision Impairment (IVI) Profile was developed specifically to assess vision rehabilitation needs in the context of limitation of participation resulting from impaired vision. It contains 32 items that query level of restriction of participation in common daily experiences. The instrument has been designed to cover a broad range of issues in five separate domains of functioning. Items contained in the IVI do not cover clinical issues such as disease or symptoms, nor does it contain physical or performance-based items. Rather, its development has been guided by the World Health Organizations model of human functioning and disablement17 with the goal of capturing a vision-specific profile of restriction of participation.
For the IVI to be useful in the assessment of the rehabilitation needs of people with impaired vision, it must be both valid and reliable. In other words, it must measure what it intends to measure and it must yield consistent results. The purpose of this study was to describe the psychometric characteristics of the IVI and evaluate its validity and reliability over time and between different forms of administration.
| Methods |
|---|
|
|
|---|
Participants recruited from the RVEEH and VAF had clinical eye examinations that included measurement of visual acuity and subjective refraction as a routine part of their appointments at these agencies. Best corrected visual acuity, near visual acuity, and main cause of vision loss were abstracted from clinic files for these participants. Distance visual acuity and main cause of vision loss for members of self-help groups was by self-report and was confirmed using a directional-E screening test. Distance visual acuity was grouped into three categories: less than 6/12 to 6/18, less than 6/18 to 6/60, and less than 6/60, reflecting vision at which functional deficits have been noted,18 19 20 21 22 according to the World Health Organizations definition of low vision and severe vision impairment.17 Those with visual field loss and visual acuity of 6/12 or better were categorized separately. All participants with visual field loss alone attended clinics at RVEEH, and visual fields were measured on an automated visual field analyzer (Humphrey Systems, Dublin, CA) using a standard program (24-2 Swedish interactive test algorithm [SITA]; Humphrey Systems). Visual field loss was noted when the results for the hemifield test (Humphrey Systems) were outside normal limits. Near vision was categorized as N8, N20, or N48 or less. Near vision was not available for members of self-help groups.
Participants answered demographic questions regarding age, duration of vision impairment, hearing loss, other health conditions, and limitations to performance of daily activities attributed to other health conditions. Participants also completed the standard 4-week Short Form-12 (SF-12, version 1; Physical and Mental Health Summary Scales)23 and completed the IVI questionnaire. The SF-12 is a short version of the SF-36, a general health-related quality-of-life instrument. Two summary components related to the physical (physical summary scale; PCS12) and mental (mental summary scale; MCS12) domains of life were calculated from the questions in the SF-12, according to the algorithm developed by Ware et al.23
All questionnaires were administered by interviewer to the person with impaired vision. All interviewers were trained to administer the IVI, using a questionnaire protocol developed for the study. Proxy answers were not solicited from caregivers or relatives to avoid biasing the IVI responses to the perception of another persons opinion of the participants ability. A subset of participants completed the IVI on two occasions, to evaluate the reliability of the IVI between two interviewers and interviewer and self-administration and over a short period (12 weeks), before receiving vision support or rehabilitation services. Only participants with visual acuity sufficient to read large print (18-point font) were asked to self-administer questionnaires.
The IVI questionnaire was developed in three stages. Initially, focus groups to identify important activities that result in restrictions of participation were conducted with people who have the most common causes of impaired vision in Australia.24 Issues explored included activities in mobility, household and personal care, consumer and social interactions, and leisure and work life domains. As a result of unstructured issue identification with these groups, a fifth domain was identified: emotional reaction to vision loss.
In the second stage of development, issues identified in focus groups were operationalized into a bank of 76 items. Existing instruments, including the Activities of Daily Vision Scale, the Visual Function (VF)14 questionnaire, the National Eye Institute-Visual Function Questionnaire (NEI-VFQ), and the Bristol Vision-Related Quality of Life (VQOL), were reviewed for content and scaling relevant to the issues identified in focus groups. The initial item bank was drawn mainly from the 139 questions in the VQOL and included 69 items with content that related specifically to restriction of participation and reflected the issues identified in focus groups. The content of many of the VQOL questions tends to overlap that of the other questionnaires reviewed, but question phrasing of the VQOL tends to be more closely aligned with the concept of restriction of participation. The VQOL contains a core of 10 items, and this core is included in the IVI. An additional seven questions were derived in areas in which the VQOL did not provide adequate coverage of issues identified in focus groups. Items regarding ocular symptoms and a persons limitation in activitiesfor example, in seeing small objectswere not included in the IVI.
Trials of the IVI were then conducted in two consecutive versions of the questionnaire before deriving the final 32-item version. Trial version 1, containing the original 76 items, was administered to 96 people with impaired vision.25 Trial version 2 was derived from trial version 1, with the number of items reduced to 45 by eliminating questions with a high degree of correlation (r > 0.70) and items with floor and ceiling effects. Trial version 2 was administered to 256 people with impaired vision who had not participated in testing trial version 1. Data from this administration were then used to further reduce the number of items by eliminating similar questions with a high degree of correlation (r > 0.60) and eigenvalue loading of less than 0.45 in the first component in principal-components analysis.26 In both stages of item reduction through elimination of questions with high correlation, decisions regarding which items with similar content to discard were made in consultation with experienced vision rehabilitation professionals. All versions of the IVI have retained the core 10 questions of the VQOL and all have retained questions in each of the five provisional domains.
All versions of the IVI have used the question format of the VQOL.16 Participants were asked how much their eyesight deficiency had interfered with an activity "in the past month." Responses to items were rated from "not at all" (0), "rarely" (1), "a little" (2), "a fair amount" (3), and "a lot" (4) to "all the time" (5) and for some items, "cant do because of eyesight" (5) or "dont do because of other reasons" (8). Total and domain scores are an arithmetic average of the rating for applicable items. That is, when a participant rated an item 8, it was not included in the final average score. Items with similar content were provisionally grouped into domains in which specific rehabilitation interventions are directed. For example, in the mobility domain, intervention might include stair marking and orientation training, and in the household and personal care domain it might include provision of adaptive devices to aid in meal preparation.
All data were doubly entered in Access (Microsoft Access 97; Microsoft Corporation, Redmond, WA) and entry errors were confirmed by review of the participant file. Statistical analyses was performed by computer (SPSS version 10; SPSS Science, Chicago, IL), and P < 0.05 was considered statistically significant. Only data from administration of the final 32-item version of the IVI are included in the analysis. In cases in which the participant completed more than one IVI for the reliability part of the study, the results from the first administration were used. (A trained interviewer always performed the first administration.) Bivariate Spearman correlation was used to determine the correlation between IVI item responses, item responses and the total IVI score, and each IVI domain and the total score with demographic characteristics. Analyses using visual acuity used the distance and near visual acuity groups at initial examination that have been defined previously. Analyses including near vision exclude members of self-help groups. Analysis of variance was used to determine difference between means of continuous variables for characteristics with more than two levels of categorization and t-tests were used to determine difference in means between variables with two levels of categorization. The
2 analysis was used to evaluate differences in proportions. Internal consistency of the IVI and its domains was evaluated with Cronbach
, and Guttman split-half correlation was used to evaluate reliability between different forms of administration. The SE of measurement for reliability analyses was calculated according to the method of Fleiss,27
based on the intraclass correlation coefficient.
Principal-components analysis was used to examine the underlying structure of the IVI. Sampling adequacy for principal-components analysis was evaluated with the Kaiser-Meyer-Olkin statistic greater than 0.5, and the Bartlett test of sphericity P < 0.05 was used to determine that the population correlation matrix is not an identity. An initial principal-component extraction was used to determine the number of components needed to represent the data, by using eigenvalues greater than 1.0 or examination of the scree plot to define the number of components in the data. To simplify and interpret the components, a principal-components extraction specifying the number of components identified in the initial extraction was conducted using varimax rotation to transform the initial matrix. Items with loading less than 0.45 were considered unrelated to a factor.28
| Results |
|---|
|
|
|---|
|
Most, 85% (n = 78) participants reported that they had an illness other than vision loss. Of these, common illnesses reported were arthritis, 18% (n = 14); heart condition, 29% (n = 23); high blood pressure, 19% (n = 15); asthma or other breathing difficulty, 29% (n = 23); and diabetes, 29% (n = 23). Many reported multiple other health conditions, 47% (n = 37). Of those, 32% (n = 25) said that it caused no difficulty in performing daily activities; 30% (n = 23), a moderate amount of difficulty; and 38% (n = 29) a lot of difficulty.
Validity
Twenty-eight (88%) of the 32 items were considered relevant by 90% or more of the participants (i.e., did not respond that they did not do the activity for reasons other than vision; Table 2
). Items 1 (work), 4 (sport), 5 (going out to events), and 18 (using transport) all had fewer than 80% of the participants respond that the item was relevant. The proportion that judged these four items to be relevant did not vary significantly by gender. However, for each item, those who judged these items not to be relevant were significantly older, on average (all P < 0.001).
|
Nine pairs of items had Spearman correlations greater than 0.60, of which three were 0.61 to 0.62 and one was greater than 0.70 (Table 3) . Three of the nine items were pairs of core items from the VQOL, and one pair contained an item from the VQOL core. All other Spearman correlations between all other possible pairs of items were less than 0.60 (data not shown).
|
of 0.85 or greater for all but the household domain (0.80; Table 4
). Eliminating one item at a time did not change the Cronbach
for each domain or the total scores. Evaluation of the total score is limited by the four questions that had less than an 80% of participants responding that the items were relevant. The Cronbach
for the total score when these four items were eliminated from the analysis was 0.95 (n = 86). The Spearman correlation between each item and the total mean score for the IVI ranged from 0.45 to 0.76.
|
|
When all 32 IVI items were used in principal-components analyses, only 27 participants had vision-related scores for each item, because many individuals stated that at least one item in the IVI was not an activity in which they participated. In cases in which an item is not applicable to the individual, the data are scored as "missing." Therefore, principal-components analyses were conducted for the 28 items for which more than 80% of participants said the item was relevant. A total of 86 participants had scores for each of these 28 items. Initial principal-components extraction resulted in identification of five components with eigenvalue greater than 1. The initial principal-components solution was dominated by the first factor, eigenvalue 12.15, which explained 43% of the variation in the data. All items in the initial solution loaded onto the first component at 0.48 or greater (Table 6) . Components 2, 3, 4, and 5 explained 7.3%, 6.1%, 4.4%, and 4.1% of the variation, respectively. Examination of the scree plot for the initial solution suggested that the data were explained by three components, in that the slope of plotted eigenvalues began to flatten at the fourth component.
|
Reliability
Seventy-five study participants also participated in reliability studies of the IVI, 22 with two IVI questionnaires administered 1 to 2 weeks apart (test-retest), 22 with two different interviewers administering the IVI, and 31 with interviewer and self-administrations. For most items in the IVI, the difference between item responses was within 1 step in 85% or more cases, for each of the three forms of administration (Table 7)
. The mean absolute difference between items was 1 or less for most items in each of the three forms of administration.
|
|
| Discussion |
|---|
|
|
|---|
Item Characteristics and Scoring
For the IVI to be a practical tool to assess vision rehabilitation needs, it had to be concise but still contain sufficient items to cover adequately the common issues raised in focus groups conducted at the initiation of the study. To achieve the requirement of being a concise tool, it was necessary to reduce the number of items from the original 76 questions.
Most items remaining in the IVI were relevant to more than 80% of participants. Four items (1, 4, 5, and 18) were found to be relevant by less than 80% of the participants. Two of these were closely related in content: "taking part in sports" and "going out to sporting events, movies, and plays." "Paid or voluntary work" and "traveling or using transport" also were relevant for less than 80% of participants. All who responded that these items were not relevant were older on average than those who deemed them relevant, perhaps signaling that in older adults much of lifes activities are centered around the home. We hesitated to eliminate these items, because the IVI is intended for use in all adults, including those of working age. Therefore, interpretation of the average score for the provisional work and leisure domain should proceed cautiously for older adults, because the number of items that are relevant may be limited.
In earlier versions of the instrument, redundant items or those with floor and ceiling effects were identified and were removed from the questionnaire.25 26 Most remaining items exhibit at most only a modest correlation with each other. Therefore, IVI items contain unique information with little content overlap. Sequential elimination of items from internal consistency analyses did not affect internal consistency of the IVI, thus demonstrating that the provisional domains and total score are not weighted to a particular item and that each item has a similar contribution to the score. All items contained in the IVI have a greater than 0.20 correlation with the total scorea suggested criterion for retention of items in a scale.34 All but two remaining items had responses across the full range, suggesting that the IVI items have good discriminative ability to describe a wide range of experience with vision impairment.
Validity
The impact of impaired vision on a persons ability to participate in society and activities is wholly dependent on the persons perception of the difficulty experienced with important activities. As such, there is not a gold standard by which to judge the criterion validity of instruments that attempt to measure this subjective response. Evaluation of the validity of these instruments is limited to face and construct validity.
Face validity of the IVI was assured by use of focus groups in its development to ensure that the range of items included in the IVI were relevant in both breadth and content of vision-related issues important to people with impaired vision.24 Development of the item bank used in the IVI was based primarily on a previously validated questionnaire, providing further assurance that the IVI contained valid content and question format that captured the issues identified by focus groups.16
In evaluating construct validity of the IVI, we expected that the degree of vision-related reported difficulty with IVI items would have some relationship to actual function-based measures of vision. Although the correlation of the IVI with distance vision was generally modest, all provisional domains and the total score demonstrated a trend of increased reported difficulty with reduced level of vision. Similarly, all domains excepting the leisure domain demonstrated similar relationships with near vision. In other studies low correlation has also been reported with function-based measures of vision and ability to complete activities of daily living and self-reported visual difficulty with tasks.1 2 IVI domain and total scores correlated most strongly with vision-specific global measures of restriction of participation, suggesting that it elicits responses consistent with the hypothesized construct.
The construct validity of the IVI would be compromised if it were actually measuring the impact of disability from other causes. Participants in this study were older adults and, typical of this age group, many reported that they had other health conditions. Mean IVI scores for each domain and the total did not vary by self-reported other health conditions nor did they vary by reported difficulty experienced because of other health conditions. IVI domain and total scores also did not correlate significantly with age, the physical summary scale (PCS12) of the SF-12, or the self-reported level of general health. Correlation of the IVI with the mental summary scale (MCS12) is difficult to interpret. It might be expected that increasing difficulty with IVI items would correlate with increasing difficulty on the MCS12. We found the opposite and suggest that the correlation may be spurious. However, the general noncorrelation between the IVI and other factors supports that the response to items contained in the IVI is specific to experience with impaired vision.
To further explore the construct validity of the IVI, we used principal-components analysis to explore the underlying structure of the IVI. In principal-components analysis, all items in the IVI loaded onto the first component of the initial solution, adding further support that the items contained in the IVI are measuring one underlying theme. Principal-components analysis did not confirm the five provisional domains identified a priori in the study. However, it tended to confirm the emotional reaction to vision loss and the mobility domains. In the final three-component model, emotional-reaction items loaded heavily onto the first component, suggesting that the underlying structure of the IVI is heavily weighted by these concerns.
Items in the provisional leisure and work, social and consumer interaction, and household and personal care domains seem to tap a related group of issues. These results indicate that combining items from these three domains may in fact give a better picture of the restriction of participation experienced in an older population.
In a practical sense, the implication of the results of principal-components analysis for vision rehabilitation suggest that three areas of restriction of participation may be addressed in assessing needs for intervention. The first and third components suggest assessment of the need for interventions targeted at emotional support and mobility, respectively. The second component is most heavily weighted to vision-dependent or vision-critical activities, such as viewing television or reading. This suggests a need for vision-enhancement intervention.
Our principal-component analysis was limited to 28 of the 32 items in the IVI because of inadequate sample size to include four of the items. As have others,7 we find that the resultant data set is not entirely representative of the complete sample. The 22 individuals whose data were not included in the principal-components analysis tended to be somewhat older on average77 compared with 71 years of age. They did not differ on level of vision, cause of vision loss, or reported other illnesses. Given that age was unrelated to either domain or total IVI score, we expect that the effect of excluding data for these older individuals from the principal-components analysis would be minimal. However, we are still unable to evaluate these four items in terms of their role in the underlying structure of the IVI.
Reliability
Test-retest reliability is particularly important if the IVI is to be used to measure change in limitations of participation over time or as a measure of low vision service outcome. Our results compare favorably with results reported for the VCM1, in which the interclass correlation coefficient was 0.90.16
Participants in this part of the research had not received vision support or rehabilitation at either the hospital or at a vision rehabilitation agency. Thus, it is unlikely that the test-retest results were affected by intervention. Upper limits of the absolute difference suggest the IVI has the ability to discriminate changes in IVI score of 1 or more for most of the provisional domains and the total IVI score.
The consistency of the IVI between different forms of administration gives it flexibility in application. For example, the IVI could be completed by a person before a clinic visit, with results comparable to administration of the IVI by clinic personnel. Also, if the IVI is used as an outcome measure, there is some assurance that changes before and after administration are not due to differences in forms of administration. It should be noted that self-administered reliability comparisons apply only to people with better vision and that other forms of self-administration have not been evaluated.
| Conclusions |
|---|
|
|
|---|
| Footnotes |
|---|
Submitted for publication April 13, 2001; revised October 16, 2001; accepted November 19, 2001.
Commercial relationships policy: N.
The publication costs of this article were defrayed in part by page charge payment. This article must therefore be marked "advertisement" in accordance with 18 U.S.C.
1734 solely to indicate this fact.
Corresponding author: LeAnn M. Weih, Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, 32 Gisborne Street, Locked Bag 8, East Melbourne, Victoria, Australia 8002; leann{at}unimelb.edu.au
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
E. L. Lamoureux, J. F. Pallant, K. Pesudovs, G. Rees, J. B. Hassell, and J. E. Keeffe The Effectiveness of Low-Vision Rehabilitation on Participation in Daily Living and Quality of Life Invest. Ophthalmol. Vis. Sci., April 1, 2007; 48(4): 1476 - 1482. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. L. Lamoureux, J. F. Pallant, K. Pesudovs, G. Rees, J. B. Hassell, and J. E. Keeffe The Impact of Vision Impairment Questionnaire: An Assessment of Its Domain Structure Using Confirmatory Factor Analysis and Rasch Analysis Invest. Ophthalmol. Vis. Sci., March 1, 2007; 48(3): 1001 - 1006. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. L. Lamoureux, J. F. Pallant, K. Pesudovs, J. B. Hassell, and J. E. Keeffe The Impact of Vision Impairment Questionnaire: An Evaluation of Its Measurement Properties using Rasch Analysis Invest. Ophthalmol. Vis. Sci., November 1, 2006; 47(11): 4732 - 4741. [Abstract] [Full Text] [PDF] |
||||
![]() |
J B Hassell, E L Lamoureux, and J E Keeffe Impact of age related macular degeneration on quality of life Br. J. Ophthalmol., May 1, 2006; 90(5): 593 - 596. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. A. Bradley, D. Bradley, and G. B. Bartley Evaluating Health-Related Quality of Life in Ophthalmic Disease: Practical Considerations Arch Ophthalmol, January 1, 2006; 124(1): 121 - 122. [Full Text] [PDF] |
||||
![]() |
R. Misajon, G. Hawthorne, J. Richardson, J. Barton, S. Peacock, A. Iezzi, and J. Keeffe Vision and Quality of Life: The Development of a Utility Measure Invest. Ophthalmol. Vis. Sci., November 1, 2005; 46(11): 4007 - 4015. [Abstract] [Full Text] [PDF] |
||||
![]() |
H T V Vu, J E Keeffe, C A McCarty, and H R Taylor Impact of unilateral and bilateral vision loss on quality of life Br. J. Ophthalmol., March 1, 2005; 89(3): 360 - 363. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. R. Taylor, H. T. V. Vu, C. A. McCarty, and J. E. Keeffe The Need for Routine Eye Examinations Invest. Ophthalmol. Vis. Sci., August 1, 2004; 45(8): 2539 - 2542. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. L. Lamoureux, J. B. Hassell, and J. E. Keeffe The Impact of Diabetic Retinopathy on Participation in Daily Living Arch Ophthalmol, January 1, 2004; 122(1): 84 - 88. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |