- Research article
- Open Access
- Open Peer Review
Development and validation of a new global well-being outcomes rating scale for integrative medicine research
BMC Complementary and Alternative Medicinevolume 4, Article number: 1 (2004)
Researchers are finding limitations of currently available disease-focused questionnaire tools for outcome studies in complementary and alternative medicine/integrative medicine (CAM/IM).
Three substudies investigated the new one-item visual analogue Arizona Integrative Outcomes Scale (AIOS), which assesses self-rated global sense of spiritual, social, mental, emotional, and physical well-being over the past 24 hours and the past month. The first study tested the scale's ability to discriminate unhealthy individuals (n = 50) from healthy individuals (n = 50) in a rehabilitation outpatient clinic sample. The second study examined the concurrent validity of the AIOS by comparing ratings of global well-being to degree of psychological distress as measured by the Brief Symptom Inventory (BSI) in undergraduate college students (N = 458). The third study evaluated the relationships between the AIOS and positively- and negatively-valenced tools (Positive and Negative Affect Scale and the Positive States of Mind Scale) in a different sample of undergraduate students (N = 62).
Substudy (i) Rehabilitation patients scored significantly lower than the healthy controls on both forms of the AIOS and a current global health rating. The AIOS 24-hours correlated moderately and significantly with global health (patients r = 0.50; controls r = 0.45). AIOS 1-month correlations with global health were stronger within the controls (patients r = 0.36; controls r = 0.50). Controls (r = 0.64) had a higher correlation between the AIOS 24-hour and 1-month forms than did the patients (r = 0.33), which is consistent with the presumptive improvement in the patients' condition over the previous 30 days in rehabilitation. Substudy (ii) In undergraduate students, AIOS scores were inversely related to distress ratings, as measured by the global severity index on the BSI (rAIOS24h = -0.42, rAIOS1month = -0.40). Substudy (iii) AIOS scores were significantly correlated with positive affect (rAIOS24h = 0.56, rAIOS1month = 0.57) and positive states of mind (rAIOS24h = 0.42, rAIOS1month = 0.45), and inversely correlated with negative affect (rAIOS24h = -0.41, rAIOS1month = -0.59).
The AIOS is able to distinguish relatively sicker from relatively healthier individuals; and correlates in expected directions with a measure of distress and indicators of positive and negative affect and positive states of mind. The AIOS offers a tool for CAM/IM research that extends beyond a disease emphasis.
The field of complementary and alternative medicine (CAM)/integrative medicine (IM) (CAM/IM) has grown substantially in recent years [1, 2]. Consumer utilization rates in the U.S. have reached over 40% . Together with the extensive use of CAM by the general population, research activity, clinical services, and medical education programs in this area are also on the rise. Clinical claims of many CAM providers from different disciplines converge on their concern with individually-salient quality of life outcomes as primary, and conventional medical disease endpoints as secondary, in assessing benefit: risk ratios [3–6]. Issues that matter to one person may have little relevance to another. Moreover, many CAM modalities address the full scope of a person's life, including spiritual, mental, emotional, and physical outcomes, rather than limiting themselves to "health-related" quality of life or physical disease .
Investigators have initially attempted to adapt tools from conventional quality of life research, e.g., the SF-36 , but these standardized measures limit their scope to pre-selected functional aspects of physical and emotional health. Furthermore, the SF-36 may be better at differentiating sick from healthy people than in assessing degrees of illness or levels of wellness . The domain of CAM outcomes includes not only disease and absence of disease as in conventional medical research, but also levels of wellness . This philosophical orientation overlaps with the World Health Organization's (WHO) definition of health as: "Health is not only the absence of infirmity and disease, but also a state of physical, mental, and social well-being" http://www.who.int/aboutwho/en/definition.html. Ideally, outcome measures for any type of health care, CAM/IM or conventional, should capture the full scope and integration of global well-being status.
Measures such as the Functional Assessment of Chronic Illness Therapies (FACIT) offer some advantage over the SF-36 in that the FACIT includes a module on spirituality [10, 11]. Even the FACIT, however, highlights coping with chronic disease rather than optimizing well-being. Many persons report their use of CAM as a preventive rather than treatment strategy ; thus, evaluating their outcomes requires determination of change not only in negative, but also positive, areas of life. Positive subscales from the Positive and Negative Affect Scale  and the Positive States of Mind Scale [14, 15] may address some of these mental and emotional outcomes.
In addition to these multi-item measures, researchers and clinicians in CAM/IM and conventional medicine need global rating scales for providers and patients that are better tailored to the full picture of purported clinical outcomes. A brief subjective scale, amenable to multiple ratings over extended periods of time, permits minimally-burdensome tracking of day-to-day or month-to-month change in overall well-being. The Arizona Integrative Outcomes Scale (AIOS) was developed as a first step in a program of developing and validating a set of outcome measures for research on CAM/IM care . This simple scale also offers the possibility of clinical applications in tracking treatment progress.
The Arizona Integrative Outcomes Scale (AIOS) is a one-item, visual analogue self-rating scale (VAS) with two alternate forms (one for daily ratings, AIOS-24h; and one for monthly ratings, AIOS-1m)(see Additional file: 1). The instructions are: "Please reflect on your sense of well-being, taking into account your physical, mental, emotional, social, and spiritual condition over the past 24 hours [over the past month]. Use an X on the line to mark your answer to the question. Mark the line below with an X at the point that summarizes your overall sense of well-being for the past 24 hours [for the entire month]." The horizontally-displayed VAS is 100 mm in length, with the low anchor being, "Worst you have ever been" and the high anchor being, "Best you have ever been." We evaluated the AIOS against various other measures in three substudies, all of which were reviewed and approved by the University of Arizona Institutional Review Board.
SUBSTUDY 1: CLINICAL SAMPLE: AIOS, Global Health, and Clinical Status Measures
The goal of this substudy was to evaluate the concurrent validity of the AIOS. Trochim  defines concurrent validity as an instrument's ability to distinguish between groups that it should theoretically be able to distinguish. Hence, this study focused on patients in an outpatient rehabilitation clinic and their caregivers, visitors, and staff. A secondary rationale for using a rehabilitation patient population was the likelihood that they would have been in process of change over the previous month, thereby permitting some comparison of the 24-hour and 1-month forms (concomitantly completed) as a cross-sectional indicator of sensitivity to change. We determined the relationship of the AIOS well-being ratings to participants' current medical status and prescription medication use, as well as ratings of global physical health.
Subjects and Procedures
Data were collected on 100 subjects using a convenience sampling methodology. Since one of the aims of this study was to determine whether the AIOS could distinguish between relatively unhealthy people and relatively healthy people, the sample was purposefully split into two groups, unhealthy subjects (registered patients, both inpatient or outpatient) (n = 50) and relatively healthy subjects (caregiver controls, who were either clinic staff or those visiting or accompanying the registered patients) (n = 50).
The present research was conducted in a rehabilitation hospital located in a large southwestern city (Tucson, AZ). Permission was granted from the clinic coordinator to approach registered patients, visitors and clinic staff for the current study. During the ten-month period from August 2000, to May 2001, a member of the study team made weekly visits to the clinic to elicit participation from potential subjects. Participants were required to be English-speaking, cognitively-intact persons who were at least 18 years of age. Individuals who gave consent to participate were asked to fill out a short questionnaire that focused on their global well-being and health status. Before proceeding, researchers ensured that subjects understood the instructions. Total in-person time with the subjects was approximately 10 minutes. After completing the questionnaire, research staff thanked subjects for their participation and answered any questions they had about the nature of the research.
In addition to completing the two forms of the AIOS, all subjects reported their age, gender, any medical diagnoses, co-morbidities  and current prescription medications. Registered patients' medical diagnoses, number of co-morbidities, and current prescription medications self-reported information were checked for accuracy against their medical records with their permission.
Overall physical health status
Single-item global health ratings have demonstrated consistently to be meaningful indicators of mortality and have better predictive validity for mortality and physical disease outcomes than physician ratings [18–23]. Using a Likert-type five-point scale where 1 is 'poor' and 5 is 'excellent', respondents were asked to rate their overall physical health 'right now.'
Analysis of covariance, controlling for age, was conducted in order to detect differences between rehabilitation patients and healthy caregivers on the AIOS, the global health rating, number of co-morbidities, and current prescription medications. Chi-square analyses were used to examine differences between groups for gender. Paired t-tests were used to compare scores within each group for the two different time frames of the AIOS. Concurrent validity of the AIOS was examined by means of calculating Pearson correlation coefficients between the AIOS and the global physical health rating within each group and across all subjects. The global health rating served as a criterion variable (e.g., poorer ratings of overall physical health should correlate negatively with higher ratings of global well-being on the AIOS).
Both groups were similar in gender (62 % (31/50) patients were women; and 52% (26/50) caregivers were women). However, there were significant differences between the two groups with respect to age (mean age of patients = 65.0, SD 14.7; mean age of caregivers = 49.8, SD 17.3: t(97) = -4.7, p < 0.001). Consequently, age was controlled for in all between-group analyses. The majority of patients had no other illnesses (n = 23; 46%), 14 others reported at least one other co-morbidity, and 13 others had more than one, but no more than four health conditions. Fifty-four percent of the caregivers reported no co-morbidities (n = 32), 14 reported at least one other health condition, and four reported more than one, but no more than four. A chi-square test of independence was performed to examine the relationship between number of co-morbidities and group membership. Results indicate a non-significant relationship between these variables, X2 (8, N = 100) = 11.97, p = 0.15. Although patients overall had more co-morbid conditions, they were no more likely to have substantially more conditions than their healthy counterparts. The majority of patients were in rehabilitation for musculoskeletal reasons (76%), followed by stroke rehabilitation (12%) and other miscellaneous conditions (16%) (e.g., post-myocardial infarction, pneumonia). One-way analysis of variance revealed significant between-group differences in the average number of current prescription medications (mean for patient group = 4.2 SD 3.1; mean for caregivers = 1.0 SD 1.6: F1.97 = 42.1, p < 0.001). Within the caregiver group, those who were visitors did not differ on the outcome variables from those who were facility staff members.
Table 1 displays mean scores for the scales. An analysis of variance controlling for age revealed that patients reported significantly lower global well-being and overall physical health status than did caregivers (F2,98 = 5.0, p < 0.01). Paired t-tests revealed that scores on the AIOS-24h were significantly different from those on the AIOS-1m within the patient group (t(48) = 4.8, p = 0.001) but not within the caregiver group.
Table 2 summarizes the correlation coefficients for the primary variables by group and across all participants. For patients, the AIOS-24h and AIOS-1m correlated significantly with each other, and with ratings of current physical health, but neither correlated with the number of comorbid conditions. AIOS-1m, but not AIOS-24h, correlated significantly with the number of prescription medications in the patient group. The caregivers also demonstrated significant correlations between their AIOS-24h and AIOS-1m scores and the global health rating. Neither of the two AIOS scales revealed significant associations with number of comorbidities or with number of prescription medications in the caregiver group.
Finally, correlations of AIOS-24h and AIOS-1m were significantly different between the two groups (patients r = 0.33; caregivers r = 0.64; t = -2.01, p = 0.02). The latter observation suggests that caregivers' perceived their well-being more similarly for both time frames than did the rehabilitation patients.
SUBSTUDY 2: UNIVERSITY STUDENT SAMPLE: AIOS, Global Health and Distress Ratings
The purpose of this substudy was to examine the convergent validity of the AIOS by comparing it with self-report measures of global physical health status and self-reported psychological distress in young, healthy persons. We hypothesized that better global well-being, as indicated by higher AIOS scores, would be associated with less psychological distress, as indicated by lower scores on the Brief Symptom Inventory (BSI).
Subjects and Procedures
A total of 458 undergraduate college students enrolled in an introductory level psychology course at the University of Arizona completed a set of questionnaires detailed below as part of a larger mass survey. As such, students were assumed to understand instructions associated with our questionnaires. The sample included 188 males with a mean age of 18.9 SD 1.8 and 270 females with a mean age of 19.2 SD 3.6.
Global Well-being and Global Physical Health
As in Substudy 1, subjects completed the AIOS and the Global Current Health Rating Scale.
Psychological distress was measured by the well-validated Brief Symptom Inventory . Respondents are asked to rate 53 items about how distressed s/he felt on a variety of symptoms "over the past week, including today" using a five-point scale (0–4) anchored at one end by not at all (0) to extremely (4) at the other end. The BSI yields nine primary symptom dimensions and three global indices of distress. One of these global indices, the global severity index (GSI), is considered to be the single best predictor of a respondent's level of psychological distress and was therefore the only subscale used for analysis in this study. Test-retest reliability for the GSI of 0.90 has shown the instrument to be stable .
The following single-item yes/no question was included: "Do you currently use, or have you ever used, alternative forms of medicine (i.e., herbs, massage, acupuncture, etc.)?"
Data analyses used were independent sample t-tests, chi-square analyses and linear regression analysis.
Means and standard deviations for each of the scales are presented in Table 3. Cronbach's alpha for the BSI in this sample was 0.97. Scores on the BSI in this sample were comparable to previously established college student norms .
According to Derogatis , psychological distress is indicated by T-scores 63 or above on the GSI. Thirteen percent of the 458 participants (n = 58) scored greater than 63 for their T-score of their GSI, slightly higher than the 10% observed in population controls. Psychologically distressed students reported significantly lower scores than non-distressed students on the AIOS-24h (t(456) = 5.6, p < 0.001); AIOS-1m (t(456) = 6.3, p < 0.001); and self-rated current health (t(456) = -2.5, p < 0.01). Psychologically distressed participants were no different in their use of CAM from non-distressed individuals (X2(1,N = 456) = 0.47, p = 0.49).
Table 4 shows correlation coefficients between the AIOS and each the study variables. Each version of the AIOS (past 24 hours and 1 month) correlated positively with the global health rating. Convergent validity was supported by the significant relationship between higher levels of global well-being and lower scores of psychological distress on the BSI global severity index. Spearman correlation coefficients revealed a negligible association between CAM use and global well-being AIOS ratings.
Although CAM use was weakly associated with ratings of poorer overall physical current health, it was not correlated with lower ratings of global well-being as measured by the AIOS. Poorer overall physical health status also correlated negatively with BSI global severity index. Conversely, better physical health status was associated with higher ratings of global well-being for both the past 24 hours and the past 30 days.
A simultaneous regression analysis was conducted using BSI T-GSI and current self-rated global health as independent variables to explain variance in AIOS ratings. Although the overall model was significant (F 4,455= 75.89, p < 0 .001), the amount of variance that was explained in the AIOS-24h ratings was fair (R 2 ADJ = 25%). AIOS-24h scores were negatively related to psychological distress (B = -0.09) and positively related to current global health status (B = 5.7). Both variables were significantly different from zero (BSI T-GSI: t(455) = -8.0, p < 0.001; current health status; t(455) = 7.0, p < 0.001).
The same model was run for AIOS-1m scores. The overall model was significant (F 4,455 = 65.8, p < 0.001) and explained slightly less variance than for the AIOS-24h ratings (R 2 ADJ = 22%). AIOS-1m scores were negatively related to psychological distress (B = -1.0) and positively related to current health status (B = 5.5). Both variables were significantly different from zero (T-GSI: t(455) = -8.0, p < 0.001; current health status: t(455) = 6.0, p < 0.001).
SUBSTUDY 3: UNIVERSITY STUDENT SAMPLE: AIOS, Positive and Negative Mood, Positive States of Mind Ratings
Based on the results from the previous substudies, this substudy was conducted to explore the extent of additional variance in AIOS scores that positive dimensions could explain in a healthy population. Previous research has focused on variables measuring negative dimensions and has concluded that lack of negative experiences or reported symptoms are associated with better states of overall well-being. In order for the AIOS to be considered a useful and unique addition to outcome tools currently available, it must provide a more complete picture of factors that contribute to global well-being. Thus, we hypothesized that the AIOS not only would be inversely correlated with measures of negative affect and psychological distress, but also positively correlated with measures of positive affect and states of mind dimensions.
Subjects and Procedures
Sixty-two undergraduate college students enrolled in an international studies course at the University of Arizona completed the AIOS and other instruments, with an instructor available to help answer any questions.
Positive and Negative Affect Scales (PANAS)
The PANAS is a 20-item questionnaire designed to measure positive and negative affect with little overlap . Subjects are instructed to rate each item on a 5-point scale reflecting the extent to which they experienced the emotion during the past 24 hours. The scale for each item ranges from 0 (very slightly or not at all) to 4 (extremely). The two subscales have been demonstrated to have sound psychometric properties. Higher positive affect scores correlate with better perceived CAM effectiveness in patients with chronic pain or cancer .
Positive States of Mind Scale (PSOMS)
The PSOMS was included based on findings that positive states of mind have been shown associated with better general perceptions of health . This measure is designed to detect subtle changes in the ability to achieve and appreciate positive experiences. It provides a discrete measure of seven specific states (including focused attention, productivity, sharing, responsible caretaking, restful repose, sensuous nonsexual and sexual pleasure) as a summation of the individual's ability to achieve each of these positive states of mind within the last 7 days. The response categories used to rate each state range from 0 to 3 where 0 represents an inability to achieve the state and 3 represents full attainment. Cronbach's alpha has been reported at 0.65 in a university sample .
Descriptive statistics for this sample are provided in Table 5. Overall AIOS and global current health were somewhat lower in this sample, while psychological distress was greater in this sample as compared with students from Substudy 2.
Correlations between the AIOS and the global current health rating, BSI GSI, PANAS, and PSOMS are presented in Table 6. The data support our hypothesis that the AIOS scale would be positively related with both the PSOMS and the positive subscale of the PANAS. We also found evidence to support our other prediction that higher AIOS scores signifying greater overall well-being would be inversely related with negative affect and greater psychological distress. Only the AIOS-24h version was significantly associated with ratings of current overall global physical health status.
Variables were selected as candidates for a simultaneous regression analysis based on the level of significance of the bivariate association with the dependent variable. The total amount of variance explained in AIOS-24h scores was approximately 37% (adjusted R2) (F 5,53 = 7.8, p < 0.001). For this sample, the positive pole of the PANAS was a significant predictor (B = 1.04, p <0 .007). Psychological distress on the BSI global severity index was marginally significant (B = -10.7, p < 0.06). Analyzing the AIOS-1m ratings yielded slightly different result, but was still an overall significant model explaining 57% of the variance (F 5,48 = 12.6, p < 0.001). Both the positive and negative poles of the PANAS were the only significant predictors (B = 1.06, p < 0.007, B = -1.46, p <0 .003, respectively).
The AIOS is a simple visual analogue scale useful for assessing global well-being in both research and clinical samples. The scale is quick to administer in both clinically-ill and non-clinical healthy populations. Future studies need to examine the acceptability and feasibility of using the AIOS, given the possibility that some populations may experience difficulty comprehending the instructions for completing a visual analogue scale format. Taken together, the present findings indicate that the AIOS captures not only less self-perceived disease and negative mood, but also greater physical health and positive dimensions of mental and emotional states. As a single item, the AIOS could lend itself to repeated measure or time-series analyses for examining patterns over time for documenting natural history and CAM/IM treatment responses within a wide range of conditions [28, 29]. Establishing temporal stability of the AIOS via test-retest reliability would be useful when constructs such as well-being are hypothesized to remain relatively stable across time. However, shifts in levels of well-being that can be attributed to treatment effects would yield weak test-retest reliability estimates. Therefore, depending on the intended use of the AIOS, either high or low test-retest reliability would be expected.
In Substudy 1, the AIOS distinguished rehabilitation outpatients with mixed diagnoses from caregiver controls at the same facility. The cross-sectional data also reveal convergent findings that suggest using the two different time-frame forms of the AIOS may detect fluctuations or shifts in condition. That is, the correlation coefficient for the 24-hour and 1-month forms was significantly greater among caregivers than patients. Moreover, only the AIOS-1m score for patients correlated with the number of prescription medications. Such findings would be consistent with the expected change toward improved health and well-being in the patients in rehabilitation treatment, but not the controls, over the course of the previous month. Patients may have begun the month more ill and needing more medications, but their current sense of their overall well-being was greater than it was one month ago. Prospective research is needed to confirm these types of changes over time in rehabilitation patients and other clinical and non-clinical populations.
Previous research has shown that spouse caregivers of seriously ill persons suffer from subclinical to clinical depression at increased rates . The caregiver sample in this study was not chosen to reflect idealized mental, emotional, or physical health; they simply were not patients at the facility. For discriminant validity, it was important to demonstrate that the AIOS could differentiate varying degrees, rather than only extremes, of health status. The data available in this study do not permit detailed comprehensive evaluation of the component domains of the well-being item, i.e., spiritual, social, mental, emotional, and physical. Additional health outcomes research should focus on developing systematic approaches to identifying these types of individualized needs and preferences and implementing the most appropriate, complementary interventions, which together may improve overall well-being and facilitate achieving very high scores on the AIOS.
A number of prospective studies suggest that self-rated global health status is a better predictor of not only mortality, but also health care utilization, than are more "objective" clinical laboratory data, physician examinations, or professional assessments [18, 19, 31, 32]. Thus, while Substudy 1 limitations include a lack of laboratory data correlations, the availability of the global health ratings and chart lists of co-morbidities and medications enrich interpretation of the meaning of the AIOS self-ratings.
The AIOS scores for the relatively healthy caregiver controls from Substudy 1 and the college students from Substudies 2 and 3 demonstrate that these individuals were far from optimal in well-being (mean scores around 60 out of a possible 100 mm). The lack of ceiling effects for non-patients in the present study is encouraging for using the AIOS in CAM/IM outcome and prevention studies outside clinical settings. That is, the scale allows the potential for a major degree of improvement in self-rated well-being above and beyond the relative lack of diagnosed health problems.
As intended, data from Substudies 2 and 3 indicate that the AIOS captures domains other than just global physical health. The correlations between both AIOS forms and the global current health rating were only moderate, not high, in patients, caregivers, and college students. In addition to physical health, lower levels of psychological distress as well as higher levels of positive mood were especially associated with better AIOS self-ratings in young adult college students. The small differences on well-being, health, and distress ratings between the Substudy 2 and 3 college students may relate, in part, to sampling from different members of the overall university population (e.g., issues stemming from university plans to phase out the program in which those in Substudy 3 were enrolled).
It will be important to extend this research to specific patient groups, including those with major psychiatric problems or with various homogeneous chronic disease diagnoses, studied over periods of months. The possible correlations between the AIOS variable of global well-being and standardized measures of quality of life and of health care satisfaction merit investigation. It may be instructive to examine the relative amounts of variance in AIOS self-ratings for which scores on standardized instruments covering each of the separate spiritual, social, mental, emotional and physical domains account [10, 11, 33].
The purpose of these studies was to validate a visual analogue rating scale for global well-being, to use in outcomes research on diverse patient and non-patient populations. This type of scale avoids the pitfall of presuming how each individual may weight the importance of specific items or functions for him/herself on a quality of life scale. Moreover, during CAM/IM treatment, even some persons with terminal medical conditions and severe physical disability nonetheless report achieving a high level of life satisfaction and general sense of well-being. Physically-disabled patients report CAM/IM use at higher rates than do the general population . The AIOS provides a means for simple, quick assessment of well-being for daily or monthly use. The next step will be to evaluate the sensitivity of the AIOS to change in prospective studies.
- CAM/IM or CAIM:
complementary and alternative medicine/integrative medicine
Arizona Integrative Outcomes Scale (24 h = 24-hour form
- 1 m:
Brief Symptom Inventory
Global Severity Index of the Brief Symptom Inventory
Positive and Negative Affect Schedule
Positive States of Mind Scale
Short Form (36 item) of the Medical Outcomes Scale
Functional Assessment of Chronic Illness Treatment Scale
Visual Analogue Scale
- B sbw:
B Standardized beta weights
Eisenberg D.M., Davis, R.B., Ettner, S.L., Appel, S., Wilkey, S., Van Rompay, M., Kessler, R.C.: Trends in alternative medicine use in the US, 1990-1997. Results of a follow-up national survey. JAMA. 1998, 280: 1569-1575. 10.1001/jama.280.18.1569.
Astin JA: Why patients use alternative medicine: results of a national study.[comment]. Jama. 1998, 279: 1548-1553. 10.1001/jama.279.19.1548.
Gould A., MacPherson, H.: Patient perspectives on outcomes after treatment with acupuncture. Journal of Alternative and Complementary Medicine. 2001, 7: 261-268. 10.1089/107555301300328133.
Paterson C., Britten, N.: In pursuit of patient-centred outcomes: a qualitative evaluation of MYMOP, MeasureYourself Medical Outcome Profile. Journal of Health Services Research & Policy. 2000, 5: 27-36.
Paterson C: Measuring outcome in primary care: a patient-generated measure, MYMOP, compared to the SF-36 health survey. BMJ. 1996, 312: 1016-1020.
Bell IR, Caspi O, Schwartz GE, Grant KL, Gaudet TW, Rychener D, Maizes V, Weil A: Integrative medicine and systemic outcomes research: issues in the emergence of a new model for primary health care. Archives of Internal Medicine. 2002, 162: 133-140. 10.1001/archinte.162.2.133.
Jonas W.B., Levin, J.S.: Essentials of Complementary and Alternative Medicine. 1999, Philadelphia, Lippincott Williams and Wilkins
Ware J.E., Sherbourne, C.D.: The MOS 36-item short-form health survey (SF-36). Medical Care. 1992, 30: 473-483.
Kane RL: Understanding Health Care Outcomes Research. 1997, Gaithersburg, MD, Aspen
Cella D, Nowinski CJ: Measuring quality of life in chronic illness: the functional assessment of chronic illness therapy measurement system. Archives of Physical Medicine & Rehabilitation. 2002, 83: S10-7. 10.1053/apmr.2002.36959.
Peterman Amy H., Fitchett George, Brady Marianne J., Hernandez Lesbia, Cella David: Measuring spiritual well-being in people with cancer: The Functional Assessment of Chronic Illness Therapy-Spiritual Well-Being Scale (FACIT-Sp). Annals of Behavioral Medicine. 2002, 24: 49-58. 10.1207/S15324796ABM2401_06.
Baldwin CM, Long K, Kroesen K, Brooks AJ, Bell IR: A profile of military veterans in the southwestern United States who use complementary and alternative medicine: implications for integrated care. Archives of Internal Medicine. 2002, 162: 1697-1704. 10.1001/archinte.162.15.1697.
Watson D., Clark, L.A., Tellegen, A.: Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology. 1988, 54: 1063-1070. 10.1037//0022-35220.127.116.116.
Horowitz M., Adler, N., Kegeles, S.: A scale for measuring the occurrence of positive states of mind: a preliminary report. Psychosomatic Medicine. 1988, 50: 477-483.
Adler N.E., Horowitz, M., Garcia, A., Moyer, A.: Additional validation of a scale to assess positive states of mind. Psychosomatic Medicine. 1998, 60: 26-32.
Trochim WMK: The Research Methods Knowledge Base. 2nd ed. 2001, Cincinnati, OH, Atomic Dog Publishing
Katz J.N., Chang, L.C., Sangha, O., Fossel, A.H., Bates, D.W.: Can comorbidity be measured by questionnaire rather than medical record review?. Medical Care. 1996, 34: 73-84. 10.1097/00005650-199601000-00006.
Idler EL, Kasl S: Health perceptions and survival: do global evaluations of health status really predict mortality?. Journal of Gerontology. 1991, 46: S55-65.
Idler E., Benyamini, Y.: Self-rated health and mortality: A review of twenty-seven community studies. Journal of Health and Social Behavior. 1997, 38: 21-36.
Long M.J., Marshall, B.S.: The relationship between self-assessed health status, mortality, service use, and cost in a managed care setting. Health Care Management Review. 1999, 24: 20-27.
Bath PA: Self-rated health as a risk factor for prescribed drug use and future health and social service use in older people. Journals of Gerontology Series A-Biological Sciences & Medical Sciences. 1999, 54: M565-70.
Menec VH, Chipperfield JG, Perry RP: Self-perceptions of health: a prospective analysis of mortality, control, and health. Journals of Gerontology Series B-Psychological Sciences & Social Sciences. 1999, 54: 85-93.
Mossey JM, Shapiro E: Self-rated health: a predictor of mortality among the elderly. American Journal of Public Health. 1982, 72: 800-808.
Derogatis Leonard R., Melisaratos Nick: The Brief Symptom Inventory: An introductory report. Psychological Medicine. 1983, 13: 595-605.
Cochran C.D., Hale, W.D.: College student norms on the Brief Symptom Inventory. Journal of Clinical Psychology. 1985, 41: 777-779.
Derogatis Leonard R.: BSI: The Brief Symptom Inventory: Administration, Scoring, and Procedures Manual. 1993, Minneapolis, National Computer Systems, Inc.
Owens JE, Taylor AG, Degood D: Complementary and alternative medicine and psychologic factors: toward an individual differences model of complementary and alternative medicine use and outcomes. Journal of Alternative & Complementary Medicine. 1999, 5: 529-541.
Gottschalk A, Bauer MS, Whybrow PC: Evidence of chaotic mood variation in bipolar disorder.[comment]. Archives of General Psychiatry. 1995, 52: 947-959.
Woyshville MJ, Lackamp JM, Eisengart JA, Gilliland JA: On the meaning and measurement of affective instability: clues from chaos theory.[erratum appears in Biol Psychiatry 1999 Apr 15;45(8):following 1081]. Biological Psychiatry. 1999, 45: 261-269. 10.1016/S0006-3223(98)00152-8.
Cummins Robert A.: The subjective well-being of people caring for a family member with a severe disability at home: A review. Journal of Intellectual & Developmental Disability. 2001, 26: 83-100. 10.1080/13668250020032787.
Bath PA: Self-rated health as a risk factor for prescribed drug use and future health and social service use in older people. Journal of Gerontology, Series A. 1999, 54: M565-70.
Menec V.H., Chipperfield, J.G., Perry, R.P.: Self-perceptions of health: a prospective analysis of mortality, control, and health. Journal of Gerontology Series B. 1999, 54: P85-93.
Adams TB, Bezner JR, Drabbs ME, Zambarano RJ, Steinhardt MA: Conceptualization and measurement of the spiritual and psychological dimensions of wellness in a college population. Journal of American College Health. 2000, 48: 165-173.
Krauss HH, Godfrey C, Kirk J, Eisenberg DM: Alternative health care: its use by individuals with physical disabilities. Archives of Physical Medicine & Rehabilitation. 1998, 79: 1440-1447.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6882/4/1/prepub
The authors thank Health South Rehabilitation Center, Tucson, AZ, for allowing access to their facility in performing this study. This study was supported in part by NIH grants K24 AT00057 (IRB), R21 AT00315 (IRB), and P50 AT00008. Its contents are solely the responsibility of the authors and do not necessarily represent the official views of NCCAM or NIH. The findings were presented in part at the International Scientific Conference on Complementary, Alternative, and Integrative Medicine Research, San Francisco, CA, May 17–19, 2001.
IRB developed the AIOS scale and designed the validation substudies in collaboration with VC, OC, PM, and LF. VC and LF developed and implemented the study data collection and management protocol. OC coordinated Substudy 1. PM served as a consultant regarding the psychometric and statistical analyses, which VC performed. All authors contributed to and reviewed the final manuscript.