Sunteți pe pagina 1din 6

A New Psychosocial Screening Instrument for Use With

Cancer Patients

JAMES ZABORA, SC.D., KARLYNN BRINTZENHOFESZOC, D.S.W.


PAUL JACOBSEN, PH.D., BARBARA CURBOW, PH.D.
STEVEN PIANTADOSI, M.D., PH.D., CRAIG HOOKER, B.S.
ALBERT OWENS, M.D., LEONARD DEROGATIS, PH.D.

The authors performed a principal components factor analysis on the 18-item Brief Symptom In-
ventory (BSI-18), a new brief screening inventory. The factor analysis, in which four factors were
specified, is consistent with findings in a previous community sample. The study sample consisted
of 1,543 cancer patients who completed the full BSI as part of their entry into care at a regional
cancer center. The reliability of the BSI-18 was determined based on the calculation of the inter-
nal consistency, mean item scores, and correlations with the total score of the BSI. In addition,
sensitivity and specificity was calculated to determine the ability of the BSI-18 to discriminate
positive and negative cases. The BSI-18 is a shortened version of the BSI that can serve as a
brief psychological screening instrument. The BSI-18 can be incorporated into outpatient clinics
to prospectively and rapidly identify cancer patients with elevated levels of distress who are in
need of clinical interventions. Early identification of distress with appropriate interventions can
reduce distress, enhance quality of life, and decrease health care costs.
(Psychosomatics 2001; 42:241–246)

O ften the distress associated with the diagnosis of can-


cer may not become manifest to the health care team
until the patient reaches an observable crisis event.1 Fre-
tion may be significantly less than the costs of adverse
medical events and unnecessary hospitalizations related to
elevated distress.
quently, referrals to psychosocial providers occur when the Several prevalence studies7–9 suggest that one of every
patient is severely depressed or anxious, is suicidal, or is three newly diagnosed cancer patients will experience sig-
experiencing significant conflicts with the family.2 Al- nificantly higher levels of distress and may benefit from
though psychosocial interventions at acute points in a pa- social work, psychological, or psychiatric intervention.10
tient’s care have been shown to be effective, the question Table 1 details the three major studies related to psycho-
remains whether an early psychological screening program logical distress among cancer patients. Given a relatively
would enable health care providers to identify patients at consistent prevalence of distress at approximately 30%, use
risk for distress associated with a cancer diagnosis.3,4 If so, of structured interviews or assessments in large-volume
clinical interventions could be initiated during the early
Received April 28, 2000; revised November 27, 2000; accepted Novem-
phase of care rather than at crisis events.5 Because psycho- ber 29, 2000. From The Johns Hopkins Oncology Center, Baltimore, MD;
logical distress may actually increase health care costs and the H. Lee Moffitt Cancer Center, Tampa, Florida; and the University of
prolong medical treatments,6 early identification and inter- Maryland, Baltimore, MD. Address reprint requests to Dr. Zabora, The
Johns Hopkins Oncology Center, 600 North Wolfe Street, Baltimore, MD
vention may also produce a significant financial benefit. 21287.
The costs associated with early identification and interven- Copyright 䉷 2001 The Academy of Psychosomatic Medicine.

Psychosomatics 42:3, May-June 2001 241


Screening Instrument

clinics may require a significant amount of staff time with in order to test the ability of the BSI-18, a recently abbre-
a low positive case yield. Self-report measures for the pur- viated version of the scale,15 to successfully identify dis-
pose of screening offer a valuable alternative for cancer tressed cancer patients. An analysis was conducted to cal-
centers that see a high number of cancer patients per year culate the alpha for the BSI-18 in an oncology population.
and wish to screen for psychological distress.11 After this analysis, the BSI-18 was subjected to a principal
Given these initial issues, screening should not be con- components factor analysis. This analysis was conducted
fused with assessment. Screening is a rapid method to pro- by specifying four factors consistent with the recent find-
spectively identify patients who may potentially experi- ings of Derogatis,15 in an effort to further support the struc-
ence significant difficulty in their attempts to cope and tural hypothesis of the BSI-18 in a cancer population.
adapt to their diagnoses and treatments. Screening is a pre-
dictive model. Assessment seeks to accomplish a series of
tasks in the early phases of a relationship with a patient. Measures
These tasks include an estimate of the severity of the pa-
tient’s distress, definition of the initial course of action,
development of a dynamic understanding of the patient, Brief Symptom Inventory The full BSI is a 53-item mea-
the establishment of a diagnosis, and the first step in the sure of psychological distress that contains three global
development of a therapeutic relationship.12 scales and nine subscales.16 The BSI is written at a sixth-
Any method of psychosocial screening must be brief grade reading level and only requires 5 to 7 minutes to
and pragmatic. Although improvements in screening tech- complete. Each item is rated on a 5-point Likert scale from
niques continue to be developed, further research is nec- 0 (not at all) to 4 (always). The patient is asked to respond
essary to identify brief, simple, and accurate tools to ac- to each item in terms of “how they have been feeling during
complish this vital task. Through screening, the early the past 7 days.” Positive cases can be identified by a
incorporation of psychosocial and behavioral interventions Global Severity Index (GSI) score of ⱖ63 or any two sub-
in cancer treatment may be more readily accepted by pa- scales where the T-score is ⱖ63.14 The BSI has been used
tients and less stigmatizing.13 In addition, these interven- in prevalence studies related to psychological distress9,17
tions complement cancer therapies and may enhance medi- and has been tested for its efficacy as a screening instru-
cal outcomes while reducing the overall costs of health ment against the omega instruments that are based on the
care.6 variables previously defined.3 In addition, the BSI pos-
sesses characteristics that are more suitable for screening
METHODS than other instruments, such as the General Hospital Ques-
tionnaire or the Hospital Anxiety and Depression Scale.18
Sample Table 2 details the psychometric properties of the BSI.
Each BSI subscale consists of 4–7 items that account
Since 1988, staff in a comprehensive cancer center for 49 of the overall 53 items. Four additional items (poor
have experimented with psychosocial screening in an effort appetite, trouble falling asleep, thoughts of death and dy-
to develop a prospective model of psychosocial care with ing, and feelings of guilt) load on more than one factor but
early identification of risk linked to appropriate interven- remain separate from the 9 subscales. These 4 configural
tions. Since the inception of these efforts, approximately items have been maintained as part of the BSI due primar-
10,000 psychological profiles have been amassed through ily to their clinical predictive significance. For example,
the use of the Brief Symptom Inventory (BSI).14 For this “poor appetite” loads on both the depression and somati-
project, cases beginning in January 1995 were selected in zation factors and can have discriminate significance re-
succession until an acceptable sample size was constructed garding the nature of depressive symptoms.

TABLE 1. Prevalence studies of psychological distress among cancer patients


Authors Year Measures N Rates of Distress
7
Derogatis et al. 1983 SCL-90 and psychiatric interview 215 47% received a DSM-III diagnosis: 68% of these were adjustment disorders
Farber et al.8 1984 SCL-90 141 34% had elevated distress scores
Stefanek et al.9 1987 BSI 126 28% demonstrated moderate to high psychosocial distress

242 Psychosomatics 42:3, May-June 2001


Zabora et al.

Application of a Scale for Use With a Cancer Population cancer diagnoses were as follows: breast (19.9%), prostate
(13.0%), leukemia (9.8%), lymphoma (9.7%), lung (5.5%),
To validate the use of a scale on a specific population head and neck (4.5%), pancreatic (4.1%), gynecological
(i.e., generalize its valid use in that population), a number (3.8%), and brain (2.1%). These cases represent patients
of issues must be considered. First, the scale, as a measure seen from 1995 to 1998, and the BSI forms from this time
of a concept such as distress, should be practical and ac- period were computer scanned so that individual item re-
ceptable to patients, clinicians, and investigators. Practi- sponses could be analyzed. Table 3 presents characteristics
cality and acceptability can be achieved through short com- of the sample used in the analysis of the BSI-18.
pletion time, understandable directions and items, and low
costs for administration of the scale. Second, the funda- Reliability and Validity of the BSI-18 MeansⳲstandard
mental principles of validity must be established for the deviations for the 18 items and total score for the sample
population. Finally, scales must minimize measurement er- are given in Table 4. In addition, internal consistency re-
ror. Scales with measurement error produce the potential liability was examined for the BSI-18 and the 53-item BSI.
for bias and misinterpretation of results.19 Cronbach’s alpha was 0.89 for the BSI-18 and 0.95 for the
full BSI. The BSI-18 total score was significantly corre-
Statistical Analyses lated with the GSI of the BSI with r⳱0.84 (P⬍0.001).
Item-to-total correlations ranged from 0.34 to 0.70.
As mentioned previously, internal consistency of the
BSI-18 in a cancer population was established through the Principal Components Factor Analysis A factor analysis
calculation of Cronbach alphas. In addition, the total score of the BSI-18 was conducted on our sample of 1,543 cancer
on the BSI-18 was correlated with the GSI raw score of patients, which consisted of a principal components anal-
the full BSI. We subjected the 18-item BSI to a principal ysis with a varimax rotation. Four factors were identified
component factor analysis with a varimax rotation while that had eigenvalues greater than (or very close to) 1.0 and
specifying four factors. Values are meansⳲstandard devi- met the scree test for retention. The four factors accounted
ations for each item calculated. The total variance ac- for 57.8% of the variance in the matrix. The factor pattern
counted for by the BSI-18 was also calculated. Finally, the matrix from this analysis is given in Table 5.
sensitivity and specificity were calculated to determine the The results of this analysis of the BSI-18 strongly con-
capability of the BSI-18 to discriminate positive from neg- firm the hypothesized dimensional structure of the instru-
ative cases, and the positive predictive value was derived.20 ment and are very similar to a factor analysis reported by
Derogatis15 on a community sample of 1,134 individuals.
RESULTS That analysis also isolated four factors that met retention
criteria and accounted for 57.2% of the variance. Much as
Sample Our test sample consisted of 1,543 cancer pa- was with the case of the Derogatis15 analysis with com-
tients with a mean age of 55.5Ⳳ14.5 (range⳱14–90 munity individuals, even though the BSI-18 was hypoth-
years). The majority of the sample were men (52.0%). Be- esized to support a three-dimensional structure, the ob-
cause consecutive cases were used, over 35 different di- served four-dimensional solution fits well with the test’s
agnoses were represented in the total sample. The top ten hypothesized dimensional composition.

TABLE 2. Critical elements of the Brief Symptom Inventory


Number of
Items Global Scales Subscales Psychometrics
53-item Global Severity Index (GSI) Somatization Alphas ⳱ 0.71 to 0.85
5 point Likert Positive Symptom Hostility Test-retest coeff. 0.68 to 0.91
Distress Index Anxiety Convergent validity ⳱ r’s between the SCL-90 and the
Positive Symptom Depression BSI subscales range from 0.92-0.98
Total Phobic anxiety Construct validity ⳱ Principal components factor analysis
Interpersonal Sensitivity accounted for 44% of variance
Obsessive-compulsive
Paranoid ideation
Psychoticism

Psychosomatics 42:3, May-June 2001 243


Screening Instrument

TABLE 3. Characteristics of sample for analysis of the BSI-18 The first factor identified in the present analysis is
(Nⴔ1,543) clearly the anxiety factor, with 5 of the BSI-18 anxiety
Gender n(%) items demonstrating heavy loadings on this factor. Factor
Men 802(52.0) I accounted for approximately 20% of the variance in the
Women 741(48.0) matrix. Unexpectedly, the anxiety item, “Feeling so restless
Age
⬍ 20 14(0.9)
I couldn’t sit still” did not load on Factor I but instead
20-29 63(4.1) loaded on the second factor. In addition, the depression
30-39 175(11.3) item “Feeling lonely” showed a split loading on this factor
40-49 277(18.0)
and the second factor.
50-59 368(23.8)
60-69 380(24.6) Factor II is a very explicit representation of the BSI-
70-79 239(15.5) 18 depression factor. Five of the six hypothesized depres-
80 Ⳮ 27(1.7) sion items showed saturated loadings on this factor, which
Primary Diagnosis
Breast 302(19.9) accounted for an additional 17% of the variance. Of the
Lung 83(5.5) hypothesized depression items, only “Suicidal ideation”
Colon 84(5.5) did not load on Factor II.
Prostate 197(13.0)
Hodgkin’s 25(1.6)
Factor III demonstrates high loadings on all six items
Lymphoma 147(9.7) of the hypothesized somatization dimension of the BSI-18
Leukemia 149(9.8) and little else. Much as was the case in Derogatis’ test15 of
Liver 14(0.9)
the hypothesized structure in a community population, the
Melanoma 13(0.9)
Adenocarcinoma 21(1.4) somatization dimension showed almost perfect empirical
Brain 32(2.1) confirmation. Factor III accounted for 14% of the variance.
Head and neck 69(4.5) The fourth factor isolated in the analysis fell just short
Pancreas 62(4.1)
Gynecological 58(3.8) (0.98) of the eigenvalue retention criteria of ⱖ1.0, although
Multiple myeloma 31(2.0) it did pass the scree test. The final factor revealed only one
Kidney 27(1.8) item (“Suicidal ideation”) as correlating strongly with the
dimension and accounted for almost 7% of the variance.
Interestingly, although loadings fell slightly below the cut-
off for reporting (i.e., ⱖ0.40), the two items of “Feelings
of terror and panic” (0.38) and “Suddenly scared for no
reason” (0.35) both showed mild correlations with this di-
TABLE 4. BSI-18 item mean scores, standard deviations, and
factor loadings (Nⴔ1,543)
TABLE 5. BSI-18 factor pattern matrix (Nⴔ1,543)
BSI-18 Item Standard Factor
Number Mean Deviation Loading BSI-18 item
number Factor 1 Factor 2 Factor 3 Factor 4
1 0.31 0.69 0.408
2 0.41 0.77 0.732 18 0.771 0.307 3.E-02 3.8E-02
3 0.91 1.01 0.582 3 0.762 –9.E-03 0.246 –3.E-02
4 0.27 0.68 0.413 6 0.704 0.351 0.185 –1.E-02
5 0.42 0.77 0.691 8 0.638 0.505 0.129 2.0E-03
6 0.85 0.97 0.739 9 0.613 0.231 0.150 0.348
7 0.62 0.97 0.463 12 0.595 0.186 0.222 0.378
8 0.68 0.86 0.775 5 0.543 0.541 4.E-02 –2.E-02
9 0.24 0.64 0.678 11 0.132 0.740 0.191 0.199
10 0.35 0.76 0.446 14 0.364 0.623 0.163 0.218
11 0.23 0.61 0.651 15 0.293 0.613 0.164 0.140
12 0.20 0.63 0.663 2 0.386 0.597 0.218 0.188
13 0.58 0.92 0.431 16 0.118 0.403 0.679 –0.157
14 0.48 0.85 0.726 10 8.E-02 7.9E-02 0.666 0.284
15 0.35 0.70 0.644 4 0.159 –7.E-02 0.632 0.370
16 0.84 1.06 0.576 1 0.169 4.9E-02 0.620 –2.E-02
17 0.09 0.39 0.408 7 0.129 0.237 0.564 3.2E-02
18 0.72 1.02 0.707 13 6.E-02 0.383 0.493 –0.244
BSI-18 Total 8.42 8.62 17 7.E-02 0.335 4.E-02 0.721

244 Psychosomatics 42:3, May-June 2001


Zabora et al.

mension. This finding is analagous to the fourth factor re- cussion of characteristics of various standardized scores is
ported in the community population,19 which combined given elsewhere.24
items reflecting panic and suicidal thoughts. Suicidal ru- To identify appropriate cutoff scores for the BSI-18,
minations are a unique aspect of psychopathology that re- the cases were separated by gender. In examining the dis-
cent research (e.g., Vollrath et al.21) has demonstrated are tribution of the scores and what is known about the prev-
often associated with panic states, just as they are known alence of distress using the 53-item BSI with this popula-
to accompany serious depression. Confronted with a di- tion,17 the 25th percentile was used to determine the cutoff
agnosis of cancer, and all the potential hardships that such point for caseness. For men, the 25th percentile fell at a
a diagnosis implies, it is understandable that vulnerable score of 10, and for women, it fell at 13. To further sub-
individuals may experience panic, and with it, some cog- stantiate the norms for the BSI-18, sensitivity and specific-
nitive ruminations of an ultimate means of escape. ity were calculated to determine how well the BSI-18 iden-
The current analysis provides strong confirmation of tified positive cases using a score of 10 for men and 13 for
the hypothesized dimensional structure of the BSI-18 in an women. These results are detailed in Table 6. Finally, given
oncology population. In doing so, the results not only com- a sensitivity of 91.2% and a specificity of 92.6%, the posi-
plement prior research with the instrument in a community tive predictive value (PPV) for the BSI-18 was also cal-
population, but these results demonstrate a substantial level culated (Sens/1-Spec), which produced a PPV of 12.32.
of construct generalizability.22 Any PPV ⬎10 indicates that a test has a strong likelihood
for positive case identification.
Scoring the BSI-18 Standardized scores were developed
in psychometrics primarily to facilitate comparisons of the DISCUSSION
standing or performance of an individual on some attribute
of interest (e.g., depression, intelligence, well-being, etc.) These results furnish significant support for the use of the
to a relevant reference group (e.g., newly diagnosed cancer BSI-18, a new psychosocial screening instrument, with
patients). In a clinical application, such “norms” enable us cancer patients. Principal components factor analysis
to better judge how distressed or ill a patient is, as well as showed confirmation for the hypothesized dimensional
better appreciate the magnitude and significance of any composition. The significant correlations between the BSI-
change observed over the course of treatment. 18 total score and the GSI score of the 53-item BSI sub-
Norms for the BSI-18 have been developed by the stantiates the continuity of the BSI-18 in identifying the
author of the BSI-1815 for the three primary dimension psychological distress construct.
scores (somatization, depression, and anxiety) and the
Global Severity Index (GSI) from approximately 1,500 Significance of the Findings Given that 30% of all cancer
cancer patients in the current sample. In addition, com- patients experience elevated levels of psychological dis-
munity norms are also available.19 In recognition of the tress, early identification of vulnerable patients is essential
consistent observation that manifestations of symptomatic to their comprehensive management. Undetected and un-
distress differ substantially across men and women,14 all treated distress creates the potential for patients to medi-
norms are gender keyed. calize psychological symptoms and greatly complicates
As was the case with both the SCL-90-R23 and the treatment of the primary neoplastic disorder. Because the
BSI,14 parent instruments to the BSI-18, the metric selected focal point of care is the tumor site, patients are often re-
to serve as the standardized score for the BSI-18 is the area luctant to consistently reveal their distress to members of
T-score. The area T-score is characterized like all T-scores the health care team. Patients may perceive that a diversion
by a distribution with a mean of 50 and a standard deviation from the tumor to focus on an emotional response may
of 10 but possesses substantial advantages over linear stan-
dardized scores. Because area transformations are normal- TABLE 6. Sensitivity and specificity of the BSI-18 (Nⴔ1,543)
izing transformations, the area T-scores carry with them BSI-53 GSI
meaningful and interpretable percentile equivalents. An
Case No Case
area T-score of 60 always places the respondent in the 84th Case 91.2% 7.4%
percentile, while a score of 70 is equivalent to the 98th BSI-18 250 94
percentile. This is true of linear standardized scores only No Case 8.8% 92.6%
24 1,175
when the underlying distribution is normal. A detailed dis-

Psychosomatics 42:3, May-June 2001 245


Screening Instrument

jeopardize the outcome of their cancer therapy. Given the care. These steps can be achieved within the first or second
high patient volumes in many cancer centers, little time, if outpatient visit, and psychosocial services can be incor-
any, is available for the health care team to assess the emo- porated as a component of comprehensive cancer care. The
tional concerns of every patient. Further, even when con- reliability and validity of this instrument support the use
cerns are detected, the patient has often reached a crisis of the BSI-18 as a psychological screening instrument for
state, and the increased distress has become apparent to use with cancer patients. Future prospective studies will
members of the team. At this point, referrals for psycho- determine the test-retest reliability and more specific pre-
social care occur when the patient is agitated, acutely de- dictive validities of the BSI-18 for this patient population.
pressed, or suicidal.2 Although clinical interventions can Psychosocial screening not only provides the oppor-
tunity to prospectively link patients to specific psychoso-
be effective at these crisis points, the major question is,
cial services, but use of a standardized screening instru-
“Could these patients be identified as being high risk early
ment such as the BSI-18 can also serve as a baseline
in the course of their cancer treatment?” thus allowing ear-
measure. Consequently, if patients with a high level of dis-
lier initiation of preventive interventions.
tress are directly referred to a counseling service, a stan-
These findings are an important step in the develop- dardized measure such as the BSI can be administered
ment of a prospective psychosocial care delivery system upon completion of the intervention. In effect, the screen-
for cancer patients. The BSI-18 is a brief tool designed to ing instrument serves as the pretest measure triaging to the
identify high-risk patients in the actual clinical setting intervention and as a posttest measure to determine any
where cancer therapies are delivered. Given the brevity and change in the psychological status. For psychosocial pro-
simple scoring, the BSI-18 can be easily incorporated into grams to survive in a managed care environment, psycho-
the clinic registration areas and yields an outcome that al- social services must also position themselves to compete
lows support staff to initiate a referral for psychosocial for mental health capitated contracts.

References

1. Weisman AD, Worden JW: The existential plight in cancer: sig- social interventions in cancer care. Arch Gen Psychiatry 1995;
nificance of the first 100 days. Int J Psychiatry Med 1977; 7:1–15 52:100–113
2. Rainey LC, Wellisch DK, Fawzy FI: Training health care profes- 14. Derogatis LR: The Brief Symptom Inventory (BSI): Administra-
sionals in psychosocial aspects of cancer: a continuing education tion, Scoring and Procedures Manual, 3rd Edition. Minneapolis,
model. Journal of Psychosocial Oncology 1983; 1:41–60 MN, National Computer Systems, 1993
3. Weisman AD, Worden JW, Sobel HJ: 1980 Psychosocial screen- 15. Derogatis LR: BSI-18: Administration, Scoring and Procedures
ing and interventions with cancer patients: a research report. Bos- Manual. Minneapolis, MN, National Computer Systems, 2000
ton, MA, Harvard Medical School, 1980 16. Derogatis LR, Melisaraatos N: The Brief Symptom inventory
4. Zabora JR, Smith-Wilson R, Fetting JH, et al: An efficient method (BSI): an introductory report. Psychol Med 1983; 13:595–606
for the psychosocial screening of cancer patients. Psychosomatics 17. Zabora JR, BrintzenhofeSzoc KM, Smith ED: Prevalence of psy-
1990; 31:192–196 chological distress by cancer site. Proceedings of the American
5. Zabora JR, Loscalzo MJ: Comprehensive psychological programs: Society of Clinical Oncology 1996; 15:507–507
a prospective model of care. Oncology Issues 1996; 11:14– 18 18. Zabora JR: Screening procedures for psychosocial distress, in The
6. Allison TG, Williams DE, Miller TD, et al: Medical and economic Handbook of Psycho-Oncology, edited by Holland JC. New York,
costs of psychological distress in patients with coronary artery Oxford University Press, 1998
disease. Mayo Clin Proc 1995; 70:734–742 19. Blythe BJ: Measurement of Direct Practice. Thousand Oaks, CA,
7. Derogatis LR, Morrow GR, Fetting JH, et al: The prevalence of Sage, 1989
psychiatric disorders among cancer patients. JAMA 1983; 20. Dawson-Saunders B, Trapp RG: Basic and Clinical Biostatistics.
249:751–757 Norwalk, CT, Appleton and Lange, 1994
8. Farber JM, Weinerman BH, Kuypers JA: Psychosocial distress of 21. Vollrath M, Koch R, Angst J: The Zurich study IX. Panic disorder
oncology patients. Journal of Psychosocial Oncology 1984; and sporadic panic: symptoms, diagnosis, prevalence and overlap
2:109–118 with depression. Eur Arch Psychiatry Clin Neurosci 1990; 239,
9. Stefanek ME, Derogatis LR, Shaw A: Psychosocial distress 221–230
among oncology outpatients. Psychosomatics 1987; 28:530–539 22. Messick S: Validity of psychological assessment: validation of in-
10. Zabora JR, Smith ED, Loscalzo MJ: Psychosocial rehabilitation, ferences from persons equals responses and performances as sci-
in Clinical Oncology, 2nd Edition, edited by Abeloff MD, et al. entific inquiry into score meaning. Am Psychol 1995; 30, 741– 749
New York, Churchill Livingstone, 2000, pp 2845–2865 23. Derogatis LR: Symptom Checklist-90-R (SCL-90-R) Administra-
11. Derogatis LR: Self-report measures of distress, in Handbook of tion, Scoring, and Procedures Manual, 3rd Edition. Minneapolis,
Stress. New York, Free Press, 1982 MN, National Computer Systems, 1994
12. Tomb DA: Psychiatry for the House Officer, 3rd Edition. Balti- 24. Tatsuoka MM: Selected Topics in Advanced Statistics: Standard-
more, MD, Williams & Wilkins, 1988 ized Scales–Linear and Area Transformations. Champaign, IL, In-
13. Fawzy FI, Fawzy N, Arndt LA, et al: Critical review of psycho- stitute for Personality & Ability Testing, 1969

246 Psychosomatics 42:3, May-June 2001

S-ar putea să vă placă și