Documente Academic
Documente Profesional
Documente Cultură
com
www.elsevier.com/locate/bt
The Negative Self-Portrayal Scale (NSPS) is a new questionnaire designed to assess the extent to which individuals
are concerned that specific self-attributes they view as being
deficient will be exposed to scrutiny and evaluation by
critical others in social situations. These concerns have been
proposed to drive symptoms of social anxiety and account
for individual differences in social fears and avoidance
behaviors (Moscovitch, 2009). Here, we introduce the NSPS
and examine its factor structure and psychometric properties across two large samples of North American undergraduate students with normally distributed symptoms of
social anxiety. Exploratory and confirmatory factor analyses supported a 3-factor solution representing concerns
about (a) social competence; (b) physical appearance; and
(c) signs of anxiety. The NSPS was found to have good
internal consistency and test-retest reliability, strong convergent validity, and adequate discriminant validity. In
addition, NSPS total scores accounted for a significant
proportion of unique variance in self-concealment (i.e.,
safety) behaviors over and above established symptom
measures of social interaction anxiety, social performance
anxiety, and depression. Results are discussed in relation to
theoretical models of social anxiety and the potential utility
of the NSPS for both clinical research and practice.
184
Method
participants
Two groups of nonoverlapping undergraduate
participants (n = 225; n = 316) at a large, urban
Canadian university completed a series of online
questionnaires in exchange for partial course credit.
Initial Item Generation
An initial pool of 62 NSPS items was constructed by
the authors. These were then sent via electronic mail
to three independent Ph.D.-level scientist-practitioners with expertise in social anxiety research and
extensive experience treating individuals with SAD in
clinical settings. Assessors were given a randomized
list of the preliminary items along with an instruction
sheet defining the four hypothesized (Moscovitch,
2009) dimensions of self-attribute concerns (i.e.,
concerns about social skills and behaviors; concerns
about visible signs of anxiety; concerns about
physical appearance; and concerns about personality). Assessors were instructed to eliminate any items
that seemed redundant or unclear, add items they
thought were appropriate, and indicate the dimension in which they thought each self-attribute item
belonged, according to the definitions given to them.
Any items eliminated or misallocated by more than
one assessor were removed from the respective
inventory. Any new items that were suggested by at
least one assessor were added to the NSPS item pool,
provided they were face valid and nonredundant
with other items already on the list. Following this
process, 11 items were removed and 6 items were
added, resulting in a total of 57 NSPS items.
measures
Negative Self-Portrayal Scale (NSPS)
Participants were administered the 57-item NSPS.
Instructions to respondents asked them to rate the
degree to which they are concerned about certain
aspects of themselves when in anxiety-provoking
social situations. Response options per item ranged
from 1 to 5, with descriptive anchors listed as not at
all concerned to extremely concerned. There
were no reverse-scored items; higher scores represented greater self-portrayal concerns.
Self-Concealment Behaviors Inventory (SCBI)
The SCBI is a self-report measure of self-concealment
(i.e., safety) behaviors. This measure is essentially an
expanded version of the unpublished Social Behaviour Questionnaire (SBQ; Clark, Butler, Fennell,
Hackmann, McManus, & Wells, 1995; see also
McManus et al., 2009). Given that the SBQ is an
unpublished scale with unknown psychometric
properties, we chose to add items deemed by
185
186
brief self-report scale that measures concerns associated with obsessive-compulsive disorder (e.g., I get
upset if objects are not arranged properly; I collect
things I don't need; etc.). Respondents are asked to
rate how much each item distresses or bothers them
on a scale from 0 (not at all) to 4 (extremely). The
OCI-SV has been found to have excellent test-retest
reliability (r = 0.820.84), good convergent validity
(r = 0.530.85 with other measures of OCD), and
high internal consistency (Cronbach's alpha indices
of 0.81 to 0.93) (Foa et al., 2002). Of note, however,
was Foa and colleagues' (2002) finding that the
OCI-SV had a high correlation (r = 0.70) with the
Beck Depression Inventory, a conceptually distinct
measure of depression.
Beck Depression Inventory II (BDI-II; Beck, Steer,
& Brown, 1996)
The BDI-II is a 21-item self-report instrument for
assessing the intensity of depression in diagnosed
patients and detecting symptoms of depression in
normal populations. Respondents are instructed to
choose the statement amongst a group of statements that best applies to how they generally feel.
Each group of statements ranges from 0 (e.g., I do
not feel sad) to 3 (e.g., I am so sad or unhappy that I
can't stand it). The BDI-II has consistently been
shown to have adequate test-retest reliability
(r = .60.83 in nonclinical samples and r = .48.86
in clinical samples), good convergent and discriminant validity (e.g., the BDI-II has been found to be
significantly more strongly correlated with depression relevant measures, such as the Beck Hopelessness Scale, than with measures of anxiety, p b .01),
and high internal consistency (Cronbach's alpha
indices of 0.76 to 0.95 in clinical populations and
.73 to .92 in nonclinical populations; Osman,
Barrios, Gutierrez, Williams, & Bailey, 2008).
procedure
All questionnaires were administered in online
sessions via a standardized web-based automated
computer program that was designed to protect
results
Descriptive Analyses
Demographic information (reported age, gender,
and ethnicity) for participants in Groups 1 and 2
are presented in Table 1. A MANOVA with gender
as the grouping variable was conducted for Groups
1 and 2. There were no significant effects of gender
on any of the measures, F(6, 218) = 1.67, p N .05, for
Table 1
Demographic Characteristics of Participants
Group 1
Group 2
45.5%
29.9%
12.9%
3.6%
8.0%
47.8%
32.6%
4.3%
4.3%
10.9%
Note. Due to some missing data that could not be imputed, Ns vary for Groups 1 and 2.
187
Table 2
Internal Consistency, Means and (Standard Deviations) of Study Measures
Measure
NSPS
SCBI
SPS
SIAS
LSAS-SR-F
LSAS-SR-A
BDI-II
OCI-SV
Group 1
Group 2
Cronbach's
Mean (SD) 1
Cronbach's
Mean (SD) 1
0.96 2
0.96
0.93
0.93
0.93
0.91
0.93
0.89
57.95 (21.61)
101.64 (23.30)
20.07 (14.74)
29.71 (16.15)
25.41 (12.51)
23.76 (12.93)
11.52 (9.74)
16.64 (10.82)
0.96 2
0.95
0.95
0.90
0.92
0.90
0.93
0.89
60.89 (23.30)
99.21 (22.65)
20.29 (15.88)
31.50 (14.16)
26.06 (11.96)
23.35 (12.13)
11.47 (9.54)
15.90 (10.73)
Note. Ns = 225 (Group1) and 316 (Group 2). NSPS = Negative Self-Portrayal Scale; SCBI = Self-Concealment Behaviors Inventory;
SPS = Social Phobia Scale; SIAS = Social Interaction Anxiety Scale; LSAS-SR-F = Liebowitz Social Anxiety Scale Self Report Version Fear Subscale; LSAS-SR-A= Liebowitz Social Anxiety Scale Self Report Version - Avoidance Subscale; BDI-II = Beck Depression
Inventory II; OCI-SV = Obsessive Compulsive Inventory Short Version.
1
Based on 27-item NSPS.
2
Despite the high internal consistency values, the highest correlation between any two of the retained NSPS items across both samples
was r = .80, suggesting non-redundancy between the items.
188
Table 3
Rotated Factor Loadings from Pattern Matrix for Non-Discarded Items of the Negative Self-Portrayal Scale for Group 1
Item
Social Competence
21. Socially awkward
24. Lacking social skills
12. Lacking personality
10. Interpersonally ineffective
14. Unable to express myself
18. Reserved
17. Humorless
23. Speaking incoherently
20. Stupid
19. Aloof
3. Boring
Physical Appearance
27. Ugly
5. Physically unattractive
11. Weird-looking
13. Fat
26. Unfashionable
9. Blemished (i.e., my appearance)
22. Having a bad hair day
2. Poorly dressed
Signs of Anxiety
8. Speaking with a trembling voice
25. Fidgeting
1. Stuttering
15. Twitching (i.e., my facial muscles)
16. Frozen
6. Losing control of my emotions
4. Sweating
7. Blushing
Social Competence
Physical Appearance
Signs of Anxiety
Communalities
1.00
.95
.76
.74
.72
.66
.63
.56
.55
.53
.50
-.07
-.04
.18
.03
-.08
-.02
.08
.09
.24
.13
.13
-.11
-.09
-.08
.09
.13
-.06
.12
.20
-.04
.04
.09
.77
.75
.71
.67
.58
.37
.60
.63
.51
.43
.44
-.01
-.03
.07
-.10
.17
.08
.00
.07
.97
.93
.80
.72
.66
.64
.58
.46
-.12
-.10
.02
.07
-.01
.05
.19
.14
.80
.73
.75
.47
.61
.53
.51
.38
-.02
-.05
-.16
.10
.32
.16
.04
.29
-.02
.02
.01
-.06
.01
.09
.07
-.05
.82
.79
.73
.64
.51
.50
.49
.24
.62
.58
.41
.46
.59
.46
.32
.21
55.11%
Note. NSPS instructions to respondents read: Using the scale provided above the following list of items, please select the circle under the
appropriate number/statement to indicate the degree to which you are concerned about the following aspects of yourself when you are in
anxiety-provoking social situations (e.g. talking to someone who is a stranger; giving a speech in front of an audience; answering a
question in class; etc.). For each item, respondents are asked to consider the following statement: In social situations (in which I feel
anxious), it will become obvious to other people that I am ____. Response options per item range from 1-5, with descriptive anchors
including not at all concerned, slightly concerned, moderately concerned, very concerned, and extremely concerned. The NSPS total
score is a sum score of all items. Each subscale can also be summed separately to obtain data on the relative strength of self-portrayal
concerns across dimensions within individuals and across individuals within a larger sample.
189
FIGURE 1 Confirmatory factor analysis of the NSPS 3-factor model for Group 2. Items are labelled with I = item and
the corresponding number from the NSPS items shown in Table 3. All factor loadings had a p-value b .001 (2-tailed).
190
191
NSPS
Total
NSPS Social
Competence
NSPS Physical
Appearance
NSPS Signs
of Anxiety
SCBI
.77
.73
.73
.72
.62
.58
.72
.64
.69
.73
.65
.67
.58
.62
.64
.68
.77
.76
.69
.71
.71
.73
.55
.55
.58
.61
.71
.75
.68
.67
.66
.68
.56
.52
.60
.59
.76
.76
.63
.65
.62
.66
.52
.51
.57
.56
.75
.75
.65
.53
.60
.50
.54
.45
.58
.48
.61
.50
.47
.40
.44
.37
.33
.35
.49
.37
.45
.43
Note. Ns = 225 (Group 1) and 316 (Group 2). NSPS = Negative Self-Portrayal Scale; SCBI = Self-Concealment Behaviors Inventory;
SPS = Social Phobia Scale; SIAS = Social Interaction Anxiety Scale; LSAS-SR-F = Liebowitz Social Anxiety Scale Self Report Version Fear Subscale; LSAS-SR-A= Liebowitz Social Anxiety Scale Self Report Version - Avoidance Subscale; BDI-II = Beck Depression
Inventory II; OCI-SV = Obsessive Compulsive Inventory Short Version.
All correlations for Groups 1 and 2 are based on the 27-item NSPS.
p b .001 (2-tailed).
Table 6
Summary of Hierarchical Regression Analysis for Variables Predicting Levels of Social Self-Concealment on the SCBI
Predictor
Step 1
SIAS
Step 2
SIAS
SPS
Step 3
SIAS
SPS
BDI
Step 4
SIAS
SPS
BDI
NSPS
SE B
Group 1
Group 2
Group 1
Group 2
Group 1
Group 2
1.04
1.02
0.07
0.05
0.72
0.75
0.44
0.83
0.57
0.63
0.10
0.10
0.07
0.07
0.31
0.53
0.42
0.45
0.41
0.65
0.55
0.55
0.59
0.16
0.09
0.11
0.12
0.07
0.08
0.10
0.28
0.41
0.23
0.41
0.42
0.07
0.22
0.54
0.25
0.39
0.44
0.46
0.08
0.24
0.09
0.10
0.12
0.06
0.07
0.08
0.09
0.05
0.15
0.34
0.10
0.36
0.32
0.32
0.03
0.24
Note. SIAS = Social Interaction Anxiety Scale; SPS = Social Phobia Scale; BDI-II = Beck Depression Inventory II; NSPS = Negative SelfPortrayal Scale; SCBI = Self-Concealment Behaviors Inventory.
Group 1: N = 225; R2 = .516 for Step 1 (p b .001); R2change = .108 for Step 2 (p b .001); R2change = .035 for Step 3 (p b .001); R2change = .050 for
Step 4 (p b .001).
Group 2: N = 316; R2 = .565 for Step 1 (p b .001); R2change = .087 for Step 2 (p b .001); R2change = .003 for Step 3 (p N .05); R2change = .024 for
Step 4 (p b .001).
p b .05.
p b .001.
192
Discussion
The results of the present study suggest that the
NSPS is a psychometrically strong and potentially
useful instrument for measuring concerns that
individuals have about exposing specific negative
self-attributes to critical others in anxiety-provoking social situations. The NSPS represents a novel
assessment tool in the social anxiety field that goes
beyond measuring the level or types of social
3
We also analyzed the psychometric properties of the NSPS for
the Caucasian (n = 102 in Group 1; n = 132 in Group 2) and Asian
(n = 67 in Group 1; n = 90 in Group 2) groups separately:
193
complete pencil-and-paper measures in the laboratory might feel. Consequently, although previous
studies comparing online and paper administrations of questionnaires have shown that online
measures are highly reliable (e.g., Luce, Winzelberg,
Das, Osborne, Bryson, & Taylor, 2007), it would
be prudent to replicate our study with paper
questionnaires. In addition, our use of multiple
sessions for completion of the study measures may
have introduced additional variability into the
study associated with participants fluctuating
circumstances and moods across testing sessions.
Furthermore, despite the wide range of reported
symptoms of anxiety and depression in our study,
the overall mean levels of these symptoms were
quite low; thus, it is impossible to know whether
and how the NSPS findings reported here would
generalize from the present participants to clinical
samples. Moreover, because our unselected samples
of participants were comprised predominantly of
young, female, university-educated, and socioeconomically advantaged individuals, we cannot infer
that the results would generalize to samples of
individuals with different compositions of demographic characteristics.
As highlighted by some of the reported differences between Asian and Caucasian participants in
the present study, it is crucial to note that, because
individuals self-portrayal concerns depend on the
standards and norms for social behavior and
because such standards and norms vary considerably across cultures (e.g., Markus & Kitayama,
1991), it is likely that the NSPS is a culturally bound
measure. Thus, whereas the values of one culture
might dictate that its members make humorous
remarks or witty conversation during social gatherings in order to appear socially competent, the
values of another culture might dictate that social
competence is reflected in one's ability to remain
silent during social gatherings, constrain the desire
to speak out, and practice listening respectfully to
the elders of the community. In other words, what
might appear socially incompetent according to the
norms of one society might appear quite competent
according to the norms of another. Similarly, there
are, no doubt, variations across cultures in standards of physical appearance and norms associated
with showing signs of anxiety, which in turn would
dictate cross-cultural differences in the relevance of
and responses to the present version of the NSPS.
Therefore, it would be both interesting and
important to examine the cross-cultural applicability of the NSPS in future research.
Although replication of our results is clearly
required in both clinical samples of SAD patients
and community samples of healthy and anxious
194
195
196