Documente Academic
Documente Profesional
Documente Cultură
State University
Marie A. Roman
Northern Illinois University
Situational factors, as facilitators or inhibitors of performance, have only recently received some of the attention lavished on traditional ability and motivation predictors of performance. As a result, expectations regarding progress in understanding situational factors must be moderated by the relative
paucity of research on situational factors. Nonetheless, systematic study of
situational factors holds much promise for providing additional understanding
of performance dynamics. Also, because human resource management professionals often undertake situational changes with the aim of influencing worker
contributions to effectiveness there is a corresponding need for practice to be
informed by research.
Our purpose in writing this article is to stimulate different ways of thinking
about situational constraints, their causes, and how they influence performance. The article is divided into three sections. We begin with a review of
Direct all correspondence
Boone, NC 28608.
Human Resource
Management Review,
Volume 3, Number 2,1993, pages 147-175
All rights of reproduction in any form reserved.
Management
Department,
Appalachian
State University,
Copyright 0 1993
by JAI Press, Inc.
ISSN:1053-4822
148
REVIEW
VOLUME
3, NUMBER
2. 1993
current conceptualizations
of situational constraints. The article then proceeds to a quantitative review of published research on situational constraints.
This section quantitatively
summarizes research on situational constraints,
including the reliability of measures used to represent constraints, and observed relationships between variables that comprise the nomological network
from which construct validity evidence for situational constraints is inferred.
Although the published research on constraints constitutes a relatively small
body of literature, the review serves as a first attempt at quantitative summary of empirical evidence relevant to the hypothesized relationships between
constraints and other constructs. Finally, in the last section of the article, we
introduce some alternative conceptualizations
of constraints with the aim of
stimulating alternative ways of thinking about constraints and the conduct of
research involving the constraint concept.
CURRENT
CONCEPTUALIZATION
OF CONSTRAINING
FACTORS
Attempts to improve performance efficiency through the manipulation of situational factors served as a catalyst to the scientific study of work behavior and
stimulated work redesign interventions (e.g., Gilbreth 1909). However, subsequent progress in conceptualizing
situational factors that influence performance was not commensurate with the scope of activity undertaken to change
situational factors in specific circumstances. And, although situational factors
were widely acknowledged
as having significant practical implications for
work behavior, no model of performance explicitly incorporated situational
factors as a determinant of performance until the seminal work of Campbell,
Dunnette, Lawler, and Weick (1970). In their model, Campbell et al. include
situational constraints as one component of task demands that interact with
individual differences, training and development experiences,
and reward
structures to influence job behavior, and subsequently job performance.
In
1976, Campbell and Pritchard characterized situational performance determinants as facilitating and inhibiting conditions not under the control of the
individual. This latter characterization was more inclusive as it allowed for the
possibility that situational factors could promote or impede performance.
However, aside from the recognition afforded situational factors in these
models, no noticeable progress was made in developing taxonomies of situational factors. Situational factors were roughly categorized as stemming from
different levels of aggregation, the task characteristics, work setting, or organization. Further description of the dimensions that constitute them, whether
these dimensions were generalizable
across levels of aggregation or other
achievement-related
contexts, or whether they were situationally specific, remained open to question. More often than not, situational factors were chosen
on the basis of their availability and perceived relevance to the phenomena
studied.
Kahn and Quinns (1970; see also Kahn, Wolfe, Quinn, Snoek, & Rosenthal
1964) resource inadequacy concept was identified as one of several factors
ALTERNATIVE CONCEPTUALIZATIONS
149
thought to contribute to work stress. However, it did not receive the systematic
attention extended to other concepts associated with this framework (e.g., role
conflict and ambiguity). Even though understanding
of job stress has been
limited by the absence of a widely accepted definition of what is meant by
stress (Ivancevich, Matteson, Freedman, & Phillips 1990), the idea that inadequate resources deemed necessary for successful work performance might
serve as a putative cause of stress is both intuitively and logically appealing.
That is, if individuals value achievement and the path to achievement is somehow made more cumbersome by the absence of necessary supports, it seems
reasonable to include inadequate resources as a stressor responsible for some
of the stress symptoms (strains) that might be observed (e.g., decreased satisfaction, higher rates of turnover). However, measures of resource inadequacy
used in stress research have been of limited breadth, including only a small
sample of the potential domain of resources that workers in these studies
might find necessary for successful execution of their work roles. For example,
although these studies have included occupations as diverse as health, bluecollar, and clerical, the items used to measure resource inadequacy have been
limited to including work load, insutlicient job knowledge, and inadequate
time. Thus, although the resource inadequacy concept was an early attempt to
provide operational statement to situational factors that affect work outcomes,
the necessary conceptual and taxonomic work of detailing its component parts
was not pursued with sufficient rigor to make it a promising vehicle for understanding how situational factors impact on performance.
More recently, the work of Peters and OConnor (1980; Peters, OConnor, 8~
Eulberg 1985) has provided operational examples of situational constraints
that influence performance buttressed by more systematic taxonomic efforts.
In a retrospective account of the ideas which occurred to them early in their
research, they stated:
. . . examples of constraining work factors came easily to mind. Factors
such as broken or improper machinery and inadequate supplies quickly
suggested themselves as types of situational factors we had in mind. To be
sure, persons who were both able and motivated should not produce as
much output as their ability and motivation levels suggested . . . (Peters,
OConnor, & Eulberg 1985,pp. 80431).
u
150
HUMAN
RESOURCE MANAGEMENT
REVIEW
KILUME
3. NUMBER
2. 1993
involve the manipulation of three or four of these resource variables. For example, job-related information, required materials, and work environment might
be manipulated so that they are more or less available, of more or less sufficient quantity, and of more or less sufficient quality (cf. Peters, Chassie, Lindholm, OConnor, & Kline 1982; Peters, Fisher, & OConnor 1982b; Peters,
OConnor, & Rudolf 1980). These variables would be manipulated
simultaneously to test main effect hypotheses from this framework (e.g., situational
constraints impede performance and reduce satisfaction). However, such tests
are not very interesting from a theoretical viewpoint because situations which
impede performance can be engineered easily, might overstate the impact of
constraints in actual work settings, and serve only to affirm a tautology. Peters
et al. (1985) correctly concluded that future research on the impact of constraints should largely be investigated in field settings.
Below, we describe a meta-analysis conducted on the findings reported in
the published literature. Meta-analysis is a method of statistically combining
the results of separate studies in order to facilitate conclusions about the
strength of a relationship between two variables. Several different procedures
exist and their suitability depends on the circumstances surrounding a specific
problem area. However, some conventions regarding the appropriate methods
of meta-analysis
are better established today and encourage its more widespread use than had formerly been the case. Initial information sought from a
meta-analysis includes: (a> an estimate of the average magnitude of an effect
observed across studies, typically in the form of a correlation coefficient; (b) a
test or series of tests involving the representativeness
of the estimated average
effect size as it applies to a set of studies; (c) an investigation, if necessary, of
potential factors associated with the studies that may account for differences
in observed effect sizes, and (d) an estimate of the fail-safe N, or the number of
studies finding nonsignificant tests of the hypothesis that need to be observed
in order to threaten the validity of a positive conclusion regarding the hypothesized relationship.
Specifically, the meta-analysis
focuses on the relationship between constraints and outcome variables including: (a) job performance, (b) job satisfaction, (cl frustration, (d) turnover and intentions to leave, and (el organizational
commitment. In addition, mean correlations among these variables are also
estimated based on the reported relationships appearing in the literature germane to situational constraints.
QUANTITATIVE
REVIEW OF SITUATIONAL
CONSTRAINTS
RESEARCH
Method
Literature Search.
The search strategy consisted of a number of components. First, the Social Sciences Citation Index for the period of January 1980June 1987 was searched, guided by the keywords situation, constraints,
ALTERNATIVE CONCEPTUALIZATIONS
151
and conditions. Next, a search was made in Psychological Abstracts for the
period (January 1987-December
1992) employing the key phrases and words
situational constraints, performance obstacles, and stressors. Third, the
reference sections of selected articles were examined for additional studies.
Only English language sources were considered.
Studies were included in the meta-analysis if they met the following criteria:
(a) the study examined the effects of situational factors on employee behavior
and attitudes such as job performance, job satisfaction, frustration, and commitment to the organization; (b) the study provided adequate description of the
sample, measurement
of constructs, analyses, and findings. Studies which
reported only the presence of a significant finding without reporting the effect
size or significance level were excluded from the meta-analysis. Applying these
criteria resulted in the retrieval and coding of 15 studies (see Appendix for a
list of the 15 studies).
Coded Features. The following study characteristics were coded: (a) research
design (experiment/simulation
versus survey), (b) research setting (laboratory/
classroom versus field), (c) nature of respondent sample (students, managers,
or subordinates), (d) sample size, (e) reliability of measurement operations, (f)
criterion measurement strategy (objective, supervisor ratings, or self-ratings
of performance), and (g) zero-order correlations between the variables of interest. These include: (a) ratings of situational constraints, (b) performance ratings, (c) job satisfaction, (d) frustration, (e) turnover, and (f) organizational
commitment.
Data were coded by the first and the second author. Any inconsistencies were discussed until consensus was reached, thereby resulting in complete
agreement.
Procedure. An estimate of the combined, sample-size weighted effect size of all
studies dealing with a particular hypothesized bivariate relationship was determined using the weighted effect size combinatorial procedure suggested by
Hunter and Schmidt (1990). Findings which were reported as t or F values
were converted to zero-order correlations (Rosenthal 1984). When studies reported more than one effect size pertaining to a bivariate relationship, the
effect sizes were averaged to arrive at a single estimate. This was considered
appropriate in light of the desire to maintain independence of the observations
for combinatorial purposes and also because all of the multiple effect sizes from
single studies were generated under similar study conditions. The variance of
the observed coefficients and the variance due to sampling error were computed using formulas from Hunter and Schmidt (1990). Because of missing
information and the large range of criterion reliabilities, the variance of the
coefficients attributable to other artifacts such as range restriction or criterion
unreliability was not estimated. However, this omission may not seriously
affect the accuracy of the variance estimates reported given that previous
studies have found that variance attributable to sample size differences accounts for 90% of artifactual variance (e.g., Pearlman, Schmidt, & Hunter
152
REVIEW
VOLUME
3, NUMBER
2.1993
1980). In the case of one study (Peters et al. 1982) only significance levels were
reported. Thus, the zero-order correlation estimates derived from these values
are conservative estimates.
Results
The sample sizes of the fifteen studies examined here ranged from 70 to
5080 with field studies generally employing larger sample sizes than did laboratory studies which never exceeded 120 subjects. Subjects in the studies included individuals
employed in a wide variety of managerial
and nonmanagerial positions.
Table 1 details measures of the constructs examined in the 15 studies included in the meta-analysis.
Information includes the instruments used to
measure the constructs, the mean reliability estimates, and the range of reliability estimates of the measurement instruments. The mean reliability of
each measure used in the research reviewed here exceeds .70.
Tables 2, 4, 6, 7, and 9 provide summaries of the published studies used in
the meta-analysis including the setting and design of the studies, the sample
size, the number of effect sizes examined in each study, the source (e.g., supervisory, self-ratings) and the form of the performance appraisal data (low or
high judgment measures), and the mean effect size for each study. Also included in each table are the estimates of effect sizes generated from the published tests of the hypothesized relationships, the variance of observed effect
sizes across studies, variance of the sampling error, the 95% credibility interval, a test for homogeneity of effect sizes, and a file drawer estimate of studies
with nonsignificant findings needed to return the aggregated probability level
across studies to .05.
Table 2 reports the estimates of effect size among published studies for the
hypothesized negative effect of situational constraints on performance. The
obtained mean effect size across studies was found to be -.14. Note that while
the 95% credibility interval centers in negative values, it includes the value
.OO, suggesting that the calculated corrected mean effect size is an estimate of
the mean of several population parameters or subpopulations identified by the
operation of moderators (Whitener 1990). This is reflected in two passive observation field studies, Peters, OConnor, Eulberg, and Watson (1988) and Olson
and Borman (1989), both with large sample sizes (971 subjects and 5080 subjects, respectively), that found no relationship between situational constraints
and performance ratings (7. = .OO). Also, in a study of time pressure effects on
performance, Peters, OConnor, Pooyan, and Quick (1984) found a positive correlation between ratings of constraining situations (time pressure and di&
culty) and performance ratings (study effect size = .30).
The test for homogeneity of effects sizes (X2 (10, N = 9273) = 289.75, p <
.Ol) indicates that it is not likely that each observation in this sample of effect
sizes was drawn from the same population. Additionally, sampling error explains only 3.3% of the observed variance in effect sizes. Application of the
Hunter and Schmidt (1990) critical ratio of expected variance due to sampling
153
ALTERNATIVE CONCEPTUAL~~TIONS
Reliability
Constructs
TABLE 1
Used in Situational
and Measures
Constraints,
Peters and OConnor
Goal Difficulty Rating
Time Pressure Ratings
Kahns Job Related Tension Index
Composite Tailored to Study
Satisfaction
Index of Organiza~onal Reactions (Smith, 1976)
Job Descriptive Index (Smith, Kendall, & H&in, 1969)
Job Diagnostic Survey (Hackman & Oldham, 1975)
Hoppack (1935)
Cammann et al.
Bullock Scale (Robinson, Athanasiou, & Head, 1969)
Frustration
Peters et al. (1980) 3 item scale
Composite Tailored to Study
Turnover
Company records @ 12 & 18 months subsequent to
study
Intent (1 item)
Performance
Supervisor Ratings
overall
quality
quantity
Self ratings
Objective indices
Commitment
Porter, steers, Mowday, and Boulian (1974)
Mowday, Steers, and Porter (1979)
Alutto, Hrebiniak, and Alonso (1973)
Constraints
Research
Mean Reliability
Range
.81(4)
.67-.91
.78(14)
.49-.91
.84(8)
.53-.91
.87(5)
.83-.a9
Note. All reliability estimates are coefficient alphas with the exception of one reported for performance which is an inter-rater reliability. Numbers in parentheses refer to the number of observed
reliability estimates used to the compute the mean.
error to observed variance (75%) suggests that substantive moderators as opposed to additional artifacts, may explain considerable variability among observed effect sizes across studies. Because the data were consistent with the Xz
test, the credibility interval application and 75% variance heuristic, moderator
analysis was conducted on the hypothesized relationship between situational
constraints and performance ratings.
Two methodological features of the studies in the meta-analysis were identified and examined for their potential moderating influence on the relationship
between situational constraints and performance: (a) the setting in which the
154
REVIEW
VOLUME
3, NUMBER
2,1993
TABLE 2
Estimates of Effect Size among Published Studies for the Hypothesized Negative
Effect of Situational Constraints on Performance
Setting and
Design
Study
Peters
et al. (1988)
Field Study
Number
of Effect
Sizes
Performance Inokx
(Source)
971
Mean
Effect
Size
.oo
Over-all
(Supervisor)
Field Study
368
Quality,
Quantity,
Over-all,
-.26
and
Objective
(Supervisor
Peters
et al. (1984)
Field Study
164
and Self)
Over-all
.30
(Supervisor)
Steel
and Mento
Field Study
438
(1986)
OConnor
et al.
Field Study
1450
et al. (1982)
Lab Experiment
120
Peters
et al. (1980)
Lab Experiment
70
Parasuraman
and
Field Study
217
Field Study
181
(1984)
et al.
-.21
and Self)
Over-all
-.12
(1984)
Quantity
Over-all
& Quantity
Over-all
-.87
-.29
-.09
(Supervisor)
(1988)
Jamal
and Objective
(Supervisor)
Peters
Allutto
Over-all
(Supervisor
(1984)
Spector
Over-all
-.05
(Supervisor)
Field Study
214
Over-all
-.42
(Supervisor)
Olson
and Borman
(1989)
Field Study
5080
Over-all
.oo
Mean effect size across studies = - .14; Variance of observed effect sizes across studies: ~2 = .03;
Variance of the sampling error: (T,
2 = ,001; 95% Credibility interval: -.47 to .19; Test for homogeneity of Effect Sizes: X2 (10, N = 9273) = 289.64,p < .Ol; File drawer Estimate: N = approximately
66 studies of ns findings (r = .OO) needed to return the aggregated p level across studies to .05.
AL~R~TIVE
155
~ONCEPTUALI~TIONS
number of studies done in the lab and their correspondingly smaller sample
sizes, both of which may contribute to large second-order sampling error
(Hunter & Schmidt 1990). There are too few published studies to allow a more
careful examination of this hypothesis.
The picture for source of constraint ratings is quite similar. While there is a
sizable difference in mean effect size between the subsets, the observed variance is larger in the one subset than the total variance effect size. The increase
in observed within group variance may also be related to the differences in the
relationship between constraint ratings and objective criteria (r = 0 for those
two studies which reported those correlations) and the relationship between
constraint ratings and performance ratings (non-zero).
Table 4 reports the estimates of effect size among published studies for the
hypothesized negative effect of situational constraints on job satisfaction. The
obtained mean effect size across studies was found to be -.32. The 95% credibility interval includes the values of -.46 to -.18. This credibility interval
suggests then, that one would expect to find a non-zero constraint-satisfaction
relationship when conditions in an organization similar to those in the studies
reviewed predominate (Schmitt & Klimoski 1991).
The test for homogeneity of effect sizes (X2 (9, iV = 9273) = 32.46, p < .Ol)
indicates that it is not likely that each observation in this sample of effect sizes
was drawn from the same population. Additionally, sampling error explains
only 28.6% of the observed variance in effect sizes. As for performance, moderator analysis was conducted on the hypothesized relationship between situational constraint and job satisfaction ratings.
One methodological feature of the studies in the meta-analysis was identified and examined for its potentially moderating influence on the relationship
between situational constraint ratings and job satisfaction ratings: the setting
in which the study was conducted (lab/classroom versus field studies).
Table 5 shows the summary of moderator analysis for the situational
TABLE 3
Summary of Moderator Analyses for the
Constraint-Pe~o~~ce
~lationship
Study setting
Lab Studies
Field Studies
i; = -49
CT:= .08
i; = -.05
CT:= .Ol
a,2 =
02 =
e
.004
Source of constraint
Supervisor
.OOl
rating
Subordinate
i = -.17
P = -.04
02 =
.12
02
CT2 =
,004
ue; =
.oos
.OOl
156
HUMANRESOURCEMANAGEMENTREVIEW
VOLUME
3. NUMBER
2. 1993
TABLE 4
Estimates of Effect Size among Published Studies for the Hypothesized Negative
Effect of Situational Constraints on Satisfaction
Setting and
Design
Study
Peters
et al. (1988)
Field Study
N
971
Number
of Effect
Sizes
1
Satisfaction Measure
Satisfaction
Mean
Effect
Size
With
-.32
With
-.28
With
-.36
Work
OConnor et al.
Field Study
1450
Satisfaction
Work
(1984)
OConnor et al.
(1982)
Classroom
Survey
Classroom
237
Satisfaction
Survey
man (1984)
Peters
82
et al. (1982)
Lab Experiment
General
-.55
Satisfaction
120
Satisfaction
With
-.23
and
Field Study
215
Over-All
Satisfaction
70
Satisfaction
-.13
(1987)
et al.
Lab Study
With
-.14
and
Field Study
217
With
-.20
Work
(1984)
et al.
Satisfaction
Field Study
181
Over-All
Satisfaction
-.47
Field Study
215
Over-All
Satisfaction
-.33
(1988)
Jamal
(1990)
Mean effect size across studies = -.32; Variance of observed effect sizes across studies: cr2 = .007;
Variance of the sampling error: (T,2 = .002; 95% Credibility interval: - .46 to - .18; Test for homogeneity of Effect Sizes: Xz (9, N = 3758) = 32.46, p < .Ol;
File drawer Estimate: N = approximately
97 studies of ns findings (r = ,001 needed to return the aggregated p level across studies to .05.
constraint-job satisfaction relationship. The mean correlation for studies conducted in the lab or classroom does not appear to differ greatly from the mean
correlation for studies conducted in the field. Also, the observed variance in the
subgroups is similar to that of all 15 studies. This finding, coupled with the
indications of the credibility interval, suggest that study setting does not have
a moderating effect on the relationship between situational constraints and job
satisfaction. Perhaps an unidentified moderator is responsible for the variance
observed in these effect sizes.
Table 6 reports the estimates of effect size among published studies for the
hypothesized positive effect of situational constraints on frustration. The mean
effect size across studies was estimated to be .39. While the test for homogeneity of effect sizes (X2 (7, N = 3246) = 13.52, p < .lO) indicate that observations in this sample of effect sizes may not be drawn from the same population,
it is important to note that the 95% credibility interval t.30 - .48) suggests
157
TABLE 5
Summary of Moderator Analysis for the
Constraint-Satisfaction Relationship
Study setting
LablClassroom
Studies
Field Studies
i = -.33
r = -.29
$72 =
.015
cr,2=
AI04
ai =
.006
0,2 =
.OOl
Study
Setting and
Design
Number
of Effect
Sizes
FieldStudy
971
O%onnor et al.
(19841
OConnor et al.
(19821
Peters et al. (19823
Field Study
1450
Classroom Survey
237
Lab Experiment
120
Lab Study
70
Parasuraman and
Alutto(1984)
Spector et, al.
(1988)
Field Study
217
Field Study
181
Frustration
Measure
Peters et al.
3 item Scale
Peters et al.
3 item Scale
Peters et al.
3 item Scafe
Peters et al.
3 item Scale
Peters et al.
3 item Scale
4 item Scale
Peters et al.
3 item Scale
Mean
Effect
Size
.42
.36
.49
.30
.25
.41
.51
Mean effect size across studies = .39; Variance of observed effed sizes across studies: u2 = .003;
Variance of the sampling error: W,2 = .OOf; 95% Credibility interval: .30 to .48; Test for homogeneity of Effect Sizes: X2 (6, N = 32461 = 13.52, p < .05; File drawer Estimate: N = approxima~iy
61 studies of ns findings fr = .OO)needed to return the aggregated p level across studies to .05.
158
REVIEW
VOLUME
3. NUMBER
2, 1993
TABLE 7
Estimates of Effect Size among Published Studies for the Hypothesized Positive
Effect of Situational Constraints on Turnover
Study
Peters
Number
of Effect
Sizes
Field Study
971
Intentions
.28
Field Study
1450
Actual
.ll
Setting
and Design
et al. (1988)
OConnor
et al.
Parasuraman
Spector
18 Months
Mean
Effect
Size
After Study
(1984)
AIutto
Turnover
Measure
and
Field Study
217
(1984)
et al.
Actual
1 year
.02
After Study
Field Study
181
Intentions
.57
(1988)
Jamal
(1984)
Field Study
214
Intentions
.24
Jamal
(1990)
Field Study
215
Intentions
.38
Mean effect size across studies = .21; Variance of observed effect sizes across studies: crz = ,017;
Variance of the sampling error: cre
2 = .002; 95% Credibility interval: - .03 to .45; Test for homogeneity of Effect Sizes: Xz (5, N = 3248) = .97, p < .95; File drawer Estimate: N = approximately 25
studies of ns findings (r = .OO) needed to return the aggregated p level across studies to .05.
ris, & Orr 1986). Thus, a search for moderators does not appear to be
necessary.
However, it should be noted that the credibility interval (-.03 to .45) includes a zero value. This is quite likely due to the fact that two of the studies
examined in the meta-analysis, OConnor, Peters, Pooyan, Weekly, Frank, and
Erenkrantz (1984) and Parasuraman and Alutto (1984) measured actual turnover 12 months and 18 months, respectively, after collection of constraint data.
Four other studies which examined the hypothesized constraint-turnover
relationship, Peters, et al. (19881, Spector, Dwyer, and Jex (19881, Jamal (1984), and
Jamal (1990), employed measures of intent to leave as indicators of turnover.
The difference between intent to leave by an employee and the actual subsequent behavior may account for the lack of consistent findings. Thus, analysis
was conducted on the data examining the moderating influence of turnover
measurement technique on the constraint-turnover
relationship (see Table 8).
TABLE 8
Summary of Moderator Analysis of the
Constraint-Turnover Relationship
Turnover Measure
Intended
Actual
P = .37
i = .07
a,2 = .007
up = .002
u,2 = .002
a,2 = .OOl
159
ALTERNATIVECONCEPTUALIZATIONS
The results of the moderator analysis show that the mean correlations between situational constraints and turnover are quite different in the two subgroups. Additionally, the observed variance in the subgroups is less than the
observed variance in effect sizes. Thus, it can be concluded that constraints
appear to be more highly correlated with intentions to leave than with actual
turnover. This is quite likely due to the large number of influences on an
employees decision to terminate his/her employment relationship (i.e., opportunity for alternative employment; cf. Hulin, Rosnowski, & Hachiya 1985).
The estimates of effect size among published studies for the hypothesized
negative effect of situational constraints on organizational commitment are
found in Table 9. The obtained mean effect size across studies was found to be
-.22. The 95% credibility interval, which includes the values of -.37 to -.07
suggests that one would expect to find a non-zero constraint-organizational
commitment relationship given similar conditions to those in the reviewed
studies.
The test for homogeneity of effect sizes (x2 (4, N = 1098) - 28.47, p < .lO)
indicates that observations in this sample of effect sizes may not be drawn from
the same population. Additionally, sampling error explains only 14% of the
observed variance in effect sizes. However, given the small number of studies
which examined the constraint-commitment
relationship, moderator analysis
is not beneficial since any conclusions drawn would be tenuous at best.
Summa/y of Results. The pattern of observed relationships between variables
constituting the nomological network which help define constraints are summarized in Figure 1. The nomological network refers to a network of relation-
TABLE 9
Estimates of Effect Size among Published Studies for the Hypothesized Negative
Effect of Situational Constraints on Organizational Commitment
Study
OConnor et al.
(1982)
Parasuraman and
Hansen (1987)
Parasuraman and
Alutto (1984)
Jamal (1984)
Setting
and Design
Classroom
survey
Field Study
Number
of Effect
Sizes
237
215
Measurement
Method
Porter et al.
Scale
Mowday et al.
Mean
Effect
Size
-.37
-.14
Scale
Field Study
217
Field Study
214
Alutto et al.
Scale
Mowday et al.
-.17
-.17
Scale
Jamal (1990)
Field Study
215
Mowday et al.
-.24
Scale
Mean effect size across studies = -.22; Varianceof observedeffectsizes acrossstudies:02 = .007;
Varianceof the samplingerror: u,2= ,001;95% Credibilityinterval:- .37 to - .07; Test for homogeneity of Effect Sizes:X2 (4, N = 1098) = 28.47, p < .Ol;File drawerEstimate:N = approximately
13 studies of ns findings (r = .OO)needed to return the aggregatedp level across studiesto .05.
160
-08
Situational \
Constraints
REVIEW
VOLUME
3. NUMBER
-28
(3)
2,1!393
(3)
39 (7)
16 (3)
..\
\
/r-l
Commitment
33 (3)
Note: Decimal points are omitted. The number of study effect sizes used to compute
average correlations between measures appear in parentheses.
ships among measures of the constructs that is used to infer the meaning of the
measures used to represent the constructs. To the extent that the pattern of
relationships observed among these measures is consistent with the hypothesized relationships as articulated by a theory or model, greater confidence is
warranted in the theory, concepts, and/or measures. However, if the relationships fail to conform to an expected pattern, the validity of the theory, concepts, and/or measures is suspect.
The correlation coefficients between constraints and outcome variables in
Figure 1 represent the mean effect size estimates reported in the tables. In
addition, correlation coefficients between outcome variables in the figure represent estimates of mean relationships between the outcome variables as reported in the 15 original studies reviewed. Some caution is required in interpreting the displayed relationships, as they are based on a small number of
observed coefficients, not corrected for measurement
error. Just the same,
several observations are worth expanded discussion with respect to their im-
ALTERNATIVE CONCEPTUALIZATIONS
161
162
REVIEW
WLUME
3, NUMBER
2. 1993
constraint and affective self-reports consistent (cf. Salancik & Pfeffer 1977).
Similar logic applies to those instances that solicit performance and constraint
ratings from supervisors. Too few studies have been conducted to derive accurate estimates of the extent to which these relationships are inflated.
The weak evidence of support for the hypothesized relationship between
constraints and performance prompted a reformulation of the framework by
Peters et al. (1985). Peters et al. (1985; Peters & OConnor 1988) proposed four
boundary conditions (Fromkin & Streufert 1976; Lynch 1982) in the form of
additional assumptions that must be present in order for constraints to correlate with performance.
First, the reformulation
assumes that persons are
assigned tasks that require the use of their abilities and motivation (p. 114). If
performance standards are not sufficiently demanding and if performance
standards are not maintained by management, then the impact of low to moderate levels of constraints should have little impact on performance. Second, it
is assumed that organizations value individual performance such that slippage in performance standards is kept to a minimum. Third, the model assumes that individuals cannot easily invoke self-handicapping
explanations
as an excuse for poor performance. That is, the impact of constraints on performance is not compensated for by a supervisor who evaluates individual performance. If supervisors were to adjust performance ratings based on worker
accounts of constraints responsible for poor performance, then essentially, the
impact of constraints on performance would be removed. Finally, given the first
three assumptions are met, the reformulated framework also requires that
resources vary in their availability across individuals. Should resources be
so plentiful that shortage is improbable, then situational obstacles to effective performance can no longer offer a plausible account for performance differences.
In tandem, these conditions characterize what Peters et al. (1985) refer to as
a high performance tension situation in which: (a) people must marshal1
their abilities and motivation in order to succeed, (b) high standards of performance are maintained by management,
(cl excuse-making
for poor performance is an ineffective strategy for altering performance scores, and (d) resource availability is variable across individuals. Performance tension is a
complex notion; it requires that all four conditions described above are present
in a situation. Thus, each assumption is a necessary but not sufficient precondition for the prediction of performance scores from situational constraints
scores.
Limitation of the circumstances in which a relationship is expected to occur
is one response to a series of empirical disconfirmations.
Additional assumptions can reduce confidence in prior nonsupportive research findings and simultaneously expand the domain of questions remaining to be answered. It
might in this way, contribute to the viability of a conceptual framework and
maintain interest in a research program. On the other hand, the failure to
accumulate empirical support for the core propositions of the framework could
also suggest the need for examining constraints through different conceptual
163
ALTERNATIVE CONCEPTUALIZATIONS
alternative
approaches
to con-
164
REVIEW
VOLUME
3, NUMBER
2. 1993
high with respect to connotation (depth of description) and low with respect to
extension (breadth of coverage).
Concept attributes, such as those noted above, serve an essential function
with respect to scientific concepts by delineating the characteristics necessary
for representing the construct. However, our review of the published literature
on constraints indicates that several distinguishing attributes of the concept
have not been investigated, but rather have been assumed to be true. For
example, although defined as uncontrollable, there has been no direct test of
constraint controllability
in field settings, nor any data bearing on whether
responses differ when workers are instructed to consider only the status of
uncontrollable resources versus when they are not provided specific instructions to do so. If constraints are somewhat controllable, then the small effect of
constraints on performance comes as no surprise. Also, the inductive method
used to construct the situational constraints taxonomy coupled with the objective of describing aspects of the immediate work situation appears to have
resulted in a regretfully narrow application of a concept that may generalize to
other levels of aggregation and a greater variety of contexts.
Confusion about the scientific status of the constraint concept, as exemplified by the equivocal meta-analysis findings, is in part due to the absence of
information about these concept attributes. The asking of higher order questions such as those involving causal relations among variables presupposes
satisfactory answers to more basic questions about the phenomena and concepts involved. As a simple example, it seems reasonable that a good representation of concept X needs to be established in a setting before proceeding to
estimate the causal relationship between X and Y. Dillon (1984) notes that the
logic of question sequences has not received much systematic study and that
failure to do so makes some research questions posed by scientists premature
relative to the current status of answers to lower level questions. Quite simply,
the truth value of tests of higher order hypotheses must be buttressed by
supporting tests of subordinate hypotheses. One recommendation
we offer
from the above discussion is that research on constraints needs to proceed
more carefully and systematically with respect to testing fundamental attributes of the concept, perhaps following Dillons scheme for the classification of
research questions. Research attempting to answer higher order questions
needs to include information about more basic questions in order to support
otherwise tenuous answers to higher order research questions.
Generalizing
and Context
Alternatives to the Peters and OConnor (1980) framework for conceptualizing and researching constraints have begun to emerge. For example, in contrast to the inductive method used by Peters and OConnor in order to identify
constraints, Schoorman and Schneider and their associates (1988a; Moeller,
Schneider, Schoorman, & Berney 1988) described a deductive method of identi-
ALTERNATIVE CONCEPTUALIZATIONS
165
fying work facilitators and inhibitors on the basis of Katz and Kahns (1978)
open systems model. This procedure entails identifying the functions performed by various organizational
subsystems (e.g., supportive, maintenance,
production, etc.) in the service of organizational
goals and the requisite resources available for the subsystem to perform adequately. The approach is
also novel in that it applies the concept of facilitators/inhibitor
at a higher level
of aggregation-the
work unit as opposed to the individual. Schoorman and
Schneider (1988b) note that the appropriateness of one approach or the other
to study constraints might depend on the degree of interdependence between
work group members in a particular work setting. When workplace technology
encourages interdependent
and interactive effort as opposed to independent
and individual effort, the work group might be a preferable unit of analysis.
The work of Schoorman and Schneider (1988a) is encouraging in that it suggests further generalization
of the facilitation/inhibition
concept to higher
levels of aggregation might be feasible.
The conceptualization
of constraints as aspects of the immediate work environment does not necessarily obviate extension of the concept to other behavioral contexts. However, like generalization to a higher level of aggregation,
generalization to a broader context requires that the context, or substantive
system (Brinberg & McGrath 1985), to which the concept is generalized maintains an essential similarity to the original context. The original context used
as the basis for developing the Peters and OConnor (1980) framework was the
work environment of the respondents who generated data for taxonomic purposes. These respondents represented a cross-section of employees engaged in
different work located in a variety of settings, some of whom may have performed their job functions in multiple work settings. This would seem particularly likely with respect to responses from managers. Thus, the attribute
immediate work environment does not necessarily proscribe application of
the constraint concept to other behavioral contexts that are virtually isomorphic in function. Isomorphism of behavioral function refers to similarity of
purpose with respect to behavior in a setting. One common aspect of the diverse respondents described above is that they were describing constraints
that impeded the effectiveness of behavior directed toward some tangible
achievement (performance, mastery, pay). Isomorphism of behavioral function
could serve as a substantive system boundary for purposes of identifying instances where the constraint concept might appropriately apply. Application of
this notion suggests numerous settings are characterized by their emphasis on
instrumental behavior including traditional vocational settings, education,
and sports. The recent work of Mathieu, Tannenbaum, and Salas (1992) illustrates one application of constraints in the context of a proofreading skills
training program.
Expansion of the context to which constraints may reasonably apply has
several advantages. First, extension of a concept to multiple contexts allows for
the possibility that the concept may explain a greater variety of phenomena,
thereby augmenting its specific scope. Second, the extension of the concept to
166
HUMAN
RESOURCE MANAGEMENT
REVIEW
VOLUME
3. NUMBER
2.1993
more contexts allows for more opportunities to test the concept and its attendant theoretical framework. Ellsworth (1977, p. 605) notes that all settings
have unfavorable quirks and characteristic sources of error and that to avoid
these problems, research might need to be pursued in alternative contexts. As
Peters et al. (1985) noted, field research on situational constraints has consistently reported low levels of constraining factors, rarely exceeding the scale
midpoint. This restriction in the range of constraint levels in traditional vocational contexts suggests a need to test the effects of constraints in settings that
include more elevated levels of constraints. Future research on constraints
should follow Ellsworths prescription that the choice of setting for the test of
the hypothesis if X, then Y is determined by X. Settings should be chosen in
such a way as to maximize the likelihood of finding a good representation of
constraints.
Finally, constraints can be construed as both causes and effects. Brown and
Mitchell (1991) investigated employee perceptions of performance obstacles
during a conversion from a batch to a just-in-time (JIT) manufacturing system.
Their findings indicated that the conversion to a JIT system reduced some
obstacles (material delivery, resource availability, information quality) and
magnified others (training, computer use, scheduling, reliance on coworkers).
More studies that construe constraints as dependent variables are needed in
order to better understand how tractable different constraints might be to
different types of interventions.
Modeling of Constraint
Relationships
ALTERNATIVE CONCEPTUALIZATIONS
167
168
REVIEW
VOLUME
3, NUMBER
2, 1993
ALTERNATIVE CONCEPTUALIZATIONS
169
Although numerous individual difference variables might influence perceptions of and responses to constraining circumstances, we will briefly discuss
one in order to illustrate their potential relevance for perception-based
measures of situations. Drawing on Gibsons (1979) notion of affordances,
Dworkin and Goldfinger (1985) described processing biases in the cognitive
appraisal of situations. Affordances refer to characteristics of the environment
that facilitate particular behaviors or aims specific to an organism. For example, some surfaces afford support for resting objects; because humans possess
sight, lighting affords us the ability to avoid collision with other objects; and
some tools afford manipulation. Dworkin and Goldfinger define processing bias
as inclinations or tendencies for individuals to differ in the extent to which
they are oriented toward recognizing the availability of different affordances.
Individuals placed in a situation that provides affordances consistent with
their own processing bias are more apt to know what to look for, how to conduct
a perceptual search effectively, and are able to discriminate quickly, efficiently, and accurately relevant objects from irrelevant ones (p. 484). Thus,
some individuals may be more capable of identifying a greater variety of uses
for an affordance if they possess traits that orient them toward that affordance.
For example, Type A individuals, who are sensitive to time constraints, could
be expected to make greater use of available time when working under time
pressure than Type B individuals. Type A individuals would be predicted to
perceive time constraints to be more severe than Type B individuals, but because they are oriented to maximizing this affordance, they would also achieve
more than Type Bs. Such a perception-response
pattern could produce a positive correlation between perceived time constraints and job performance. Further evidence for the influence of individual differences on perceptions of situations comes from work on perceptions of environmental uncertainty. Downey,
Hellriegel, and Slocum (1977) found that cognitive process variables (cognitive
complexity, anomie, and independence of judgment) were more strongly related to perceived environmental
uncertainty than were perceived environmental characteristics (static-dynamic, simple-complex).
Systemic Validity of the Constraint Concept
The recent conceptualization
of stress as involving perceptions of uncertainty involving desired outcomes stemming from encounters with opportunities,
constraints, and demands (Beehr & Bhagat 1985; Schuler 1980) suggests some
commensurability between the situational constraints framework and theories
of work stress. As used here, commensurability
refers to the extent to which
elements and patterns of relationships constituting one theoretical framework
can be compared to another using similar language, methods, problem scope,
and explanations. Commensurability
is a prerequisite for systemic validity
(Zaltman, Pinson, & Angelmar 1973). Systemic validity represents the degree
to which a concept facilitates integration of different theoretical systems. Sirgy
(1988) describes seven different strategies that can be used to construct unified
theories from nominally disparate conceptual domains. Like concept extension, theory integration is desirable in that it, too, has the potential to ex-
170
REVIEW
VOLUME
3. NUMBER
2, 1993
CONCLUSION
Our knowledge about situational constraints as a concept, its potential influence on behavior, and its applicability to different contexts remains limited
because systematic effort at understanding
constraints as a concept, as opposed to treatment as an artifact for which control might suffice, has occurred
only recently. Similar ways of thinking about extraneous sources of variance
in criterion measures contributed to the relative lack of attention given to the
dynamic nature of criteria (Austin & Villanova 1992). However, once a phenomenon is reliably demonstrated, the need for a conceptual framework to explain
its occurrence becomes more urgent. Just the same, original conceptualizations are frequently incomplete or erroneous and may require alternative conceptual schemes that hold the potential for more frequent comirmatory evidence than an existing framework. We hope that the foregoing discussion
stimulates further thought about constraints and promotes research that explores the implications of different conceptual schemes for representing constraints and their putative effects on work outcomes.
STUDIES
APPENDIX
INCLUDED IN THE META-ANALYSIS
Jamal, M. 1984. Job Stress and Job Performance Controversy: An Empirical Assessment. Organizational Behavior and Human Performance 33: 1, 21.
-.
1990. Relationship of Job Stress and Type-A Behavior to Employees Job Satisfaction, Organizational
Commitment,
Psychosomatic
Turnover Motivation. Human Relations 43: 727-738.
Health
Problems,
and
171
ALTERNATIVE CONCEPTUALIZATIONS
REFERENCES
Andrews, F. M. and G. F. Farris. 1972. Time Pressure and Performance of Scientists
and Engineers: A Five-year Panel Study. Organizational
Behavior and Human
Performance 8: 185-200.
Austin, J. T. and P. Villanova. 1992. The Criterion Problem: 1917-1992. Journal of
Applied Psychology 77: 836-874.
Beehr, T. A. and R. S. Bhagat. 1985. Introduction to Human Stress and Cognition in
Organizations. Pp. 3-19 in Human Stress and Cognition in Organizations,
edited by T. A. Beehr and R. S. Bhagat. New York: Wiley.
172
REVIEW
VOLUME
3. NUMBER
2, 1993
Bobko, P. 1985. Removing Assumptions of Bipolarity: Towards Variation and Circularity. Academy of Management Review 10: 99-108.
Brinberg, D. and J. E. McGrath. 1985. Validity and the Research Process. Beverly Hills:
Sage.
Brown, K. A. and T. R. Mitchell. 1991. A Comparison of Just-in-time and Batch Manufacturing: The Role of Performance Obstacles.Acao!emy of Management Journal
34: 906-917.
Campbell, J. P., R. L. Daft, and C. L. Hulin. 1982. What to Study: Generating and
Developing Research Questions. Beverly Hills, CA: Sage.
Campbell, J. P., M. D. Dunnette, E. E. Lawler, and K. E. Weick. 1970. Managerial
Behavior, Performance, and Effectiveness. New York: McGraw-Hill.
Campbell, J. P. and R. D. Pritchard. 1976. Motivation Theory in Industrial and Organizational Psychology. Pp. 63-130 in Handbook of Industrial and Organizational
Psychology, edited by M. D. Dunnette. Chicago: Rand McNally.
Dillon, J. T. 1984. The Classification of Research Questions. Review of Educational
Research 54: 327-361.
Downey, H. K., D. Hellreigel, and J. W. Slocum. 1977. Individual Characteristics as
Sources of Uncertainty Variability. Human Relations 30: 161-174.
Dworkin, R. H. and S. H. Goldfinger. 1985. Processing Bias: Individual Differences in
the Cognition of Situations. Journal of Personality 53: 480-501.
Eden, D. 1982. Critical Job Events, Acute Stress, and Strain: A Multiple Interrupted
Time Series. Organizational Behavior and Human Performance 30: 312-329.
Ellsworth, P. C. 1977. From Abstract Ideas to Concrete Instances: Some Guidelines for
Choosing Natural Research Settings.American
Psychologist 32: 604-615.
Fromkin, H. L. and S. Streufert. 1976. Laboratory Experimentation. Pp. 415-465 in
Handbook of Industrial and Organizational Psychology, edited by M. D. Dunnette. Chicago: Rand McNally.
Gibson, J. J. 1979. The Ecological Approach to Visual Perception. Boston: Houghton
Mifflin.
Gilbreth, F. B. 1909. Bricklaying System. Chicago: Myron C. Clark.
Hulin, C. L., M. Rosnowski, and D. Hachiya. 1985. Alternative Opportunities and
Withdrawal Decisions: Empirical and Theoretical Discrepancies and an Integration. Psychological Bulletin 97: 233-250.
Hunter, J. E. and F. L. Schmidt. 1990. Methods of Meta-analysis: Correcting Error and
Bias in Research Findings. Newbury Park, CA: Sage.
Hunter, J. E., F. L. Schmidt, and G. B. Jackson. 1982. Meta-anulysis: Cumulating
Research Findings Across Studies. Beverly Hills, CA: Sage.
Ivancevich, J. M., M. T. Matteson, S. M. Freedman, and J. S. Phillips. 1990. Worksite
Stress Management Interventions. American Psychologist 45: 252-261.
Jamal, M. 1984. Job Stress and Job Performance Controversy: An Empirical Assessment. Organizational Behavior and Human Performance 33: 1-21.
1990. Relationship of Job Stress and Type-A Behavior to Employees Job Satis-.
Psychosomatic
Health Problems, and
faction, Organizational
Commitment,
Turnover Motivation. Human Relations 43: 727-738.
Jaques, E. 1964. Time-span Handbook. London: Heineman Educational Books.
Kahn, R. L. and R. P. Quinn. 1970. Role Stress: A Framework for Analysis. In Occupational Mental Health, edited by A. McLean. Chicago: Rand McNally.
Kahn, R. L., D. M. Wolfe, R. P. Q umn, J. D. Snoek, and R. A. Rosenthal. 1964. Organizational Stress: Studies in Role Conflict and Ambiguity. New York: Wiley.
ALTERNATIVE CONCEPTUALIZATIONS
173
174
HUMAN
RESOURCE MANAGEMENT
REVIEW
VOLUME
3. NUMBER
2,1993
ALTERNATIVE CONCEPTUALIZATIONS
175
Steel, R. P., A. J. Mento, and W. H. Hendrix. 1987. Constraining Forces and the Work
Performance of Finance Company Cashiers. Journal of Management
13: 473482.
Whitener, E. M. 1990. Confusion of Confidence Intervals and Credibility Intervals in
Meta-analysis. Journal of Applied Psychology 75: 315-321.
Wicker, A. W. 1985. Getting Out of Our Conceptual Ruts: Strategies for Expanding
Conceptual Frameworks. American Psychologist
40: 1094-1103.
Zaltman, G., C. Pinson, and R. Angelmar. 1973. Metatheory in Consumer Research. New
York: Wiley.