Linear Regression

ATS
 Outcomes
Performed regression analysis using
SPSS
Analyzed data using regression /
multiple regression
 Regression Analysis
Is a statistical tool for the investigation of
relationships between variables
Usually, the researcher seeks to ascertain the
cause effect of one variable upon another
Examples:
The effect of Organizational Climate on Employee
Satisfaction
The effects of Advertisement and Price on Sales
Relationship between Mothers Age, Weight,
History of Hypertension, and Smoking Status and
on Babys Birth Weight
 Linear Regression
It is used when we want to predict the
value of a variable based on the value of
another variable
The value we want to predict is the
DEPENDENT VARIABLE
(OUTCOME/RESPONSE), and the variable
we are using to predict the other
variables value is called the
INDEPENDENT VARIABLE
(PREDICTOR/EXPLANTORY)
INDEPENDE
DEPENDENT
NT
VARIABLE
VARIABLE/S

X, Y,
EXPLANATO OUTCOME,RESPON
RY, SE, PREDICTED
 Six Assumptions for Linear
Regression
1. the variables are continuous
2. there is a linear relation
(correlation)
3. there should be no significant
outliers
4. there should be independence of
observation
5. the data needs to show
homoscedasticity
6. the residuals of the of the
 LINEAR REGRESSION
IT IS A PARAMETRIC STATISTICS

THERE IS NO NON- PARAMETRIC

ALTERNATIVE
Variables ( multiple linear
regression)
INDEPENDENT
VARIABLE DEPENDENT VARIABLE
Two or more One
continuous and/ or
dummy /dichotomous
continuous DV
variable IVs

Self-esteem Life
Perceived control
Optimism Satisfaction
Explanatory (X)
Response (Y)
Predictor
Predicted
 Essential feature

One sample with

scores on all
measures
 Question
How much of the variance in life
satisfaction (Y) scores can be
explained by self esteem (X1),
perceived control (X2) and optimism
(X3)?

Conduct test using a valid instrument

which will measure self-esteem,
perceived control, optimism and life
satisfaction.
 Effects of SE, PC and OP on Life
Satisfaction (Y)
Equation/Model:
Life Satisfaction=Bo + B1SelfEsteem +
B2PerceivedControl + B3Optimism + Error
In regression analysis, you will know:
Which factors significantly effect the variation
of life satisfaction can be explained?
The relative effects of the factors on life
satisfaction?
The proportion of variance in life satisfaction
that can be explained by the factors?
 Model:
Life Satisfaction=Bo +
B1SelfEsteem + B2PerceivedControl
+ B3Optimism + Error
Null Hypothesis

Ho= B1=B2=B3 = 0
 VARIABLE RANGE
Self esteem: 1-30; 15-25 within normal range;
below 15 suggest low esteem, above 25
suggest high esteem (Rosenberg)
Perceived control: 1-30-:1-10- low; 11-20-
medium; 21-30 - high
Optimism:1-40; 20 and above optimistic; 19
and below- pessimistic
Life-satisfaction: 1 -35; 31-35- very high; 26-30-
high;20-25-average;15-19-sightly below
average;10-14- dissatisfied;5-9- extremely
dissatisfied (Diener et al)
 Scatter Plot
Pearson R Correlation

0.785193 0.59555
2 0.9064
40
40
97
40
35
35
30 35
30
25 30
25
20 25
15 20
20
10 15
15
5 10
10
0 5
5
5 10 15 20 25 30 35
0
0
14 16 18 20 22 24 26 28 30 32
12 14 16 18 20 22 24 26 28 30 32
Migrate from Excel to SPSS, then
name and label the 4 variables
<Analyze<Regression<
linear
Transfer LS to the dependent box and SE, PC
and OP to the Independent box, < Statistics
 Check estimate, confidence interval, model fit <
continue (note: you may check other data as needed)
<Continue<OK
 Important Outputs

Regression Equation : LS= (.259) SE + (.186) PC + (.817)

OP 4.930
F test (Anova) in regression tests the
Ho that all the B coefficients are Zero

F= 31.535 in the above table has a

p-value of less than .05 that the null
hypothesis is false
 Thus, we can infer that there is at
least one B coefficient in the model
that is not Zero. To determine which
B coefficient (s) is are not equal to
zero the researcher should examine
the t-test for each B coefficient.
 T-test, p values and B Coefficient in
Regression Model
T-test in regression analysis tests the hypothesis for
each of the B coefficient.
Recall the model:
Life Satisfaction=Bo + B1SelfEsteem +
B2PerceivedControl + B3Optimism + Error
Null Hypothesis:
Ho1: B1 = 0
Ho2: B2 = 0
Ho3: B3 = 0
P value is associated with T-value tells us if the effect B
is statistically significant or not. The B is significant if p
is less than .05
For optimism, T=3.982 has a p-
value of .001. Thus, we can
infer that the optimism affects
significantly life satisfaction
(B=.817, p<.05)
UNSTANDARDIZED B COEFFICIENTS

Positive B coefficient tells us that there is

a positive relationship between the DV and
IV. Negative B coefficient tells us that there
is a negative relationship between DV and
IV
The value of the B coefficient tells us the
change in the dependent variable for every
unit change in one independent variable,
For optimism, B is positive indicating optimism
is positively associated with life satisfaction.
The higher the perceived optimism, the higher
the life satisfaction level. Or, those with higher
optimism are expected to have higher level of
satisfaction. The B coefficient of .650 indicates
that every one unit increase in optimism, life
satisfaction level increased by .817, holding
the other variables constant.
 Standardized coefficient
The Unstandardized B coefficients cannot be used
to determine the relative effects of the
independent variables if they were measured using
different range and/or units.
The standardized B (called Beta) can be used to
determine the relative effects of the IVs on the DV.
In our regression analysis, among the three
independent variables, optimism has the largest
effect on life satisfaction (Beta=.817), followed by
self-esteem (Beta= .242), perceived control (.127)
 Constant Term (Bo): It represents the
predicted life satisfaction when all
IVs are zero. This value is not useful
in this case because it is impossible
for a respondent to have zero score
on the IVs because the values range
between 1 and 10.
R^2 in linear Regression:: is the
estimated proportion of variance that
is accounted for the independent
variables in the model.
 An R^2 of .855 indicates that the
three independent variables
explained about 85.5% of the
variability of life satisfaction. The
other 14.5 can be explained by other
variables not included in the
analysis.
Optimism (X) and Life satisfaction
(Y)

Regression Equation: LS= (1.138)

optimism 3.374
Perceived Control and Life
Satisfaction

Regression Equation: LS= (.875) Perceived

Control 2.376
 Self-esteem and life
satisfaction

Regression Equation: LS= (838) self esteem -7.882

C Optimism
. Life
82 Satisfaction
O 2
N Perceived
Control
.
35
Life
Satisfaction
C 5
.
E Self Esteem
61
Life
Satisfaction

P 7

T Optimism .855 Life

U Perceived
Control Satisfaction
Self Esteem
A
MODEL
 ERRO
R
Optimism
.
25
Perceived .9 Life
Control 18 Satisfaction
6
.
Self Esteem
81
7

STATISTICAL MODEL
 IMPLICATION/CONCLUSION
In order to improve ones satisfaction
in life, one must be able to improve
perceived control, self-esteem and
most especially optimism.
Interventions to improve
simultaneously these three
categories in a person, would allow a
person to be satisfied in life.