Design and Analysis of

Engineering Experiments

Chapter 1

Design & Analysis of Experiments

Design of Engineering Experiments

Introduction

Usefulness of DOE
An abbreviated history of DOE
Some basic principles and terminology
The strategy of experimentation
Guidelines for planning, conducting and
analyzing experiments

Chapter 1

Design & Analysis of Experiments

Introduction to DOE
To experiment is to understand cause and
effect relationships by purposefully varying
the inputs and observing the outputs
Determine which variables are responsible for
the observed changes in the response
Develop a model relating the response to the
important input variables and to use this
model for process or system improvement or
other decision making
Chapter 1

Design & Analysis of Experiments

Introduction to DOE
A well designed experiment is important
because the results and conclusions that can
be drawn depend to a large extent on the
manner in which data were collected

Chapter 1

Design & Analysis of Experiments

Engineering Experiments

Reduce time to design/develop new products

& processes

Improve performance of existing processes

Improve reliability and performance of

products

Achieve product & process robustness

Evaluation of materials, design alternatives,

setting component & system tolerances, etc.

Chapter 1

Design & Analysis of Experiments

Four Eras in the History of DOE

The agricultural origins, 1908 1940s
W.S. Gossett and the t-test (1908)
R. A. Fisher & his co-workers
Profound impact on agricultural science
Factorial designs, ANOVA
The first industrial era, 1951 late 1970s
Box & Wilson, response surfaces
Applications in the chemical & process industries
The second industrial era, late 1970s 1990
Quality improvement initiatives in many companies
Taguchi and robust parameter design, process
robustness
The modern era, beginning circa 1990
Chapter 1

Design & Analysis of Experiments

William Sealy Gosset

(1876-1937)
Gosset's interest in barley
cultivation led him to speculate
that design of experiments should
aim, not only at improving the
average yield, but also at breeding
varieties whose yield was
insensitive (robust) to variation in
soil and climate.
Gosset was a friend of both Karl
Pearson and R.A. Fisher, an
achievement, for each had a
monumental ego and a loathing
for the other.
Gosset was a modest man who cut
short an admirer with the
comment that Fisher would have
Chapter 1
discovered
it all anyway.Design & Analysis of Experiments

R. A. Fisher (1890 1962)

Chapter 1

George E. P. Box

Design & Analysis of Experiments

The Basic Principles of DOE

Randomization
Running the trials in an experiment in random order
Notion of balancing out effects of lurking variables

Replication
Sample size (improving precision of effect estimation,
estimation of error or background noise)
Replication versus repeat measurements?

Blocking
Dealing with nuisance factors

Chapter 1

Design & Analysis of Experiments

Planning, Conducting &

Analyzing an Experiment
1.
2.
3.
4.
5.
6.
7.

Recognition of & statement of problem

Selection of the response variable(s)
Choice of factors, levels, and ranges
Choice of design
Conducting the experiment
Statistical analysis
Drawing conclusions, recommendations

Chapter 1

Design & Analysis of Experiments

10

Planning, Conducting &

Analyzing an Experiment
1. Recognition of & statement of problem
2. Selection of the response variable(s)
3. Choice of factors, levels, and ranges
. Cause and effect diagram to have a
comprehensive view of all the factors

Chapter 1

Design & Analysis of Experiments

11

Planning, Conducting &

Analyzing an Experiment
How would
create this
cause and
effect
diagram in
MINITAB?

Chapter 1

Design & Analysis of Experiments

12

Planning, Conducting &

Analyzing an Experiment
2. Choice of factors, levels, and ranges
Design factors: They are of interest to the experimenter
- Design factors
- Held-constant factors
- Allowed to vary factors
Nuisance factors: NOT of interest to the experimenter
- Controllable
- Uncontrollable
Chapter 1

Design & Analysis of Experiments

13

Planning, Conducting &

Analyzing an Experiment
Categorize the
factors shown in
the cause and
effect diagram
Design
Held constant
Allow to vary
Nuisance
controllable
Nuisance not
controllable
Chapter 1

Design & Analysis of Experiments

14

Planning, Conducting &

Analyzing an Experiment
4. Choice of design

Chapter 1

Design & Analysis of Experiments

15

Strategy of Experimentation
Best-guess experiments
Used a lot
More successful than you might suspect, but there
are disadvantages

One-factor-at-a-time (OFAT) experiments

Sometimes associated with the scientific or
engineering method
Devastated by interaction, also very inefficient

Statistically designed experiments

Based on Fishers factorial concept
Chapter 1

Design & Analysis of Experiments

16

Factorial Designs
In a factorial experiment, all
possible combinations of
factor levels are tested
The golf experiment:

Type of driver
Type of ball
Walking vs. riding
Type of beverage
Time of round
Weather
Type of golf spike
Etc, etc, etc

Chapter 1

Design & Analysis of Experiments

17

Factorial Design

Chapter 1

Design & Analysis of Experiments

18

Chapter 1

Design & Analysis of Experiments

19

Factorial Designs with Several

Factors

Chapter 1

Design & Analysis of Experiments

20

Chapter 1

Design & Analysis of Experiments

21

Factorial Designs with Several Factors

A Fractional Factorial

Chapter 1

Design & Analysis of Experiments

22

Planning, Conducting &

Analyzing an Experiment
5. Conducting the experiment
6. Statistical analysis
7. Drawing conclusions,
recommendations

Chapter 1

Design & Analysis of Experiments

23

Planning, Conducting &

Analyzing an Experiment
Get statistical thinking involved early
Your non-statistical knowledge is crucial to
success
Pre-experimental planning (steps 1-3) vital
Think and experiment sequentially (use the
KISS principle)

Chapter 1

Design & Analysis of Experiments

24

Introduction to MINITAB

Chapter 1

Design & Analysis of Experiments

8E 2012 Montgomery

25

Workshop 1
(Due at the of the class!!!)
Suppose that you want to investigate the factors that potentially
affect cooking rice
a) What would you use as a response variable in this
experiment? How would you measure the response?
b) Construct a cause and effect diagram with all the potential
sources of variability that could impact the response
c) Complete the first three steps of the guidelines for
designing experiments in section 1.4. In step 3, state your
design, held-constant, allowed to vary, nuisance
controllable and nuisance uncontrollable factors)
Chapter 1

Design & Analysis of Experiments

8E 2012 Montgomery

26