Reinforcement

Schedules

Overview
Some history, review, and definition
Basic Schedules
Limited hold
Schedule thinning
Schedules for rate of responding
Schedule combinations
Choice & concurrent schedules

The Simple Schedules (A Summary)

Fixed Ratio
Variable Ratio
Progressive Ratio
Fixed Interval
Variable Interval
Fixed Time
Variable Time

FR
Fixed Ratio: the last of a specified
number of responses is reinforced
(the # is always the same)

RESPONSES

Complete 20 lever presses (FR 20)--> Get

a food pellet
Move 50 boxes (FR 50)--> Get $5
Sell 1000 boxes of cookies, win an iPod
Touch

REINFORCER

POST REINFORCEMENT
PAUSE
HIGH RESPONSE RATE

Key Features of Patterning:

High rate of responding

Post reinforcement pause (PRP)
Possible ratio strain (schedule requirement
is too big, causes big pauses during run)

REINFORCER
TIME

VR
HIGH STEADY
RESPONSE RATE
RESPONSES

Variable Ratio (VR): the last of a

specified number of responses is
reinforced, the number varies
from one reinforcer to the next,
but revolves around some
average value

REINFORCER

Gambling
Getting a nail into a board

Key Features of Patterning:

Highest rate of responding of all

simple schedules
No PRP

TIME

PR
Progressive Ratio: the number of R required for reinforcers
increases (or decreases) after each reinforcer delivery.
2, 4, 8, 16, 32
Cost of commodity keeps rising

Can tell you about the reinforcing value of some stimulus.

STEP SIZE = 5

RESPONSES

RESPONSES

STEP SIZE = 5

TIME

TIME

 Fixed Interval (FI): the first

response after X period of
time is reinforced
Looking at your watch

Note:
Early responses in the interval
have no effect
A response must occur for
reinforcer delivery
Produces scallop patterning

RESPONSES

FI

SCALLOP PATTERN

PRP

REINFORCER
TIME

 Variable Interval (VI): the first

response after X interval has
elapsed, but the time value
revolves around some average.
Note:
Remember how we find the
average value (same as with VR
schedules)
Checking your email
Generates low, steady, rates of
responding

RESPONSES

VI

STEADY RESPONSE RATE

REINFORCER
TIME

Time-based Schedules
Fixed Time (FT): Reinforcers (stimuli) are delivered at
set points in time, independent of behavior (response
independent)
Variable Time (VT): Same as FT, except the time
interval revolves around some average value (also
response independent)

Limited Hold
With a limited hold, the reinforcer is set up (scheduled)
but a response must occur in a specified period of time
to produce that reinforcer

DRH
High rates (short IRTs)
Fluency
Running

At least X responses in Y min

20 math problems in 30 min
10 spelling words in 5 min

DRL
Low rates (long IRTs)
Eating slowly
Hand raising
Manding

Fewer than X responses in Y min

Good Behavior Game

Multiple Schedules
Two or more schedules alternate, each during a
different stimulus
Speaking loosely, this tells the organism that a particular set
of rules is in place

How this works

During a set period of time (e.g., 1 hr) two simple schedules
(e.g., VI 30 s, FR 20) alternate back and forth
Sometimes the requirement is FR 20, sometimes its VI 30 s

Multiple Schedules
How this works
ANY time the FR 20 is in place one relevant stimulus is present (a GREEN
LIGHT)
ANY time the VI 30-s schedule is in place a DIFFERENT relevant stimulus is
present (a BLUE LIGHT)

Multiple Schedule
M u l ti p l e S c h e d u l e P e r f o r m a n c e

How this works

Each component is in place for a set
period of time (usually)
So, FR 20 is in place for 10 min, then
VI 30 s for 10 min, and so on
We usually do not want them to
alternate in the same sequence (try to
make it random, but not required of
this schedule type)
Remember, the whole session is 1
hr, so we watch how behavior
changes during 10 min segments of
this 1 hr period

40
30
R esp o n ses
P er M in

F R 20

20
V I 30 s
10
0

6
S essio n s

10

Mixed Schedules
Two or more schedules alternate, each during the same
stimulus
Speaking loosely, the organism doesnt know how to respond
based on ANY specific stimulus

How this works

During a set period of time (e.g., 1 hr) two simple schedules
(e.g., VI 30 s, FR 20) alternate back and forth
Sometimes the requirement is FR 20, sometimes its VI 30 s

Mixed Schedules

M ix ed S c h ed u le P er fo r m a n c e
50

F R 20

How this works

ANY time the FR 20 is in place a
GREEN LIGHT is on
ANY time the VI 30-s schedule the
GREEN LIGHT is still on!!

40
R esp o n ses
P er M in

30
20

V I 30 s

10
0

10
S essio n s

15

20

M ix ed S c h e d u le P e r fo r m a n c e

M u l ti p l e S c h e d u l e P e r f o r m a n c e
40

50
40

30
R esp o n ses
P er M in

R esp o n ses
F R 2 0 P er M in

20

30
20

V I 30 s
10
0

F R 20

V I 30 s

10

6
S essio n s

10

10

15

20

S essio n s

Note: It takes longer to get that separation between data paths.

Occurs quickly in multiple schedule, more slowly in mixed
schedule.
*Multiple schedules produce characteristic schedule
performance more quickly. Reason: More information.

Definition
Chained schedule: reinforcers are produced by completion of two or
more component schedules, each associated with a different stimulus

Chained Schedules
Recall: We get fast response rates, and a PRP in FR schedules.
A pigeon completes a FR 200 rather quickly and will get all the food it
needs by responding on the FR 200

Chained Schedule
Next, we introduce different color keys after completion of 50
responses (again, during the FR 200)

Key starts out blue. After 50 pecks, the key

changes

Chained Schedule

z
To green. When the pigeon completes the
next 50 responses, the key changes

Chained Schedule

To yellow. When the pigeon completes the

next 50 responses, the key changes

Chained Schedule

To red. When the pigeon completes the next

50 responses,

Chained Schedule

Food is delivered. After food, the sequence

starts all over.

Chained Schedule

Questions:
Does responding occur in the same fashion when the key colors change
vs. when it stays the same (when its always white)?
No, response rate is slower when the key colors change.

Chained Schedule

Questions:
How is behavior affected when the key colors change?

Chained Schedule

Questions:
What does blue tell you about when food is coming?
You are the farthest from food that you can be. What does the pigeon
do? Pauses longer before getting started and then the
responses are not rapid, they occur more sporadically.

Chained Schedule

Questions:
When the light turns green, they pause again, and respond slowly.
When the light turns yellow, the pigeon is less likely to pause.
What about when it turns red? Now you respond very quickly. Why?
You are the closest to food that you will ever be.

Chained Schedule

So, compare all that pausing with what happens when the key color
stays white for the entire FR 200.
Does the pigeon pause? Yes! When? After food, before the next run.
What happens when they start the FR 200 run? Yes! They keep on
going until they receive food.

Chained Schedule

IMPORTANT: In chained schedules, a stimulus supports less

responding the further it is from the end of the sequence.

Tandem Schedules
How this works
Organism completes a FR 30
After completing the FR 30, no reinforcer is delivered

Completing the FR 30 EARNS YOU the next schedule (e.g., VI 60 s)

Complete the VI 60 s, organism earns the reinforcer

Like a mixed schedule, there are no SPECIFIC stimuli that tell you what schedule
is in place
Takes time to learn how to respond to each schedule

Tandem schedule
N o te : N o th i n g to te l l y o u th a t y o u a r e i n th e " n e x t" s c h e d u l e r e q u i r e m e n t.
H a r d to " fi g u r e o u t."

F ood
R e q u i r e m e n t:
F R 30

R e q u i r e m e n t:
V I 60 s