Swiss Federal Institute for Hygiene and Applied Physiology

Institute of Technology
Zürich
Prof.Dr. Dr. Helmut Krueger
Clausiusstr. 25, CH-8092 Zürich

Introduction into Human-

Computer Interaction

Matthias Rauterberg

1998
 view view
from from
outside inside

user's perspective developer's perspective

operator operation function

 DIN 66 234 EC directive ISO 9241 Ulich
part 8 90/270/EEC part 10
(1988) (1990) (1996) (1991)

suitability for the task suitability (activity adapted) suitability for the task task orientation

self-descriptiveness feeback about system states self-descriptiveness transparency

appropriate format and pace feedback

of information presentation

conformity with user conformitity with user compatibility

expectations expectations
consistency

information and instruction of suitability for learning support

user

ease of use applicable to suitability for selection possibilities

skill level individualization user definability

hearing and participation of participation

users

controllability controllability flexibility

error robustness error tolerance

 transparency

feedback compatibility consistency help support

individualisation

flexibility individual individual

selection adaptation
(programming)

potential degree of freedom

(meta-dialog task)

actual degree of freedom

 Differences between
the visual and the auditory sense

The two most important

constrains in interface design
• the control of user's attention

• the physical size of the screen

 feedback modalities

pros cons
parallel in space active eye contact
neccessary
large information
visual transfer

enforces attention noise through

allocation environment

enables the perception linear in time

of background
acoustic activities

important for visually exists only for a

impaired people short time span

force perception linear in time

object recognition contact with

haptic objects
textur and surface
perception neccessary
human memory
remember rate
100%

80%

60%

40%

20%

0 3 6 9 12 15 18
time interval until remember items (in sec)

internal memory external memory

 long term memory storage
component

goals
problem solving short term memory

user
plan component expectations

action motoric perception component

component memory

visual auditory haptic

Operation "memory" "memory" "memory"
Eingabe visual output acoustic output tactile output

input-handler output-handler (DC) output-handler (AC)

user interface
representation

dialog dialog- dialog-

functions (DF) objects (DO) states
(DCS)
dialog-component (DC)

application
states (ACS)
application- application-
Funktionen (AF) objects (AO) transformation

application component (AC)

 task(s)

au
gn

tom
esi

ati
fun
n
kd

tio

on
cti
tas

a
fic

on
ali

ali
qu

ty
usability
user computer
training

user-oriented requirement analysis

• know the user

• describe the context of use

• analyse the user‘s tasks

• decide for man-machine function allocation

 the complete action cycle

1
task(s)
goal-, subgoal-setting

4 feedback 2 planning of execution

control of
action selection of means

3a
mental operation
3b
physical operation
usability specification map (USM)

global design principles control

high level goals customization

measuring concepts flexibility

criteria = metric + extent fan degree

scale type examples in the context of HCI

nominal classification of interfaces

(e.g. command, menu, desktop etc.)

ordinal summative evaluation studies

(e.g. CUI versus GUI)

interval checklist evaluation

(e.g. expert's opinion)

rational quantitative metrics

Methods to Measure Usability Quality

user's involvement
virtual real
formal view: user-oriented view:
ecological validity

virtual formal modelling inquieries,

interview,
mock-ups
computer's
involvement product-oriented view: interaction-oriented view:

real expert evaluation usability test

effort and costs

the advanced Seeheim-model:

application
manager

am application

i/o
user inter- dialog
face

dm

organisation i / o manager dialog manager organisation

socio-technical system
An abstract concept to describe
usability aspects

function space
FS

perceptible functions hidden functions

PF HF

perceptible
dialog functions δ [hidden]
dialog functions
PDFIP HDFIP

perceptible
application functions
α [hidden]
application functions
PAFIP HAFIP
schema of the dialog structure
function: switch
HDFIP PDFIP HAFIP PAFIP
11 10 0 0

function: file main menu

HDFIP PDFIP HAFIP PAFIP HDFIP PDFIP HAFIP PAFIP
3 3 0 0 14 14 0 0

modul: information
HDFIP PDFIP HAFIP PAFIP filter: data
10 10 0 0 HDFIP PDFIP HAFIP PAFIP
2 2 46 1

modul: calculation
program: data
HDFIP PDFIP HAFIP PAFIP
HDFIP PDFIP HAFIP PAFIP
10 10 0 0
2 2 56 9
 schematic diagram

actual
dialog context i/o-interface HAFIP

A.function-1
object space A.function-2

A.function-3

PAFIP A.function-4

A.function-5

PDFIP A.function-6

HDFIP application
component
D.F1 D.F2 D.F3 D.F4

dialog-component
a command language interface

MS-DOS Vers. 3.01 PAO

C:>_ PAFIP

DC
command language interface (CUI)

application specific

actual i/o interface interaction point

(HAFIP)
dialog-
context
A.Function-1

A.Function-2
perceptible
function A.Function-3
point
(PF) A.Function-4

A.Function-5
dialog
specific A.Function-6
interaction
point A.Function-7
(HDFIP)

application
...
manager
D.F1 D.F2

dialog manager
 a menu-driven interface (CUI)
1 [.........1.........2.........3.........4.........5.........6..]..
the normal view on a text document
MsWORD 4.0 PAFIP
PAO

DC

TEXT.DOC
COMMAND: Copy Delete Format Gallery Help Insert Jump Library PDFIP
Options Print Quit Replace Search Transfer Undo Window
Edit document or press Esc to use menu PAFIP
Pg1 Ro1 Co1 {} ? Microsoft Word
PDO
 menu driven interface (CUI)

i/o interface
application specific
actual interaction point
dialog- (AFIP)
context

representa- A.Function-1
tion of an
application A.Function-2
specific
interaction A.Function-3
point
(RAFIP) A.Function-4

representa- A.Function-5
tion of a
dialog specific A.Function-6
interaction
point A.Function-7
(RDFIP)

dialog application
specific
interaction
point
D.F1 D.F2 ... manager
(DFIP)
dialog manager
 GUI: a desktop interface
PDFIP Desk File Edit Join Selection Calculation Switches Option Program
JOIN.Customer-No

JOIN.Customer-No ( )
PAO
Customer-No Article-No Quantity discette
customer
500010 1001 250
500010 1002 10
604650 1001 500
604650 1002 100 printer
article 604650 2004 50 PAFIP

PDO
supplies
DC contracts clipboard mixboard sortboard im/export trash

F1 F2 F3 F4 F5 F6 F7 F8 F10 heap 100

PDFIP Input Delete Update Search Browse File Key Sort. Quit memory 2
 direct manipulative interface (GUI)

actual
i/o interface
application specific
dialog- interaction point
context (AFIP)
representa-
tion of an A.Function-1
application
specific A.Function-2
interaction
point A.Function-3
(RAFIP)
A.Function-4
representation
of a dialog A.Function-5
specific
interaction A.Function-6
point

application
(RDFIP)

dialog
specific manager
interaction
point D.F1 D.F2 ...
(DFIP)
dialog manager
quantitative measure of "functional feedback":

D
FB = 1/D ∑ (#PFd / #HFd) * 100%
d=1

quantitative measure of "fan degree":

D
FD = 1/D ∑ ∑ Post(Dd,f)
d=1 f ∈ HAFIP

quantitative measure of "dialog flexibility":

D
DFl = 1/D ∑ #HDFIPd
d=1

quantitative measure of "application flexibility":

D
AFl = 1/D ∑ #HAFIPd
d=1
 quantitative measure of "feedback":

D
FB = 1/D ∑ (#PFd / #HFd) * 100%
d=1

quantitative measure of "interactive directness":

P
ID = {1/P ∑ min[lng(PATHp)] }-1 * 100%
p=1

[visual] feedback (FB)

low high

menu
batch
low interface

interactive MI
directness desktop style
(ID) command
language direct
high manipulation
CI DI
The outcomes of nine (9) different comparison studies between
command (CI) and menu (MI) interfaces.
"CI < MI" means that the average usage/preference with/for MI is better than with/for CI;
"CI = MI" means that there are no published data to decide;
"CI > MI" means that the average usage/preference with/for CI is better than with/for MI;
"sig." means that p ≤ 0.05; "not sig." means that p > 0.05

Reference interface skill level usability metric outcome result

Streitz et al. (1987) CI, MI beginner task solving time CI < MI sig.
Chin et al. (1988) CI, MI beginner subjective rating CI < MI sig.
Ogden & Boyle (1982) CI, MI, HY beginner preferences CI < MI sig.
Roy (1992) CI, MI advanced error rate CI < MI sig.
Roberts & Moran (1983) CI, MI, DI experts task solving time CI < MI sig.
Chin et al. (1988) CI, MI experts subjective rating CI < MI sig.
Peters et al. (1990) CI, MI, DI experts slips CI < MI sig.
Peters et al. (1990) CI, MI, DI experts recognition errors CI < MI sig.
Peters et al. (1990) CI, MI, DI experts efficiency CI < MI sig.
Ogden & Boyle (1982) CI, MI, HY beginner task time CI < MI not sig.
Roy (1992) CI, MI advanced task solving time CI < MI not sig.
Antin (1988) CI, MI, KMI advanced subjective rating CI < MI not sig.
Hauptmann & Green (1983) CI, MI, NO beginner task solving time CI = MI not sig.
Hauptmann & Green (1983) CI, MI, NO beginner number of errors CI = MI not sig.
Hauptmann & Green (1983) CI, MI, NO beginner subjective rating CI = MI not sig.
Whiteside et al. (1985) CI, MI, IO beginner task completion rate CI > MI not sig.
Antin (1988) CI, MI, KMI advanced preferences CI > MI not sig.
Roberts & Moran (1983) CI, MI, DI experts error-free task time CI > MI not sig.
Whiteside et al. (1985) CI, MI, IO advanced task completion rate CI > MI sig.
Streitz et al. (1987) CI, MI advanced task solving time CI > MI sig.
Antin (1988) CI, MI, KMI advanced task completion rate CI > MI sig.
Whiteside et al. (1985) CI, MI, IO experts task completion rate CI > MI sig.
The outcomes of twelve (12) different comparison studies between
command (CI) and direct manipulative (DI) interfaces.
"CI < DI" means that the average usage/preference with/for DI is better than with/for CI;
"CI = DI" means that there are no published data to decide;
"CI > DI" means that the average usage/preference with/for CI is better than with/for DI;
"sig." means that p ≤ 0.05; "not sig." means that p > 0.05

Reference interface skill level usability metric outcome result

Altmann (1987) CI, DI beginner task solving time CI < DI sig.
Karat et al. (1987) CI, DI beginner task solving time CI < DI sig.
Streitz et al. (1989) CI, DI beginner task solving time CI < DI sig.
Sengupta & Te'eni (1991) CI, DI beginner task solving time CI < DI sig.
Margono et al. (1987) CI, DI beginner number of errors CI < DI sig.
Morgan et al. (1991) CI, DI beginner number of errors CI < DI sig.
Morgan et al. (1991) CI, DI beginner time between errors CI < DI sig.
Karat et al. (1987) CI, DI beginner error correction time CI < DI sig.
Morgan et al. (1991) CI, DI beginner error-free time CI < DI sig.
Margono et al. (1987) CI, DI beginner subjective rating CI < DI sig.
Morgan et al. (1991) CI, DI beginner subjective rating CI < DI sig.
Torres-Chazaro et al.(1992) CI, DI beginner subjective rating CI < DI sig.
Sengupta & Te'eni (1991) CI, DI beginner efficient usage CI < DI sig.
Tombaugh et al. (1989) CI, DI advanced subjective rating CI < DI sig.
Torres-Chazaro et al.(1992) CI, DI advanced subjective rating CI < DI sig.
Roberts & Moran (1983) CI, MI, DI experts task solving time CI < DI sig.
Peters et al. (1990) CI, MI, DI experts oblivion's errors CI < DI sig.
Peters et al. (1990) CI, MI, DI experts recognition error CI < DI sig.
Peters et al. (1990) CI, MI, DI experts efficiency CI < DI sig.
Margono et al. (1987) CI, DI beginner task solving time CI < DI not sig.
Morgan et al. (1991) CI, DI beginner task solving time CI < DI not sig.
Tombaugh et al. (1989) CI, DI advanced task solving time CI < DI not sig.
Roberts & Moran (1983) CI, MI, DI experts error correction time CI < DI not sig.
Altmann (1987) CI, DI beginner subjective rating CI > DI not sig.
Masson et al. (1988) CI, DI advanced task solving time CI > DI sig.
 space action space
action
on and
ercepti
np
betwee
nce
dista

perception space
PDFIP Input... GROUP.primary_key PDO
PAFIP Delete...
Update... Primy_key Last_name First_name
Edit...
Browse... CH..8057 Bauknecht Kurt PAO
GROUP ADDRESS CH..8092 Ackermann David
CH..8092 Greutmann Thomas PDFIP
CH..8092 Spinas Philipp
CH..8092 Ulich Eberhard
D...8024 Hacker Winfried
JOINFILE
USA.20742 Shneiderman Ben

DC
CLIPBOARD selection
calculation
clipboard
IM/EXPORT count
mask
attributes
sorting
SORTBOARD
MERGE PDO =
DISCETTE
PAFIP
PRINTER TRASH
 Playing time per game
500
Cell Line Chart for "playing time"
450 Grouping Variable(s): Interface type
Error Bars: ± 1 Standard Deviation(s)
400
Cell Mean for time of user (s)

350

300

250

200

150

100

50

0
CI MI TI DPD
p≤.001 p≤.01 p≤.001
p≤.001
p≤.001
p≤.001

Winning chance per dialog technique

user win
Cell Line Chart for "winning chance"
Grouping Variable(s): Interface type
Error Bars: ± 1 Standard Deviation(s)

remis

computer win

CI MI TI DPD
p≤.020 p≤.080 p≤.001
p≤.802
p≤.001
p≤.007
Architecture of a
Natural User Interface (NUI)

Communication & Working Area

Electronic
documents
Paper
document
Working Area

Wellner P, Mackay W, Gold R:

Computer-Augmented Environments: Back to the Real World. (1993)

Fitzmaurice G, Ishii H, Buxton W:

Bricks: Laying the Foundations for Graspable User Interfaces. (1995)

Tognazzini B:
Tog on Software Design. (1996).
List of relevant books:

About HCI in general:

L. Barfield: The user interface - concepts & design. Addison Wesley, 1993.
P. Booth: An introduction to Human-Computer Interaction. Lawrence Erlbaum, 1990.
A. Dix, J. Finlay, G. Abowd, R. Beale: Human-Computer Interaction. Prentice, 1993.
L. Macaulay: Human-Computer Interaction for Software Designers. Thomson, 1995.
D. Norman, S. Draper: User centered system design. Lawrence Erlbaum, 1986.
J. Preece, Y. Rogers, H. Sharp, D. Benyon, S. Holland, T. Carey: Human-Computer Interaction.
Addison Wesley, 1994.
B. Shneiderman: Designing the user interface. Addison Wesley, 1997, 3rd edition.

About design principles:

C. Brown: Human-Computer Interface design guidelines. Ablex, 1989.

W. Galitz: Handbook of screen format design. QED, 1989.
C. Gram, G. Cockton (eds.): Design priniples for interactive software. Capman & Hall, 1996.
D. Hix, R. Hartson: Developing user interfaces. Wiley, 1993.
ISO 9241 (Part 10: Dialogue principles, Part 12: Presentation of information, Part 14: Menu
dialogues, Part 15: Command dialogues, Part 16: Direct manipulation dialogues, Part 17: Form
fill-in dialogues)
D. Mayhew: Priniples and guidelines in software user interface design. Prentice, 1992.

About usability evaluation methods:

J. Dumas, J. Redish: A practical guide to usability testing. Ablex, 1993.
D. Freedman, G. Weinberg: Walkthroughs, Inspections, and technical reviews. Dorset, 1990.
ISO 9241 (Part 11: Guidance on usability, Part 13: User guidance)
A. Monk, P. Wright, J. Haber, L. Davenport: Improving your Human-Computer Interface: a
practical technique. Prentice Hall, 1993.
J. Nielsen, R. Mack (ed.): Usability inspection methods. Wiley, 1994.

About Design:

D. Norman: The psychology of everyday things. Basic Books, 1988.