Swiss Federal Institute of Technology Zrich

Institute for Hygiene and Applied Physiology Prof.Dr. Dr. Helmut Krueger Clausiusstr. 25, CH-8092 Zrich

Introduction into HumanComputer Interaction

Matthias Rauterberg

1998

view from outside view from inside

user's perspective

developer's perspective

operator

operation

function

DIN 66 234 part 8 (1988) EC directive 90/270/EEC (1990) Ulich (1991) ISO 9241 part 10 (1996)

suitability for the task self-descriptiveness transparency feedback conformitity with user expectations compatibility consistency

suitability (activity adapted)

suitability for the task

task orientation

self-descriptiveness

feeback about system states

appropriate format and pace of information presentation

conformity with user expectations

information and instruction of user

suitability for learning suitability for individualization

support selection possibilities user definability participation

ease of use applicable to skill level

hearing and participation of users controllability error tolerance

controllability

flexibility

error robustness

transparency
feedback

compatibility

consistency

help support

individualisation
flexibility individual selection individual adaptation (programming)

potential degree of freedom (meta-dialog task)

actual degree of freedom

Differences between the visual and the auditory sense

The two most important constrains in interface design

the control of user's attention the physical size of the screen

feedback modalities
pros
parallel in space

cons
active eye contact neccessary

visual

large information transfer

enforces attention allocation enables the perception of background activities important for visually impaired people

noise through environment linear in time

acoustic

exists only for a short time span

force perception

linear in time contact with objects neccessary

haptic

object recognition textur and surface perception

human memory
remember rate
100% 80% 60% 40%

20% 0 3 6 9 12 15 18

time interval until remember items (in sec)

internal memory

external memory

long term memory

storage component

goals plan

expectations

action component

motoric memory visual "memory" visual output

perception component

Operation Eingabe

auditory "memory" acoustic output

haptic "memory" tactile output

input-handler

output-handler (DC)

output-handler (AC)

representation dialogstates (DCS)

dialog functions (DF)

dialogobjects (DO)

dialog-component (DC) application states (ACS) applicationFunktionen (AF) applicationobjects (AO) transformation

application component (AC)

user interface

user

problem solving component

short term memory

task(s)
on ati tom ty au ali on cti fun

esi kd tas qu ali

gn fic a tio n

usability

user
training

computer

user-oriented requirement analysis

know the user describe the context of use analyse the users tasks decide for man-machine function allocation

the complete action cycle

task(s)

goal-, subgoal-setting

feedback control of action

3a 3b

planning of execution selection of means

mental operation physical operation

usability specification map (USM)

global design principles

control

high level goals

customization

measuring concepts

flexibility

criteria = metric + extent

fan degree

scale type nominal ordinal interval rational

examples in the context of HCI classification of interfaces (e.g. command, menu, desktop etc.) summative evaluation studies (e.g. CUI versus GUI) checklist evaluation (e.g. expert's opinion) quantitative metrics

Methods to Measure Usability Quality user's involvement

virtual
formal view:

real inquieries, interview, mock-ups

interaction-oriented view:

virtual

formal modelling

computer's involvement
real

product-oriented view:

expert evaluation

usability test

effort and costs

ecological validity

user-oriented view:

the advanced Seeheim-model:

application manager
am application

user

i/o interface

dialog

dm

organisation

i / o manager

dialog manager

organisation

socio-technical system

An abstract concept to describe usability aspects

function space FS

perceptible functions PF

hidden functions HF

perceptible dialog functions PDFIP

[hidden] dialog functions HDFIP

perceptible application functions PAFIP

[hidden] application functions HAFIP

schema of the dialog structure

function: switch HDFIP PDFIP HAFIP PAFIP 11 10 0 0 function: file HDFIP PDFIP HAFIP PAFIP 3 3 0 0 main menu HDFIP PDFIP HAFIP PAFIP 14 14 0 0

modul: information HDFIP PDFIP HAFIP PAFIP 10 10 0 0 filter: data HDFIP PDFIP HAFIP PAFIP 2 modul: calculation HDFIP PDFIP HAFIP PAFIP 10 10 0 0 2 46 1

program: data HDFIP PDFIP HAFIP PAFIP 2 2 56 9

schematic diagram
actual dialog context

i/o-interface

HAFIP
A.function-1

object space

A.function-2 A.function-3

PAFIP

A.function-4 A.function-5

PDFIP HDFIP

A.function-6

application component
D.F1 D.F2 D.F3 D.F4

dialog-component

a command language interface

PAO PAFIP DC

MS-DOS Vers. 3.01

C:>_

command language interface (CUI)

application specific interaction point (HAFIP)
A.Function-1 A.Function-2

actual dialogcontext

i/o interface

perceptible function point (PF) dialog specific interaction point (HDFIP)

A.Function-3 A.Function-4 A.Function-5 A.Function-6 A.Function-7

D.F1

D.F2

...

dialog manager

application manager

a menu-driven interface (CUI)

PAFIP PAO

[.........1.........2.........3.........4.........5.........6..]..

the normal view on a text document MsWORD 4.0

DC

PDFIP PAFIP PDO

TEXT.DOC COMMAND: Copy Delete Format Gallery Help Insert Jump Library Options Print Quit Replace Search Transfer Undo Window Edit document or press Esc to use menu Pg1 Ro1 Co1 {} ? Microsoft Word

menu driven interface (CUI)

actual dialogcontext representation of an application specific interaction point (RAFIP) representation of a dialog specific interaction point (RDFIP) dialog specific interaction point (DFIP)

i/o interface

application specific interaction point (AFIP)

A.Function-1 A.Function-2 A.Function-3 A.Function-4 A.Function-5 A.Function-6 A.Function-7

D.F1

D.F2

...

application manager

dialog manager

GUI: a desktop interface

Program

PDFIP

Desk File Edit Join Selection Calculation Switches Option

JOIN.Customer-No JOIN.Customer-No ( Customer-No Article-No Quantity ) discette

PAO

customer

article

500010 500010 604650 604650 604650

1001 1002 1001 1002 2004

250 10 500 100 50

printer PAFIP

supplies

PDO

DC clipboard

contracts

mixboard

sortboard

im/export

trash

PDFIP

F1 Input F3 Update F4 Search

F2 Delete

F5 Browse

F6 File

F7 Key

F8 Sort.

F10 Quit

heap 100 memory 2

direct manipulative interface (GUI)

actual dialogcontext representation of an application specific interaction point (RAFIP)

i/o interface

application specific interaction point (AFIP)

A.Function-1 A.Function-2 A.Function-3 A.Function-4

representation of a dialog specific interaction point (RDFIP) dialog specific interaction point (DFIP)

A.Function-5 A.Function-6

application manager
D.F1 D.F2

...

dialog manager

quantitative measure of "functional feedback": D

FB

= 1/D

d=1

(#PFd / #HFd) * 100%

quantitative measure of "fan degree": D FD = 1/D

f HAFIP

Post(Dd,f)

d=1

quantitative measure of "dialog flexibility":

DFl = 1/D

d=1

#HDFIPd

quantitative measure of "application flexibility": D AFl = 1/D

#HAFIPd

d=1

quantitative measure of "feedback": D

FB = 1/D

d=1

(#PFd / #HFd) * 100%

quantitative measure of "interactive directness": P ID = {1/P

min[lng(PATHp)] }-1 * 100%

p=1

[visual] feedback (FB)

low batch low high menu interface

interactive directness (ID)

high

MI
command language
desktop style

direct manipulation

CI

DI

The outcomes of nine (9) different comparison studies between command (CI) and menu (MI) interfaces.
"CI < MI" means that the average usage/preference with/for MI is better than with/for CI; "CI = MI" means that there are no published data to decide; "CI > MI" means that the average usage/preference with/for CI is better than with/for MI; "sig." means that p 0.05; "not sig." means that p > 0.05 Reference Streitz et al. (1987) Chin et al. (1988) Ogden & Boyle (1982) Roy (1992) Roberts & Moran (1983) Chin et al. (1988) Peters et al. (1990) Peters et al. (1990) Peters et al. (1990) Ogden & Boyle (1982) Roy (1992) Antin (1988) interface CI, MI CI, MI CI, MI, HY CI, MI CI, MI, DI CI, MI CI, MI, DI CI, MI, DI CI, MI, DI CI, MI, HY CI, MI CI, MI, KMI skill level beginner beginner beginner advanced experts experts experts experts experts beginner advanced advanced beginner beginner beginner beginner advanced experts advanced advanced advanced experts usability metric task solving time subjective rating preferences error rate task solving time subjective rating slips recognition errors efficiency task time task solving time subjective rating task solving time number of errors subjective rating preferences outcome CI < MI CI < MI CI < MI CI < MI CI < MI CI < MI CI < MI CI < MI CI < MI CI < MI CI < MI CI < MI CI = MI CI = MI CI = MI CI > MI result sig. sig. sig. sig. sig. sig. sig. sig. sig. not sig. not sig. not sig. not sig. not sig. not sig. not sig. not sig. not sig. sig. sig. sig. sig.

Hauptmann & Green (1983) CI, MI, NO Hauptmann & Green (1983) CI, MI, NO Hauptmann & Green (1983) CI, MI, NO Whiteside et al. (1985) Antin (1988) Roberts & Moran (1983) Whiteside et al. (1985) Streitz et al. (1987) Antin (1988) Whiteside et al. (1985) CI, MI, IO CI, MI, KMI CI, MI, DI CI, MI, IO CI, MI CI, MI, KMI CI, MI, IO

task completion rate CI > MI error-free task time CI > MI task completion rate CI > MI task solving time CI > MI task completion rate CI > MI task completion rate CI > MI

The outcomes of twelve (12) different comparison studies between command (CI) and direct manipulative (DI) interfaces.
"CI < DI" means that the average usage/preference with/for DI is better than with/for CI; "CI = DI" means that there are no published data to decide; "CI > DI" means that the average usage/preference with/for CI is better than with/for DI; "sig." means that p 0.05; "not sig." means that p > 0.05

Reference Altmann (1987) Karat et al. (1987) Streitz et al. (1989) Sengupta & Te'eni (1991) Margono et al. (1987) Morgan et al. (1991) Morgan et al. (1991) Karat et al. (1987) Morgan et al. (1991) Margono et al. (1987) Morgan et al. (1991) Sengupta & Te'eni (1991) Tombaugh et al. (1989) Roberts & Moran (1983) Peters et al. (1990) Peters et al. (1990) Peters et al. (1990) Margono et al. (1987) Morgan et al. (1991) Tombaugh et al. (1989) Roberts & Moran (1983) Altmann (1987) Masson et al. (1988)

interface CI, DI CI, DI CI, DI CI, DI CI, DI CI, DI CI, DI CI, DI CI, DI CI, DI CI, DI CI, DI CI, DI CI, MI, DI CI, MI, DI CI, MI, DI CI, MI, DI CI, DI CI, DI CI, DI CI, MI, DI CI, DI CI, DI

skill level beginner beginner beginner beginner beginner beginner beginner beginner beginner beginner beginner beginner beginner advanced advanced experts experts experts experts beginner beginner advanced experts beginner advanced

usability metric task solving time task solving time task solving time task solving time number of errors number of errors

outcome CI < DI CI < DI CI < DI CI < DI CI < DI CI < DI

result sig. sig. sig. sig. sig. sig. sig. sig. sig. sig. sig. sig. sig. sig. sig. sig. sig. sig. sig. not sig. not sig. not sig. not sig. not sig. sig.

time between errors CI < DI error correction time CI < DI error-free time subjective rating subjective rating subjective rating efficient usage subjective rating subjective rating task solving time oblivion's errors recognition error efficiency task solving time task solving time task solving time subjective rating task solving time CI < DI CI < DI CI < DI CI < DI CI < DI CI < DI CI < DI CI < DI CI < DI CI < DI CI < DI CI < DI CI < DI CI < DI CI > DI CI > DI

Torres-Chazaro et al.(1992) CI, DI

Torres-Chazaro et al.(1992) CI, DI

error correction time CI < DI

nce dista

be

np twee

erc

on epti

and

sp ction

ace

action space

perception space

PDFIP PAFIP GROUP.primary_key Primy_key Last_name First_name

PDO PAO PDFIP

Input... Delete... Update... Edit... Browse...

GROUP

ADDRESS

JOINFILE

CH..8057 CH..8092 CH..8092 CH..8092 CH..8092 D...8024 USA.20742

Bauknecht Ackermann Greutmann Spinas Ulich Hacker Shneiderman

Kurt David Thomas Philipp Eberhard Winfried Ben

CLIPBOARD IM/EXPORT

SORTBOARD MERGE PRINTER

selection calculation clipboard count mask attributes sorting

DC

DISCETTE TRASH

PDO = PAFIP

Playing time per game

500 450 Cell Mean for time of user (s) 400 350 300 250 200 150 100 50 0 Cell Line Chart for "playing time" Grouping Variable(s): Interface type Error Bars: 1 Standard Deviation(s)

CI
p.001

MI
p.01 p.001 p.001

TI
p.001 p.001

DPD

Winning chance per dialog technique

user win Cell Line Chart for "winning chance" Grouping Variable(s): Interface type Error Bars: 1 Standard Deviation(s)

remis

computer win

CI
p.020

MI
p.080 p.802 p.007

TI
p.001 p.001

DPD

Architecture of a Natural User Interface (NUI)

Communication & Working Area

Electronic documents Paper document Working Area

Wellner P, Mackay W, Gold R: Computer-Augmented Environments: Back to the Real World. (1993) Fitzmaurice G, Ishii H, Buxton W: Bricks: Laying the Foundations for Graspable User Interfaces. (1995) Tognazzini B: Tog on Software Design. (1996).

List of relevant books: About HCI in general:

L. Barfield: The user interface - concepts & design. Addison Wesley, 1993. P. Booth: An introduction to Human-Computer Interaction. Lawrence Erlbaum, 1990. A. Dix, J. Finlay, G. Abowd, R. Beale: Human-Computer Interaction. Prentice, 1993. L. Macaulay: Human-Computer Interaction for Software Designers. Thomson, 1995. D. Norman, S. Draper: User centered system design. Lawrence Erlbaum, 1986. J. Preece, Y. Rogers, H. Sharp, D. Benyon, S. Holland, T. Carey: Human-Computer Interaction. Addison Wesley, 1994. B. Shneiderman: Designing the user interface. Addison Wesley, 1997, 3rd edition.

About design principles:

C. Brown: Human-Computer Interface design guidelines. Ablex, 1989. W. Galitz: Handbook of screen format design. QED, 1989. C. Gram, G. Cockton (eds.): Design priniples for interactive software. Capman & Hall, 1996. D. Hix, R. Hartson: Developing user interfaces. Wiley, 1993. ISO 9241 (Part 10: Dialogue principles, Part 12: Presentation of information, Part 14: Menu dialogues, Part 15: Command dialogues, Part 16: Direct manipulation dialogues, Part 17: Form fill-in dialogues) D. Mayhew: Priniples and guidelines in software user interface design. Prentice, 1992.

About usability evaluation methods:

J. Dumas, J. Redish: A practical guide to usability testing. Ablex, 1993. D. Freedman, G. Weinberg: Walkthroughs, Inspections, and technical reviews. Dorset, 1990. ISO 9241 (Part 11: Guidance on usability, Part 13: User guidance) A. Monk, P. Wright, J. Haber, L. Davenport: Improving your Human-Computer Interface: a practical technique. Prentice Hall, 1993. J. Nielsen, R. Mack (ed.): Usability inspection methods. Wiley, 1994.

About Design:
D. Norman: The psychology of everyday things. Basic Books, 1988.