Introduction to Machine

Learning

Presented by-
Pragya Sonwani
(1573513029)
 Machine Learning Definition
• Field of study that gives
computer the ability to learn
without being explicitly
programmed (Arthur Samuel,
1956)
• Study of algorithms that improve
their performance P at some task T: Play checkers
P: % of games won
T with experience E (Tom E: Playing against self
Mitchell, 1998)
Well defined learning task: <P, T, E>
 Well Defined Learning Task
• Handwriting Recognition
– Task T: recognizing and classifying handwritten
words within images
– Performance P: percent of words correctly
classified
– Training experience E: a database of written words
with given classification
 Question
• Suppose your email program watches which
email you do and do not mark as spam and
based on that learn how to better filter spam.
What is the task in this setting
– Classifying emails as spam or not spam
– The number of emails correctly classifying as
spam/not spam
– Labelling emails as spam/ not spam
– Non of above: This is not a machine learning
problem
 Machine Learning Algorithms
• Supervised Learning Algorithms
• Unsupervised Learning Algorithms
 Supervised Learning

• Right answers are given for inputs

• Regression refers to predicting continuous
valued output (e.g. price)
 Supervised Learning

• Classification refers to predict discrete valued

output (e.g. 0 or 1)
 Supervised Learning

• More sophisticated features are:

– Uniformity of cell size
– Uniformity of cell shape, etc
Unsupervised Learning
Unsupervised Learning Application
Unsupervised Learning Application
Unsupervised Learning Application

Figure: DNA microarray data of individuals

 Unsupervised Learning Application
Fridge, computer and dishwasher
3000

2500

2000
Average power consumptionn[W]

1500

1000

250

200 Fridge and computer

150 Fridge

100

50

0
0 50 100 150 200 250 300 350 400 450
Windows [#]
Window size = 2 minutes
 Unsupervised Learning Application
State sequence of fridge Fridge, computer and dishwasher
StateState sequence
sequence of of diswasher
fridge and computer
3000 S2S6 S1 S5S7 S4 S2S6 S3 S5S7
State: S1
120
160
3000 State: S2
State: S1S2S2
State:
State: State: S3
140 2500 State:
State:S
State: S S
1002500 State: S4
power [W]

3 5 5
power

State:
State: S S State: S5
[W]

4 S6
consumption [W]

120
power

802000 State:
consumption

2000
7 State: S6
consumption

100 State: S7
Average

601500
Average power consumptionn[W]

80
Average
Average

40 1500
601000
40
20
1000
500
20
0
00 0310 10 320 20 330 30 340 40 350 50 360 60 370 70 380 80 390
250 130 140 150 Windows
120 160 170 [#] 180 190 200 210
WindowsWindows
[#] [#]
200 Fridge and computer

150 Fridge

100

50

0
0 50 100 150 200 250 300 350 400 450
Windows [#]
Window size = 2 minutes
Unsupervised Learning
Applications
Unsupervised Learning Application:
Cocktail Party Problem
Reinforcement Learning

1.Learn from delayed feedback

E.g. Machine learns how to play chess