Data Mining

Spring 2015

Introduction to Data Mining

Dr. Shariq BASHIR
shariq.bashir@bui.edu.pk

 Instructor:
Dr. Shariq Bashir
PostDoc: New York University Abu Dhabi
PhD: Vienna University of Technology, Austria

Faculty Room (13 XC Basement)

Tel: 051-9260002 (Ext 411)
shariq.bashir@bui.edu.pk

Student Hours
Between 11:30 AM 1:30 PM (Monday)

Yahoo Group
DataMining_BU_Spring_2015
https://groups.yahoo.com/neo/groups/DataMining_BU_Spring_2015/info

Grading Scheme

Method
Quizzes

Weight (%)
5

Assignments/Proj
ects

25

Midterm

20

Final

50

Comparison with Data Structure

Data Mining is not related to Data Structures
Data Structures is about how to store data
efficiently in storage devices (RAM, External
Memory)
But we will utilize data structures concepts
(especially linked lists, Tress, B-Tress,
Graphs) during exploring Data Mining
techniques

Comparison with DBMS

Data Mining is not DBMS
DBMS is mostly about Query Processing
SQL
In DBMS, your requirements (query) are mostly
precise, and you are mostly interested in
extracting a subset of database
e.g. show the records of all those employers
who have monthly salary > 50,000 rupees

Definition of Data Mining

Data Mining is about extraction of previously
unknown and potentially useful information
In DM, you have data but mostly you dont know
what you are trying to find
DM is not always related to big data
Queries in DM are not precise
In Style the rating of the Swift is 4/5
but then why
Value for money has rating 3/5

What is Data Mining?

Knowledge Discovery in Databases
(KDD).
Data mining digs out valuable
information from large multidimensional
apparently unrelated data bases(sets).
Its the integration of business
knowledge, statistics, computing
technology and algorithms.
Data mining is used to find hidden
patterns and relationships in data.
7

Data Mining Example

Suppose you have data (from Pakistan
Meteorological Department) of all cities of
last 10 years
Then whether calculating average
temperature of cities is a data mining task or
not?
No, this is not a data mining
task
However if you are going to
utilize this data for forecasting
temperature of Tomorrow, Next
Week or of a whole month

Then this is a data mining

Task
8

Data Mining (More Applications)

Data Mining on Weather Data
Data Mining can forecast natural hazards (like
floods, thunderstorm, hail storm, drought etc.)
Which can save thousands of lives

Data Mining Example

Road Traffic Data (Given the road traffic data of a city)
Calculating the Avg. traffic density of all roads is not
a Data Mining task
However, your task is to find which is the best route
(traffic path) from location A to location B that has low
traffic at 4:00PM then this is a data mining task

10

Data Mining Example

Collection of images
Find the two top images in a image database that
have best similarity with query image (Q).
Image Database

query image Q

O1

O3

O4

O0

O2

Top-2
images
11

11

Data Mining Example

Applications in Biometrics
You can utilize Data Mining techniques for
building efficient Biometrics applications

12

Data Mining
We will cover following techniques

Data Cleansing
Prediction/Forecasting Techniques
Clustering (grouping) similar samples
Ranking of Knowledge (Information Retrieval)
Outlier (noise) removal
Frequent Itemsets Mining

Data could be anything

Relational tables, Web (text) documents,
Images/Videos, Signal of sensors

13

Data Mining Process

Data mining: the core
of knowledge discovery
process.

Data Mining

Data Mining
Task-relevant Data
Data
Warehouse
Data Cleaning
Data Integration

Prediction (Classification) Example

Classification
Algorithms

Known
Data

age
<=30
<=30
3140
>40
>40
>40
3140
<=30
<=30
>40
<=30
3140
3140
>40

income student credit_rating

high
no fair
high
no excellent
high
no fair
medium
no fair
low
yes fair
low
yes excellent
low
yes excellent
medium
no fair
low
yes fair
medium
yes fair
medium
yes excellent
medium
no excellent
high
yes fair
medium
no excellent

age?

<=30

student?

overcast
30..40

yes

>40

credit rating?

no

yes

excellent

fair

no

yes

no

yes

Each Leaf node represents a class.

15

Ranking of Knowledge
(Information Retrieval)
Goal: Rank the knowledge most relevant to
the user Query
Dealing with notions of:
Collection of information (documents, images,
videos, voice, etc)
Query (Users information need)

16

Ranking of Knowledge
(Information Retrieval)

Data

Query
String

IR
System

Ranked
Documents

1. Doc1
2. Doc2
3. Doc3
.
.
17

Reference Books
Books
1. Jiawei Han and Micheline Kamber. Data
Mining: Concepts and Techniques. Third Edition,
Morgan Kaufmann, 2011.
Chapter1, Chapter2, Chapter3, Chapter6,
Chapter8, Chapter10, Chapter12
2. Christopher D. Manning,Prabhakar
RaghavanandHinrich Schtze,Introduction to
Information Retrieval, Cambridge University
Press. 200
Chapter1, Chapter2, Chapter3

http://nlp.stanford.edu/IR-book/