Jesus A. Gonzalez Supervisor: Dr. Lawrence B. Holder Committee: Dr. Diane J. Cook Dr. Lynn Peterson

SUBSTRUCTURE DISCOVERY IN REAL
WORLD SPATIO-TEMPORAL
DOMAINS
Jesus A. Gonzalez
Supervisor: Dr. Lawrence B. Holder
Committee: Dr. Diane J. Cook
Dr. Lynn Peterson
1
OUTLINE
 Motivation and Goal.

 Knowledge Discovery with Subdue.
 Application to two Real-World Relational
Databases.
 Comparison of Subdue with ILP Systems.
 Conclusion and Future Work.
2
MOTIVATION AND GOAL
 Need to analyze large amounts of information in
real world databases.

 Information that standard tools can not detect.
 Aviation Safety Reporting System Database.
 Earthquake Database.
 Previous knowledge: Spatio-Temporal relations.
3
THE KDD PROCESS
DATA DATA
SELECTION PREPARATION
SPECIFIC COLLECTION
DOMAIN DATA
DATA
SET CLEAN,
PREPARED
DATA
DATA
TRANSFORMATION
DATA
PATTERN MINING
KNOWLEDGE EVALUATION
APPLICATION KNOWLEDGE
SUBDUE
FOUND
PATTERNS
FORMATTED AND
STRUCTURED
DATA
4
SUBDUE KNOWLEDGE DISCOVERY
SYSTEM
 SUBDUE discovers patterns (substructures) in

structural data sets.
 SUBDUE represents data as a labeled graph.
 Inputs: Vertices and Edges.
 Outputs: Discovered patterns and instances.

5
EXAMPLE
Vertices: objects or attributes

Edges: relationships
shape triangle
object
on shape square
object
4 instances of
6
SUBDUE’S SEARCH
 Starts with a single vertex and expand by one
edge.
 Computationally Constrained Beam Search.
 Space is all Sub-graphs of Input Graph.
 Guided by Compression Heuristics.

7
EVALUATION CRITERION
 Minimum Encoding.
 Graph Compression.
 Substructure Size (Tried but did not work).
8
EVALUATION CRITERION
MINIMUM DESCRIPTION LENGTH
 Minimum Description Length (MDL) principle. The

best theory to describe a set of data is the one that
minimizes the DL of the entire data set.
 DL of the graph: the number of bits necessary

to completely describe the graph.
 Search for the substructure that results in the

maximum compression.
9
THE ASRS DATABASE
 The Aviation Safety Reporting System (ASRS).
 Reports of incidents that might affect the aviation

safety.
 Some fields modified or omitted to keep the pilot’s

identity confidential.
 72,504 records, with 74 fields each.

10
THE ASRS DATABASE KNOWLEDGE
REPRESENTATION
Acft _type Small_Transport
Detectors ATC
EVENT 1 Detectors
Cockpit
Detectors
Others
Num _engine
2.000000
Near_in_distance
Surface
Land_Plane
EVENT 2
EVENT m
11
THE ASRS DATABASE
PRIOR KNOWLEDGE
 Connections between events where related airports

are near to each other.
 An airport is near another airport if the distance

between them is not more than 200 km.
 Spatial relations represented with

“near_in_distance” edges.
12
THE ASRS DATABASE
RESULTS
 Data set:
 “CONSEQUENCES”: “ACFT_DAMAGED” or “INJURY”.
 “ACFT_TYPE”: “MED_LARGE_TRANSPORT”.
 Graph:
 1,053 events, 42,723 vertices, 41,669 directed
edges and 18,373 undirected edges.

 File size: 2,143,356 bytes.
13
THE ASRS DATABASE RESULTS
MINIMUM ENCODING HEURISTIC
 Substructure 1 Found with the Minimum Encoding

Heuristic with 374 instances.
2.000000 Crew_ size Med _Large_Transport 2.000000 Crew_ size Med _Large_Transport
Acft _type Acft _type
Flt _plan
IFR Engine_typ Turbojet Engine_typ Turbojet
Mission Lndg _gear Lndg _gear

Passenger Retractable Retractable
Event Event
Operator Operator
Num _engine Num _engine
Role
Air_Carrier 2.000000 Air_Carrier 2.000000
Report_typ Report_typ
Flight_Crew Occ Occ

Surface Surface
Wings Wings
Low_Wing Land_Plane Low_Wing Land_Plane
Near_in_distance
14

Acft_damaged Consequenc Alt_agl_hi

0.0
Fac_type Flt_condit
Airport VMC
Sub_1
Lighting Alt_agl_lo
Daylight 0.0
15

Near_in_distance
Sub_2 Event
16
 Subdue was able to geographically relate incidents that

occurred near to each other and with the same
characteristics.
 This information is valuable for investigating similar

events in a particular region that might be caused for the
same reason.
17
GRAPH COMPRESSION HEURISTIC
 Substructure 3: Problem happening in a region determined

by the area where the substructures were found.
 Substructure 3 interpretation:
 Two incidents that happened near to each other.
 If airplane identification and complete date and time.
 Might find and trace an airplane that failed near one
airport, was reported and later had to land close to this
first airport due to another failure.
18
THE EARTHQUAKE DATABASE
 Several catalogs.
 Sources like the National Geophysical Data Center.
 Each record with 35 fields describing the

earthquake characteristics.
19
KNOWLEDGE REPRESENTATION
PDE_W
Category
Year 1998
Month 01
EVENT 1
Near_in_time
Magnitude
4.5
EVENT 2
Near_in_distance
EVENT 3
EVENT m
20
PRIOR KNOWLEDGE
 Connections between events whose epicenters were

close to each other in distance (<= 75 kilometers).
 Connections between events that happened close to

each other in time (<= 36 hours).
 Spatio-Temporal relations represented with

“near_in_distance” and “near_in_time” edges.
21
RESULTS
 Sample of the events that happened in one year.
 All the fields in the records were considered.
 Graph:
 10,135 events, 136,077 vertices, 125,941
directed edges and 757,417 undirected edges.

 Graph file size: 26,963,605 bytes.
22
THE EARTHQUAKE DB RESULTS
GRAPH COMPRESSION HEURISTIC
 Substructure 8 Found with the Graph Compression

Near_in_time
Sub-1 Sub-7
Depth
33.0000
23
THE EARTHQUAKE DB RESULTS
 Graph Compression works faster --> more iterations.

 Given enough time MDL could find those substructures.
MDL finds substructures using Spatio-Temporal relations.
 Subdue found relations with fields like “Catalog”,
“Month”, “Mag1 Scale”, and “Depth”.
 More earthquakes happened in the months of May and
June.
 Most frequent earthquake depths were 33 and 10
kilometers.
24
DETERMINING EARTHQUAKE
ACTIVITY
 Geologist Dr. Burke Burkart.

 Study of seismology caused by the Orizaba Fault.
25
ACTIVITY
 Geologist Dr. Burke Burkart.
 Study of seismology caused by the Orizaba Fault.
 Fault: A fracture in a surface where a displacement of
rocks also happened.
 Selection of the area of study, two squares:
 First Longitude 94.0W through 101.0W and Latitude
17.0N through 18.0N.
 Second Longitude 94.0W through 98.0W and Latitude
18.0N through 19.0N.
26
ACTIVITY
 Divide the area in 44 rectangles of one half of a degree in

both longitude and latitude.
 Sample the earthquake activity in each sub-area.
 Run Subdue in each sub-area.
27
ACTIVITY
Area Area Coordinates Area Number of
Number Name Events
Latitude Longitude
1 101.0W 100.5W 17.0N 17.5N Gue1 62

2 101.0W 100.5W 17.5N 18.0N Gue2 40
3 100.5W 100.0W 17.0N 17.5N Gue3 57
4 100.5W 100.0W 17.5N 18.0N Gue4 13
5 100.0W 99.5W 17.0N 17.5N Gue5 71
6 100.0W 99.5W 17.5N 18.0N Gue6 15
7 99.5W 99.0W 17.0N 17.5N Gue7 35
8 99.5W 99.0W 17.5N 18.0N Gue8 16
9 99.0W 98.5W 17.0N 17.5N Gue9 13
10 99.0W 98.5W 17.5N 18.0N Gue10 14
26 95.0W 94.5W 17.5N 18.0N Ver1 43

27 94.5W 94.0W 17.0N 17.5N Oaxver4 35
28 94.5W 94.0W 17.5N 18.0N Ver2 23
29 98.0W 97.5W 18.0N 18.5N Pue1 6
30 98.0W 97.5W 18.5N 19.0N Pue2 0
42 95.0W 94.5W 18.5N 19.0N Vergolf5 1

43 94.5W 94.0W 18.0N 18.5N Vergolf4 3
44 94.5W 94.0W 18.5N 19.0N Vergolf6 1 28
ACTIVITY
 Substructure 1 (with 19 instances) and substructure 2 (with

8 instances) found in sub-area 26.
Near_in_distance
Event Event Sub_1
Region_number Region_number
Depth Dept_ctl Coord_qual..
Category Category
61.00 PDE PDE 61.00 33.00 N %
Substructure 1, 19 instances. Substructure 2, 8 instances.
29
ACTIVITY
 This pattern might give us information about the cause of

the earthquakes.
 Subduction also affects this area but it affects at a specific

depth according to the closeness to the Pacific Ocean.
30
SUBDUE’S POTENTIAL
 Subdue finds not only shared characteristics of events, but

also space relations between them.
 Dr. Burke Burkart is studying the patterns to give direction
to this research.
 Expect to find patterns representing parts of the paths of
the involved fault.
 Time relations not considered by Subdue.
 Earthquake’s characteristics.
 Important for other areas.
31
COMPARISON OF SUBDUE WITH ILP
SYSTEMS
 Inductive Logic Programming (ILP) learn logical

relations.
 FOIL, GOLEM, PROGOL.
 SUBDUE competitive
Table 7. Number inAverage
of Rules Used and several domains.
of Errors Made by System per Domain
DOMAIN FOIL GOLEM SUBDUE

Vote 8 / 3.0 9 / 4.3 1 / 9.3
Credit 83 / 33.5 234 / 48.5 1 / 51.2
Diabetes 21 / 30.8 113 / 39.4 1 / 30.6
32
CONCEPT LEARNING SUBDUE
 ILP systems take positive and negative examples

represented with First Order Logic.
 New Concept Learning Subdue (CLSubdue) does too.
 Can learn multiple rules.
 Evaluation is ongoing.
33
CONCLUSION
 Subdue successful in real world databases.

 Subdue discovered interesting patterns using the temporal
and spatial relations.
 Subdue found significant patterns in the Orizaba Fault
Earthquake Database.
 Subdue has potential to compete with ILP systems.
 Subdue compared with Progol.
34
FUTURE WORK
 Theoretical analysis.
 Show Subdue converges to optimal substructure.
 Better understanding of search space properties.
 Bounds on complexity (e.g. PAC learning).
 Graphic User Interface to visualize substructures and their
instances.
 Express ranges of values (ranges of depth, magnitude,
latitude, longitude, etc. in the Earthquake database).
 Continue Evalutation in Real-World Spatio-Temporal
Databases. 35

Jesus A. Gonzalez Supervisor: Dr. Lawrence B. Holder Committee: Dr. Diane J. Cook Dr. Lynn Peterson

Încărcat de

Informații document

Descriere originală:

Titlu original

Drepturi de autor

Formate disponibile

Partajați acest document

Partajați sau inserați document

Opțiuni de partajare

Vi se pare util acest document?

Este necorespunzător acest conținut?

Drepturi de autor:

Formate disponibile

Jesus A. Gonzalez Supervisor: Dr. Lawrence B. Holder Committee: Dr. Diane J. Cook Dr. Lynn Peterson

Încărcat de

Drepturi de autor:

Formate disponibile

SUBSTRUCTURE DISCOVERY IN REAL

 Motivation and Goal.

 Need to analyze large amounts of information in

real world databases.

 SUBDUE discovers patterns (substructures) in

 SUBDUE represents data as a labeled graph.

 Inputs: Vertices and Edges.

 Outputs: Discovered patterns and instances.

Vertices: objects or attributes

 Starts with a single vertex and expand by one

 Computationally Constrained Beam Search.

 Space is all Sub-graphs of Input Graph.

 Guided by Compression Heuristics.

 Substructure Size (Tried but did not work).

 Minimum Description Length (MDL) principle. The

 DL of the graph: the number of bits necessary

 Search for the substructure that results in the

 The Aviation Safety Reporting System (ASRS).

 Reports of incidents that might affect the aviation

 Some fields modified or omitted to keep the pilot’s

 72,504 records, with 74 fields each.

Acft _type Small_Transport

 Connections between events where related airports

 An airport is near another airport if the distance

 Spatial relations represented with

edges and 18,373 undirected edges.

 Substructure 1 Found with the Minimum Encoding

Mission Lndg _gear Lndg _gear

Flight_Crew Occ Occ

 Substructure 3 Found with the Minimum Encoding

Acft_damaged Consequenc Alt_agl_hi

 Substructure 4 Found with the Minimum Encoding

 Subdue was able to geographically relate incidents that

 This information is valuable for investigating similar

 Substructure 3: Problem happening in a region determined

 Sources like the National Geophysical Data Center.

 Each record with 35 fields describing the

 Connections between events whose epicenters were

 Connections between events that happened close to

 Spatio-Temporal relations represented with

 Sample of the events that happened in one year.

 All the fields in the records were considered.

directed edges and 757,417 undirected edges.

 Substructure 8 Found with the Graph Compression

 Graph Compression works faster --> more iterations.

 Geologist Dr. Burke Burkart.

 Divide the area in 44 rectangles of one half of a degree in

 Sample the earthquake activity in each sub-area.

 Run Subdue in each sub-area.

1 101.0W 100.5W 17.0N 17.5N Gue1 62

26 95.0W 94.5W 17.5N 18.0N Ver1 43

42 95.0W 94.5W 18.5N 19.0N Vergolf5 1

 Substructure 1 (with 19 instances) and substructure 2 (with

61.00 PDE PDE 61.00 33.00 N %

Substructure 1, 19 instances. Substructure 2, 8 instances.

 This pattern might give us information about the cause of

 Subduction also affects this area but it affects at a specific

 Subdue finds not only shared characteristics of events, but

 Inductive Logic Programming (ILP) learn logical

 FOIL, GOLEM, PROGOL.

DOMAIN FOIL GOLEM SUBDUE

 ILP systems take positive and negative examples