Real Time Data Mining Techniques for

Anomaly Detection in Syncrophasor Data at PDC

Deshawn Williams, Steele Warner, Toresen Golberg, Taylor McGrew, Spencer Thomas
Advisors: Dr. Yinghui Wu, Dr. Anurag Srivastava
Smart Grid Demonstration and Research Investigation Lab (SGDRIL)
The School of Electrical Engineering and Computer Science

Abstract
Phasor Measurement Units (PMU) have become the forefront of smart grid measuring devices stemming from their high rate of data sampling and signal processing for real time monitoring of power system operation. Although important for the future of
power system automation and protection, PMUs present challenges for Wide Area Monitoring System (WAMS) implementation arising from network security, signal noise and communication issues. We evaluate two techniques that allow for anomaly
detection in PMU data streams to enable real time control and dynamic event detection seen during power system operation. Developed techniques also enable high data quality utilized for substation level applications and Energy Management System (EMS)
applications running in control centers.

Motivation Testbed Architecture Simulation Results

Ø  The future of fully “automated” power systems begins with our ability to understand dynamic
Chebyshev on Haar Decomposition Transform Haar + K-Means Recall vs Range at Lowest Level
events upstream of control centers. If we can utilize big data mining techniques combined with 500 1

rapid sampling of PMU’s, we will one day be able to “predict” changes to the system and 450 0.9

actuate automated schemes ahead of control center operation. 400 0.8

350
0.7

Flagged Anomalies
Objective
300
0.6 16
250 32

Recall
0.5
64
200

(Fig.1. Stage One)

128
0.4
150 256

Ø  Assess the efficiency and accuracy that can be achieved from data mining algorithms used in 100
0.3 512
1024

time series applications and provide new methods that ultimately will further our ability to 50
0.2

detect bad data and monitor our power system in real time reliably. 0
0 0.005 0.01 0.015 0.02 0.025 0.03
0.1

0
P2 Value 0 0.02 0.04 0.06 0.08 0.1 0.12

Ø  Implement techniques Haar+ K-means and Haar + Chebyshev for data cleansing application Haar 4 Haar 8 Haar 16 Outlier Range

using synthetic data generated using an industrial PMU connected to simulated data anomalies Chebyshev on Inverse Haar Transform Haar + K-Means False Positive vs Range at
generated by modeled power system test cases in RTDS. 1800 Lowest Level
1600 1

Data Mining Techniques for Anomaly Detection

1400 0.998

1200 0.996

Flagged Anomalies
1000 0.994
16

False Positive
0.992 32

(Fig.2. Stage Two) (Fig.3. Stage Three)

800
64
600 0.99
128

0.988 256
400
512
200 0.986 1024

0 0.984

Design/Testing Approach 0 0.005 0.01

Inverse 4
0.015

P2 Value

Inverse 8
0.02

Inverse 16
0.025 0.03
0.982
0 0.02 0.04 0.06

Outlier Range
0.08 0.1 0.12

We implement a three stage test bed for evaluation and enhancement of our
derived techniques….
Ø  Stage One: Develop and evaluate accuracy/precision of data mining techniques using an “offline”
PMU CSV file with pre-inserted anomies. Test using visual studios. (Fig.1)
Ø  Stage Two: Using OpenPDC, evaluate accuracy/precision of techniques when applying IEEE
C37.118 data packets. Implement the CSV file as an “input adapter” to supply “live data” to the
derived algorithms which are implemented as an action adapter. (Fig.2)
Ø  Stage Three: Use RTDS Simulator and SEL PMU from Dr. Srivastava’s Lab to simulate “live” data
streaming to our data mining methods. Implement testing using OpenPDC and PMU Connection
Tester. (Fig.3)
Conclusion
Ø  After performing first stage analysis, although K-means performed well detecting
recall (true positives) it’s precision in time stream applications performed very poorly
resulting in a high false positive detection rate compared to Chebyshev.
Future Work
Ø  Enhance derived methods for better accuracy and precision in live PMU data streams.
Ø  Apply Data Mining Techniques in OpenPDC software for stage two and stage three
testing.

Acknowledgments
Glossary
Ø  Our team would like to personally thank Dr. Anurag Srivastava and Dr. Yinghui Wu
Ø  PMU – Phasor Measurement Unit
for taking the time to mentor and guide us through this project.
Ø  PDC – Phasor Data Concentrator
Ø  WAMS – Wide Area Monitoring System
Ø  EMS – Energy Management System
Ø  RTDS – Real Time Digital Simulator
Team Caravel