STUDY ON HUMAN ACTIVITY

RECOGNITION
USING DEEP LEARNING

Presented by :
RABI GAYAN(180302015)
Mtech IT 3rd Sem
Guide: Dewan Imdadul Islam
CONTENTS
 Objective
 Introduction
 Problems
 Approach to this problems
 Datasets
 Background of HAR
 Literature Survey
 Conclusion
 References
OBJECTIVE
 To develop a novel technique for
analyzing, training and subsequent
learning of un-annotated data that can be
accepted for classifications using standard
low compute classifiers.
INTRODUCTION
 Human Activity Recognition (HAR) has
gained immense research attention over
the past years due to its vast applications
range including robotics, home
automation, security surveillance, remote
health-care and assisted and independent
living for elderly.
 The problem of HAR can broadly be
divided into vision-based and sensor-
based recognition .
Introduction contd.
 In vision-based HAR, video-cameras are
mostly used to generate digitized visual data,
which are then analyzed using computer
vision techniques to detect the activities.
 In sensor-based HAR, small sensory
devices, either in form of wearable
devices/smart phones carried by the human
or embedded into the environment, generate
time-series data defining state change events
or various physical parameters.
Problems
 We observe that standard classifiers are
often dependent on feature rich datasets
and require extensive annotations to
perform well.
 Massive amount of data gathered in smart
homes through tape-on sensors often
lack such rich features.
Action Plan
 We will work with such dataset where a large number
of sensor responses are recorded in a smart home
scenario.
 Our primary motivation is to learn this data so as to
extract the critical features and annotate each activity.
 We will employ a deep neural network based
technique to learn the inherent features in such data
and see if traditional classifiers would do well in
recognizing the different activities.
 We will apply a variant of RNN called Long Short
Term Memory (LSTM) to learn the important features
from the data and subsequently perform annotations.
Datasets
 In order to validate our work, we focus on
data collected in a smart home environment.
Towards that we focused on datasets
generated by the Centre for Advanced
Studies in Adaptive Systems(CASAS) [4] at
the Washington State University’s School of
Electrical Engineering and Computer
Science Department.
 CASAS repository contains over 60 datasets
from which we have chosen two of the
datasets, namely the Aruba and the Tulum
datasets.
Dataset Used
Background
• This stage involves the extraction in short or long-time intervals,of sensor data.
• From the data is forward, to a single device that has more powerful hardware.
Data
Acquisition

• This stage includes an analysis and manipulation of data to guarantee there no invalid values
that could compromise the learning stage.
Data • This stage usually begins by removing noise values,proceeded by a segmantation of the
dataset and then apply that into feature selection and extraction to get more valuable data.
Manipulation

• This stage comprehends a training mechanism to help build a classifier model with labelled
or unlabelled data.
Machine • Several different classification model can be used for determining the most accurate
solution performance evaluation mechanisms are used.
learning

Figure 1: Basic steps in HAR system

 LITERATURE SURVEY
Author
Paulo Barbosa
Jindong Wang, Yiqiang Chen,
Shuji Hao, Xiaohui Peng, Lisha
Hu
Sumalatha Ramachandran,
Lakshmi Harika Palivela and C. human suspicious activity using
Giridhara
Schalk Wilhelm Pienaar, Reza
Malekian, Senior Member
N. Yala, B. Fergani, and A.
Fleury
Paper details
Human Activity Recognition
Based on Transfer
Learning,2018
Deep Learning for Sensor-based
Activity Recognition: A
Survey,2019
An intelligent system to detect
deep neural networks,2019
Human Activity Recognition
Using LSTM-RNN Deep Neural
Network Architecture,2019
Towards improving feature
extraction and classification for
activity recognition on streaming
data,2017
JIST
From this paper I understand
the data preparation design
From this I got the
understanding of deep learning
.
Here, I got the idea of
Proposed framework
architecture.
From this, I got the idea of
Model Training
For comparison with the other
state-of-the-art results, we will
compare the study done , over
the same dataset for feature
extraction and classification
CONCLUSION
 To the best of our knowledge, no existing
work has performed annotations on un-
annotated smart home data using
RNN/LSTM, and our work is a first
towards that direction.
 In our work, we will propose a novel
technique for analyzing, training and
subsequent learning of un-annotated data
that can be used for classifications using
standard low compute classifiers.
References
[1].
PauloBarbosa,”HumanActivitiesRecognition:ATransferLearningApproach,
” FACULDADE DE ENGENHARIA DA UNIVERSIDADE DO PORTO
2018.
[2]. Jindong Wang, Yiqiang Chen, Shuji Hao, Xiaohui Peng, Lisha Hu,” Deep
Learning for Sensor-based Activity Recognition: A Survey,”Elsevier Pattern
Recognition Letters ,Volume 119, 1 March 2019.
[3]. Sumalatha Ramachandran, Lakshmi Harika Palivela and C. Giridhara,” An
intelligent system to detect human suspicious activity using deep neural
network,” Journal of Intelligent & Fuzzy Systems, vol. 36, no. 5, pp. 4507-
4518, 2019.
[4]. Schalk Wilhelm Pienaar, Reza Malekian, Senior Member,” Human
Activity Recognition Using LSTM-RNN Deep Neural Network
Architecture,”IEEE,2019
[5]. N. Yala, B. Fergani, and A. Fleury,” Towards improving feature extraction
and classification for activity recognition on streaming data,” Journal of
Ambient Intelligence and Humanized Computing,2016