Visual Machine Intelligence for Home Automation

Suraj∗, Ish Kool†, Dharmendra Kumar‡and Shovan Barma§

Indian Institute of Information Technology Guwahati Assam, India
∗hrishabhsuraj52@gmail.com,†kool382@gmail.com,‡rajdharmendra307@gmail.com,§shovan@iiitg.ac.in

Abstract- In this paper, we present a vision-based machine intelligence system to sense the ON/OFF state of
commonly used household appliances like Television, Fan, and Tubelight/CFL. The visual modality of sensing the
state of appliance acts as a proactive substitute to sensors used in the home automation network. The sensor-based
home automation system suffers significant complexity in terms of cost and implementation whenever the suite of
devices/appliances in the home automation increases. To overcome the complexity of home automation system in
terms of cost and implementation, our proposed system uses vision-based machine intelligence to detect the states of
multiple appliances without being dependent on the number of appliances. This proposed method of sensing the states
of appliances thus give rise to a novel home automation system. The proposed home automation interface has multiple
advantages over traditional home automation interfaces which incorporate the use of various discrete sensors. A switch
to toggle between the visual monitoring of the home and sense of the home without sending images Makes this system
a bimodal approach towards Home automation which keeps a check on the privacy issues. The proposed machine
learning based approach was found to effectively switch ON/OFF the appliances like TV, Fan, and Light and
accordingly, update the user about the state of the appliance on a website.

Keywords - Machine learning, Home automation, Computer vision, Internet of things.

Low Cost Energy Efficient Smart Security System

with Information Stamping for IoT Networks
Jayendra Kumar Paidi Raja Ramesh
Deptt.ofElectronics & Communication Engg. Deptt.ofElectronics & Communication Engg.
National Institute of Technology Jamshedpur, National Institute of Technology Jamshedpur,
India India.
jkumar.ece@nitjsr.ac.in paidi.rajaramesh@gmail.com

Abstract- A security system with CCTV and other network nodes in IoT deals with large amount of data, so the need
for devices with larger storage space comes into the picture which is a bit costlier. Traditional security systems are
more power consuming as it has to record for 24x7 with more throughput but less efficient. Thus need human in
middle to upload into cloud is needed. In this work, we propose a low-cost energy efficient smart security system for
CCTV with other network nodes. Whenever motion is detected by passive infrared (PIR) sensor, at that time only the
camera and all other security sensor nodes in network are activated (Switched on), the captured video and information
(sensor data) are stamped on the image using image processing techniques on Python platform. It will be stored in a
local storage device, after certain threshold (based on sensitivity of the location) data will be uploaded into the cloud
along with data log created during processing stage by Python programming model. In this way, we can reduce the
amount of data to be stored (as no recording when idle), consumed power (as device is switched off when idle),
maintenance cost(as fully programmed). No need for human in middle for uploading data into the cloud (as program
will upload data in to cloud). Because of time, date and information (data from sensor nodes) stamping on each frame
of video using python programming model video access becomes easier, as data log will be created.

Keywords - IoT; PIR sensor; Storing in cloud; information stamping; Motion Detection.