Sunteți pe pagina 1din 6

Bonfring International Journal of Software Engineering and Soft Computing, Vol. 9, No.

2, April 2019 58

Smart Home Implementing IOT Technology with


Multilingual Speech Recognition System
Angshuman Chakrabartty, Ashish Adhikari,
Jurisra Sorokhaibam and Dr.J. Nirmala Devi

Abstract--- There is nothing like staying at home for real and the output might be a contradiction with sustainable and
comfort. This era is a technical era. People are searching for healthy lifestyle. To mitigate the situation, the use of
smart way of doing every little-to-big things in their life.so technology to reduce human labor are increasing
there is no exception for home at all. We can use automation exponentially. People are fighting with the sword of
technologies to make life easier for all kinds of people. Analog technologies against hard, tedious and mind wrecking tasks.
switches are mounted on the walls and operating them is Internet of Things (IOT) is revolutionary for that change.
tedious job to do for everyone and is very challenging to Home automation system is smart way of using of information
physically disabled and elderly people. So this proposed technologies and control system to reduce the human labor.
system is targeted to all kinds of people to make their life The rapid growth of technologies to use smartphones to
better. We have designed and implemented a low-cost, remotely control the home appliances are becoming a normal
reliable, efficient and secure automation with speech operated thing now. An automated devices has ability to work with
system in different languages. As of today, the literacy rate are versatility, diligence and with lowest error rate [1-2]. The idea
increasing but there are people who are uneducated or of home automation system is a significant issue for
someone might prefer speaking their own languages. As of researchers and home appliances companies. Automation
today, Google Assistant can support up to eight of the system not only helps to decrease the human labor but it also
languages of India so as to support the indigenous people saves time and energy [3-4].
residing in India. Since it is using Google Assistant so, it Early home automation systems were used in labor saving
removes the complexity for voice train process and voice machines but nowadays its main objective is provide facilities
recognition process. This system has both the feature of to elderly and handicapped people to perform their daily
Bluetooth and Wi-Fi so, both of them can be utilized to control routine tasks and control the home appliances remotely.
the loads of the home. The proposed system also gives the Everyone nowadays has smart phones and an internet
facility of operating the appliances through the internet by connection. In wireless based home automation system
utilizing port forwarding technology. This paper is proposed different type of technologies such as ZigBee [5], Z-Wave [6],
to implement the smart home automation that controls the and Global System for Mobile (GSM) [7], General Packet
devices such as Fan, Lights, AC and door from within home Radio Service (GPRS) [8], Infrared [9], wireless fidelity (Wi-
using Bluetooth or from remote places using Node MCU and Fi) [10-11] and Bluetooth [12] are used, each technology has
operates the devices using web, android application and their own pros and cons. A Bluetooth based wireless home
Google Assistant. The main objective of this system is to be automation system is a very basic one and can be implement
flexible for all kinds of people with specific needs. with a low cost and it is easy to install in an existing home
Keywords--- Home Automation, Smartphone, Arduino, [13]. A research work proved that Bluetooth system are faster
Bluetooth, Home Appliances, Node MCU, Wi-Fi, Google than wireless and GSM systems and also they are least
harmful [14]. Bluetooth technology has ability to transmit data
Assistant.
serially up to 3 Mbps within a physical range of 10m to 100m
depending on the type of Blue tooth device. And Wi-Fi has a
physical range of 50m [15]. And of course with Wi-Fi module
I. INTRODUCTION
you can access it from anywhere around the world.

W E live in the era of technology where things are being


done in a smart way and IOT holds a substantial credit
for this. Recently, the abundance of work and life are in battle
The primitive man realized that a highly effective way to
communicate with on another is through words [16].The
advantages of using voice as interfacing medium are
multifarious.
Angshuman Chakrabartty, Final Year, Department of Computer Science
And, the easiest things of these servicers would entail a larger
and Engineering, Excel Engineering College, Komarapalayam, Tamil Nadu, adoption of existing technology and would assist individuals
India. with varied disabilities, sick and tired person and elderly
Ashish Adhikari, Final Year, Department of Computer Science and people. The speech recognition system comes with Google
Engineering, Excel Engineering College, Komarapalayam, Tamil Nadu,
India.
Assistant which comes bundled with android os system, and
Jurisra Sorokhaibam, Final Year, Department of Computer Science and by implementing this we will be using the machine learning
Engineering, Excel Engineering College, Komarapalayam, Tamil Nadu, and voice recognition software of google itself which is an
India. advanced system. There are language support for google
Dr.J. Nirmala Devi, Professor, Department of Information Technology,
Excel Engineering College, Komarapalayam, Tamil Nadu, India.
assistant so that one can use their native language for
DOI:10.9756/BIJSESC.9027 operation which brings simplicity for all kinds of people.

ISSN 2277-5099 | © 2019 Bonfring


Bonfring International Journal of Software Engineering and Soft Computing, Vol. 9, No. 2, April 2019 59

In this paper, a low cost, reliable, efficient and flexible system Digilent chipKIT. Although this system mentioned as low
of home automation is presented which utilizes the voice cost system but it is much expensive than Bluetooth base
recognition method and also touch button method for home automation system [17].
activating any electrical devices. The application can A low cost and wireless controlled automation system was
In next section Literature Survey is discussed. In next designed by researchers [18]. Bluetooth technology was used
section implementation of overall system description is to provide remote controlled wireless access to user. Although
presented. Section IV describes the hardware architecture and this system achieved high accuracy but it only aimed to
section V describes the software architecture of proposed provide facilities and assistance to disabled and elderly.
work. Result and analysis are highlighted in section VI. In [20], an overview of different home automation systems
Finally section VII, described the conclusion and future work. in presents. Authors highlight the advantages and
disadvantages of different technologies such as Bluetooth,
II. LITERATURE SURVEY ZigBee, GSM and EnOcean. The Bluetooth based automation
Several remote controlled home automation systems have system are low cost and enables the user to control appliances
been studied. Neha A. Wahile, Priyanka D. Hatwar, Isha M. within the range of Bluetooth network.
Padiya research work [21] provided a speaker dependent In [19], a petrol level indicator was designed and
method of home automation using speech recognition system implemented on hardware using two ultrasonic sensors (HC
which uses MATLAB R2009a to turn on/off loads via parallel SR-04), liquid crystal display (LCD), micro SD card and
port of a computer. Atmel ARV controller. The system has ability to measure the
A NodeMCU based home automation system by rathmesh petrol level 0.03-3 meters inside the fuel tank. Moreover
Shelke, Shubham Kulkarni, Swapnil Yelpale, Omkar Pawar, system indicate the users if the petrol level drop below the
Ravdeep Singh & Kirti Deshpande [22], utilized the inbuilt fixed level.
Wi-Fi method to enable and disable the switches through the
web browser so as to reduce cost and have a remote access to III. SYSTEM DESCRIPTION
the appliances from anywhere around the world. The proposed system has two main parts hardware and
R.Piyare and M.Tazil research work [14] provided full software. The hardware part consists of three main hardware
functionality to remotely control home appliances via wireless components smartphone, Arduino board and Bluetooth
communication between the Arduino BT and cell phone using module. Software part consist of Arduino integrated
Bluetooth technology. Arduino BT board was connected with development environment (IDE) and Bluetooth terminal
home appliance and it was controlled by a Symbian OS cell smartphone application which is used for wireless
phone application. Symbian OS cell phone can only support communication between smartphone and Arduino board. Node
the python language scripts and this system failed to support MCU and port forwarding methods are also used in this
Java based application, nowadays mostly smartphone method to provide more ease and facilities to the users. Fig. 1
applications are developed in Java. Similarly, another study illustrates block diagram of proposed home automation system
presented home automation system using Bluetooth and and the flow chart is depicted in Fig. 2.
android application. However, this was designed only for 4
lights and it was not feasible to control more than 4.
Rozita Teymourzadeh, Salah Addin Ahmed [5] designed a
GSM based system for home automation. Using the GSM
protocol, it became possible to access the system by using the
Short Message System (SMS). The system also gave feedback
to the user about the current state of any desired object.
Through detailed study of “Home Automation Using
Internet of Thing” proposed by Shopan Dey, Ayon Roy and
Sandip Das, it is found that they have used Raspberry pi
module to connect ESP8266-01 module to the internet.
Through this module they are controlling various devices
through web page and also through android application [23].
Miss. Aboli Mane , Miss. Pooja Pol, Mr. Amar Patil, Prof. Figure: Bluetooth Module
Mahesh Patil designed a project[24] on homne automastion
using NodeMCU and blynk app. Blynk app is usesd as a third
party app.it provide open source to user to design automation
in less price.
A project by N. Prathima, P. Sai Kumar, SK. Lal Ahmed
and G. Chakradhar home automation for paralyzed people by
voice recognition proposed a system for people suffering from
quadriplegia or paraplegia to control various home appliances
just by his/her voice commands.
A home monitoring and automation system was also
studied, it was implemented by using Arduino Uno and
Figure: Node MCU Module

ISSN 2277-5099 | © 2019 Bonfring


Bonfring International Journal of Software Engineering and Soft Computing, Vol. 9, No. 2, April 2019 60

Implementation
The details of the project are classified as two –
(a) Hardware Implementation
(b) Software Implementation
(a) Hardware Implementation
The Idea is to use both module but at a separate time
duration. The Bluetooth will be activate when the user enters
home and when he go outside the NodeMCU module will be
activated during that time period. The idea is that when the
user stay inside controlling the appliances with Bluetooth will
be suitable inside the house with Bluetooth 4.0 Technology.
The Devices will be connected with the Arduino device when
the Bluetooth sets to ON. With smartphone user can control
the devices inside the home like a charm. When the user go
outside he will on the Node Mcu module with which he can
access the appliances before he came home i.e. for example if
he wants AC to be on 5 minute before he arrive, so he can turn
it on. With this mechanism user can open the garage door
before his arrival to park the car. The user can light on the
household devices.
The NodeMCU will create a webserver that can be accessed
from the browser and with that also the user can access the
devices in case of emergency.
(b) Software Implementation
The Software connects the Arduino, Bluetooth module and
NodeMCU but one at a time. The App is created for both
Click and Voice Recognition technology. With this controlling
the Bluetooth with HC-05 module and NodeMCU with Wi-Fi
module is very easy. The Devices that are connected by the
module are set to be activated by connecting first then they are
commanded to do the particular task. The App was created as
to have both English and Hindi command for users to have
friendly experience.
Figure 2: NodeMCU Implementation

IV. HARDWARE ARCHITECTURE


The proposed home automation system contains three
hardware components smartphone, Arduino board and
Bluetooth module.
Smartphone is used to communicate with Arduino board
using a smartphone application and Bluetooth technology. In
this research work Bluetooth module HC 06 and Arduino Uno
are used for hardware implementation.
A. Arduino Uno
Arduino Uno is open source hardware and microcontroller
board which is based on A Tmega328P Processor. It has 14
digital input/output and 6 analog input pins and operates at 5
volts and 16 MHz quartz crystal frequency. It has 32 KB flash
memory, 2 Kb SRAM and 1 KB EEPROM.
B. Bluetooth module HC-06
Bluetooth module HC-06 is used for wireless
communication between Arduino Uno and smartphone. HC-06
is a slave device and it can operates at power 3.6 to 6 volts. It
has 6 pins: State, RXD, TXD, GND, VCC and EN. For serial
communication connect TXD pin of Bluetooth module HC-06
with RX (pin 0) of Arduino Uno and RXD pin with TX (pin 1)
of Arduino Uno.
Figure 1: Bluetooth Module Implementation

ISSN 2277-5099 | © 2019 Bonfring


Bonfring International Journal of Software Engineering and Soft Computing, Vol. 9, No. 2, April 2019 61

Connection diagram of Adriano and Bluetooth (BT) module Graphical User Interface
is illustrated in Figure.

V. SOFTWARE ARCHITECTURE
In this research work two software Arduino Integrated
Development Environment (IDE) and Bluetooth terminal
application are used.
A. Arduino IDE
IDE stands for Integrated Development Environment, entire
programming for proposed system is done in Arduino IDE
tool.
Baud rate is set to 9600 bits per second for serial
communication between Arduino board and smartphone.
Arduino IDE command "Serial.
A vailable 0" is used to receive data serially from
smartphone and "Serial.println" command is used to transmit
data serially from Arduino board to smartphone.
Similarly state variable is compared with different
conditions to control more appliances.
B. Bluetooth terminal application
A smartphone application named Bluetooth (BT) Simple
terminal is used for wireless communication between
smartphones and Arduino board. It has ability to transmit
ASCII data serially from smartphone to Arduino board using
Bluetooth module.
ASCII data and their equated operation are given in Table
2. According to proposed method users will be able to control Figure 3: Smart Home Page
maximum 18 appliances and sensors using Bluetooth terminal
application.
ASCII Operation Data
0 Turn ON light 1
1 Turn OFF light 1
2 Turn ON light 2
3 Turn OFF light 2
4 Turn ON FAN
5 Turn OFF FAN
6 Turn ON air Conditioner
7 Turn OFF air Conditioner
8 Turn ON television
9 Turn OFF television

VI. RESULTS
Proposed home automation system implemented on
hardware using Arduino Uno, NodeMCU, and Bluetooth
module HC-06 and smartphone.
Bluetooth module TXD and RXD pins were connected with
user specified Arduino Uno RX and TX pins respectively,
while NodeMCU and Arduino is connected similarly with the
rest of the appliances with its GPIO pins and output pins
respectively.
VCC pins were connected with 5V DC supply and the
outputs have a common ground pins. The home appliances
lamp, electric motor and fan, AC were connected with
Arduino Uno digital output ports and with the help of relay.
Relays can be used for 5V to 240V switching circuitry. Figure 4: Device Selection

ISSN 2277-5099 | © 2019 Bonfring


Bonfring International Journal of Software Engineering and Soft Computing, Vol. 9, No. 2, April 2019 62

Fi, for future research work it is recommended to increase the


range and interface more sensors and it should be a low cost
and user friendly system. Moreover home automation system
can be interfaced with biomedical (EMG) signals. It will be
beneficial for amputees, they will be able to control the
appliances using their muscle's movement and it can also be
useful to the people suffering from dementia to remind them
of doing. With the coupling of both Bluetooth and Wi-Fi
technology, there is a wide range of opportunities and ideas
that could be centered on security of home and the same
concept can be utilized in many sectors like offices, hospitals,
hotels, factories with changes as per the surrounding and the
usage of multiple different sensors. And also the smart watch
technology can be utilized with the home automation which
further increases the flexibility and ergonomic value of the
system.

REFERENCES
[1] M.S. Soliman, M.O. Dwairi1, I.I.M. Abu Sulayman & S.H.A. Almalki,
“Towards the Design and Implementation a Smart Home Automation
System Based on Internet of Things Approach”, International Journal of
Applied Engineering Research, Vol. 12, No. 11, Pp. 2731-2737, 2017.
[2] K. Mandula, R. Parupalli, C.A.S. Murty, E. Magesh and R. Lunagariya,
“Mobile based home automation using Internet of Things(loT)”,
International Conference on Control, Instrumentation, Communication
and Computational Technologies (ICcrCCT), Kumaracoil, Pp. 340-343,
2015.
Figure 5: Voice Command Panel [3] N. Skeledzija, J.C. Edin, V. Bachler, H.N. Vucemilo and H. Dzapo,
The suggested home automation system was tested within “Smart home automation system for energy efficient housing”, 37th
International Convention on Information and Communication
the range of 20 meters and it attained 100% accuracy. All the Technology, Electronics and Microelectronics (MIPRO), Pp. 166-171,
connected LEDs and appliances were controlled from the 2014.
smartphone application. [4] R.A. Ramlee, M.A. Othman, M.H. Leong, M.M. Ismail and S.S.S.
Smart Home application was installed in smartphone and a Ranjit, “Smart home system using android application”, International
Conference of information and Communication Technology (fCoiCT),
Bluetooth wireless connection was established between Bandung, Pp. 277-280, 2013.
smartphone and Arduino Uno. Password protection was used [5] R. Gogawale, “Bluetooth remote home automation system using android
for pairing of smartphone with Bluetooth Module HC-05 to application”, International Engineering Research Journal (fERJ), Vol. 2,
only allow authorized user. Figure1: illustrates the interface No. 2, Pp. 848- 850, 2016.
[6] M. Asadullah and A. Raza, “An overview of home automation systems”,
of Bluetooth in Smart Home application and NodeMCU was 2nd international Conference on Robotics and Artificial intelligence
connected to router & appliances were controlled via (fCRAi), Rawalpindi, Pp. 27-31, 2016.
application and a PC through ip address. Figure2: illustrates [7] "Bluetooth Simple Terminal Application retrieved on June 19, 2016
the interface of NodeMCU application. retrieved from < hltps: l/play.google.com/ store/apps/
details?id=wingood. bluetooth.bts impleterminal & hl=en. [Accessed:
06-Feb-2017].
VII. CONCLUSION [8] N.M. Morshed, G.M. Muid-Ur-Rahman, M.R. Karim and H.U. Zaman,
“Microcontroller based home automation system using Bluetooth, GSM,
In this research work a low cost and user friendly design for
Wi-Fi and DTMF”, International Conference on Advances in Electrical
home automation system is presented. It has better Engineering (iCAEE), Dhaka, Pp. 101-104, 2015.
performance than existing Bluetooth based conventional home [9] R.K. Kodali, V. Jain, S. Bose and L. Boppana, “loT based smart
automation systems, it provides a general approach for home security and home automation system”, International Conference on
Computing, Communication and Automation (ICCCA), Noida, Pp.
automation which is not only suitable for elderly and
1286-1289, 2016.
handicapped people but it is also beneficial to reduce human [10] M. Asadullah and A. Recai Celik, “An Effective Approach to Build
labor and save energy with the help of sensors. For the Smart Building Based on Internet of Things (loT)”, Journal of Basic and
knowledge of readers, this is the first paper on home Applied Scientific Research (JBASR), Vol. 6, No. 5, Pp. 56-62, 2016.
[11] V. Puri and A. Nayyar, “Real time smart home automation based on
automation system in which both Bluetooth and Wi-Fi module
PIC microcontroller, Bluetooth and Android technology”, 3rd
are used for Smart Home automation. In addition proposed international Conference on Computing for Sustainable Global
system has ability of speech recognition in many languages. Development (INDIA Com), New Delhi, Pp. 1478-1484, 2016.
Moreover smartphone application used in proposed system has [12] S. Palaniappan, N. Hariharan, N.T. Kesh and A. Deborah, “Home
automation systems - A study”, International Journal of Computer
ability to interface up to 18 home appliances and sensors.
Applications, Vol. 116, No. 2, Pp. 11- 18, 2015.
Proposed system is analyzed and tested within the range of 10 [13] R. Piyare and M. Tazil, “Bluetooth based home automation system using
meters and it achieved 100% accuracy using Bluetooth and cell phone”, IEEE 15th International Symposium on Consumer
Wide range using Wi-Fi. Electronics (ISCE), Singapore, Pp. 192-195, 2011.
[14] N. Prathima, P. Sai Kumar, S.K. Lal Ahmed and G. Chakradhar, “Voice
Proposed system is only able to control the appliances
Recognition Based Home Automation System for Paralyzed People”,
within short range using Bluetooth and long range using Wi-

ISSN 2277-5099 | © 2019 Bonfring


Bonfring International Journal of Software Engineering and Soft Computing, Vol. 9, No. 2, April 2019 63

International Journal for Modern Trends in Science and Technology,


Vol. 3, No. 2, Pp. 101-106, 2017.
[15] M.A.E.L. Mowad, A. Fathy and A. Hafez, “Smart home automated
control system using android application and microcontroller”,
International Journal of Scientific & Engineering Research, Vol. 5, No.
5, Pp. 935-939, 2014.
[16] S. Raghavan and G.S. Tewolde, “Cloud based low-cost Home
Monitoring and Automation System”, Proceedings of the 20i5 ASEE
North Central Section Conference, Pp. 1-10, 2015.
[17] R.A. Ramlee, M.A. Othman, M.H. Leong, M.M. Ismail and S.S.S.
Ranjit, “Smart home system using android application”, 2013
international Conference of information and Communication
Technology (fCoiCT), Bandung, Pp. 277-280, 2013.
[18] R. Gogawale, “Bluetooth remote home automation system using android
application”, International Engineering Research Journal (fERJ), Vol. 2,
No. 2, Pp. 848- 850, 2016.
[19] M. Asadullah and A. Raza, “An overview of home automation
systems”, 2016 2nd international Conference on Robotics and Artificial
intelligence (fCRAi), Rawalpindi, Pp. 27-31, 2016.
[20] P.D. Hatwar, N.A. Wahile and I.M. Padiya, “Home Automation System
Based on Gesture Recognition System”, International Journal of
Emerging Technologies in Engineering Research (IJETER) Vol. 5, No.
3, 2017.
[21] P. Shelke, S. Kulkarni, S. Yelpale, O. Pawar, R. Singh, K. Deshpande,
“Design and Implementation of PID Controller using HDL on FPGA”,
International Research Journal of Engineering and Technology (IRJET)
Vol. 5, No. 6, 2018.
[22] S. Dey, A. Roy and S. Das, “Home Automation Using Internet of
Thing”, IRJET, Vol. 2, No. 3, Pp. 1965-1970, 2016.
[23] A. Mane, P. Pol, A. Patil, M. Patil, “IOT based advanced home
automation using Node MCU controller and blynk Framework”, Zerone
Scholar.

ISSN 2277-5099 | © 2019 Bonfring