The ease of usability of any appliance is paramount. The traditional way of controlling any appliance requires use of switch or remote. This paper provides an aid in usability of appliances by bringing a technological change in how we control them. In this paper, we propose an integrated system that can control equipments using various gestures.
In the proposed system, we are developing a smart watch that has various sensors that detects gesture and triggers the functioning of equipment according to user's requirement. Simple movement of hands: horizontal, vertical or circular, can be used to control devices over a wireless network. The watch can be programmed as per user requirements, e.g. Controlling Car, Controlling Robotic arm etc. The scope of this project extends over various fields having limitless applications. The main advantage of the proposed system is that the applications of this watch are vast and also provides a modernized approach.
CONTENT
INTRODUCTION
PROPOSED SYSTEM
A. SYSTEM ARCHITECTURE
B. FRONT END:
C. BACK END:
D. ALGORITHM
IMPLEMENTATION
FUTURE WORK AND CONCLUSION
REFERENCES
IoT-based Smart Band to Achieve Home Automation with Gesture Detection and Control
Maitrey Talware, Saurabh Bhagwat, Harshal Patil, Ritesh Dhisale, Prof. Ajitkumar Shitole
BE Computer
Abstract — The ease of usability of any appliance is paramount. The traditional way of controlling any appliance requires use of switch or remote. This paper provides an aid in usability of appliance by bringing a technological change in how we control them. In this paper, we propose an integrated system that can control equipments using various gestures. In the proposed system, we are developing a smart watch that has various sensors that detects gesture and triggers the functioning of equipment according to user's requirement. Simple movement of hands: horizontal, vertical or circular, can be used to control devices over a wireless network. The watch can be programmed as per user requirements, for e.g. Controlling Car, Controlling Robotic arm etc. The scope of this project extends over various fields having limitless applications. The main advantage of the proposed system is that the applications of this watch are vast and also provides a modernized approach.
Keywords— IoT, Smart Watch, Control Center, Smart Gesture Control, GUI
INTRODUCTION
Internet of Things has many definitions in literature. IoT is described as the vast network of devices connected to the Internet, including smart phones and tablets and almost anything with a sensor on it – cars, machines in production plants, jet engines, oil drills, wearable devices, and more. It has immense possibilities with various applications. One of its significant application is Home Automation. Imagine controlling all your home appliances from anywhere inside or outside your home.
In this paper, we contribute to this field of study by proposing a smart home automation system development. The proposed framework mainly focuses on three functionalities Reliability, Portability and Ease of Use. Firstly, it gives access to both user and system administrator to define set of rules called scenarios [1] based on which system can automatically operate. In earlier systems as in [1] [2] [4], a user could not operate devices from outside home; in our system it gives the user an ease to control devices from outside the house. Secondly, it is a portable system, user does not need to go near the device to control it as in [1]. Thirdly, it has the ability to support various kinds of end devices (e.g. Sensors and
Actuators) in the market with less efforts in terms of development time and manpower. The last one is that the whole system is configurable.
PROPOSED SYSTEM
A. SYSTEM ARCHITECTURE
The system is implemented using Raspberry Pi 3 with Raspbian OS [11][13], ESP8266 [10], MPU-6050 (accelerometer, gyroscope)[8] and various other sensors and batteries. The Raspberry Pi 3 is used as a smart watch that selects appliance. MPU- 6050, an accelerometer and gyroscope sensor, which is interfaced with Raspberry pi 3, is used to sense the gesture. The ESP8266 is used as control center [2], which communicates with appliance to perform action as per gesture. To reduce power consumption, the whole system is in sleep state initially and remains in sleep state unless invoked (started). The figure below gives an architectural overview of the proposed system.
illustration not visible in this excerpt
Fig 1. Simple Architecture of Module
B. FRONT END:
GUI: The front end consists of a GUI for smart watch, having various applications such as calculator, notes, etc. The TkInter module is the standard Python interface which is used for developing the main application’s GUI [12]. The GUI displays list of appliances that are integrated with the system. Icons of respective appliances can be used to make interface more interactive and easy to use.
illustration not visible in this excerpt
Fig 2. Graphical User Interface
C. BACK END:
1. INTERFACING:
illustration not visible in this excerpt
Fig 3. Interfacing Raspberry Pi and MPU6050 [9]
2. GESTURE DECTECTION: MPU-6050 an Accelerometer and Gyroscope sensor on board will detect the hand gestures, which will be in accordance with the universal hand-gesture vocabulary and will generate values as per gesture [5]. After selecting the appliance from GUI, MPU-6050 starts sensing the movement, based on which operations are performed.
3. COMMUNICATION AND WORKING: MQTT (Message Queue Telemetric Transport Protocol)[14][10] is used to transfer generated data from Raspberry Pi to the control center [2] through Wi-Fi [7]. The control center is connected to all the appliances i.e. fans, lights and doors [3]. The Wi-Fi module of control center receives the data transmitted by the smart watch and feeds it to the appliances to perform required tasks [1]. The purpose of this architecture is to minimize the physical efforts and to reduce power consumption.
D. ALGORITHM
Step 1: Start
Step 2: Check whether smart watch is connected to Wi-Fi or not
Step 3: If not then try connecting again
Step 4: If yes, Go to next state
Step 5: Enter the sleep state where appliances are not active, until they are selected
Step 6: Select appliance from the list of appliances displayed on the smart watch
Step 7: Perform the appropriate gesture
Step 8: If gesture not performed, go to step 5
Step 9: If gesture performed, perform the required action
Step 10: Go to step 5, until invoked again
illustration not visible in this excerpt
Fig 4. Simple Flowchart of Module
IMPLEMENTATION
Whenever we turn on the smart watch, it automatically searches for control center and connects to it Wi-Fi. After connection is established, smart watch enters sleep state or energy saving state [6]. When user desires an action to be performed, he has to tap on the screen of smart watch so as to wake it from sleep state. The GUI will display list of appliances that are integrated into the system. The user has to select appliance which he intents to operate. Once the appliance is selected, the backend of the system will automatically invoke the appliance [1] and thus, the appliance is ready to receive commands. Using the universal hand-gesture vocabulary, hand gesture user can command appliance as per requirement [5]. As mentioned in [5], it is important to follow a universal hand-gesture vocabulary, which specifies the tasks that will be executed by the devices on performing a particular gesture. This will not only avoid the confusion among the users as to what gestures should be performed to carry out a particular task, but will also make them understand its functionality with ease. Based on command, the actions will be taken by the appliance [1]. Once the action is performed, the watch will again go into sleep state. If the user further wants to operate some other appliance, he will have to perform the same tasks again as mentioned above. If the gesture is not performed, the watch will wait for some amount of time for the user to try again. If that does not happen, then it will automatically go into sleep state. By doing so, the robustness and the power efficiency are further increased. Also with the availability of Wi-Fi in almost every household today, the overall cost of the system is reduced.
FUTURE WORK AND CONCLUSION
In this paper, our proposed system not only helps in reducing the physical efforts and power consumption but it also bring about a technological change in how we manage and control our equipment. The proposed smart watch provides an innovative and creativity approach to reduce and simplify day to day activities.
In the future, we will increase the robustness and durability of our system by using advanced communication protocols. Using renewable energy such as solar energy we can extend the lifespan of battery. The smart watch can also be linked to Internet and hence we can control objects over large distances.
REFERENCES
[1] Susumu Takeuchi∗, Michiharu Takemoto, and Masato Matsuo ,” SPIRE: Scalable and Unified Platform for Real World IoT Services with Feature Interaction ”, 2016 IEEE 40th Annual Computer Software and Applications Conference
[2] Dang-Nhat Pham-Huu, Van-Hien Nguyen, Van-Anh Trinh, Van-Hieu Bui, and Hoang-Anh Pham ,” Towards an Open Framework for Home Automation Development “, 2015
[3] International Conference on Advanced Computing and Applications
[4] Dung Vu Ba Tien, Miika Komu, Matti Siekkinen, Antti Yla ̈-Ja ̈a ̈ski ,” H-box: Interconnecting Devices Across Local Networks ”, 39th Annual IEEE Conference on Local Computer Networks
[5] Amir Atabekov , Jing (Selena) He , Patrick Otoo Bobbie,” Internet of Things-Based Framework to Facilitate Indoor Localization Education”, 2016 IEEE 40th Annual Computer Software and Applications Conference
[6] An Elicitation Study on Gesture Preferences and Memo- rability Toward a Practical Hand-Gesture Vocabulary for Smart Televisions. HAIWEI DONG1, (Member, IEEE), Ali Danesh1, Nadia Figueroa2, and Abdulmo- Taleb el Saddik1, (Fellow, IEEE) . Elicitation Study on Gesture Preferences and Memorability
[7] Fabian Kaup, Philip Gottschling, David Hausheer, Peer-to-Peer Systems Engineering Group, Technische Universität Darmstadt, “PowerPi: Measuring and Modeling the Power Consumption of the Raspberry Pi “, 39th Annual IEEE Conference on Local Computer Networks
[8] Manan Mehta, “Esp 8266: A Breakthrough in Wireless Sensor Networks and Internet of Things”, International Journal of Electronics and Communication Engineering & Technology (IJECET) Volume 6, Issue 8, Aug 2015, pp. 07-11
[9] Arduino, “MPU-6050 Accelometer + Gyro”, 2017. [Online]. Available: http://playground.arduino.cc/Main/MPU-6050#short. [Accessed: 9- Nov- 2016].
[10] blog.bitify.co.uk“Interfacing Raspberry Pi and MPU-6050” . [Online]. Available: http://blog.bitify.co.uk/2013/11/interfacing-raspberry-pi-and-mpu-6050.html. [Accessed: 26- Dec- 2016]
[11] sparkfun.com, “WiFi-Module ESP8266”, 2017. [Online]. Available: https://www.sparkfun.com/products/13678. [Accessed: 28- Dec 2016].
[12] raspberrypi.org “Raspberry Pi 3 Model B” 2017. [Online]. Available: https://www.raspberrypi.org/products/raspberry-pi-3-model-b/. [Accessed: 07- Dec- 2016].
[13] Tkinter “Graphical User Interfaces with Tk” 2017. [Online]. Available: https://docs.python.org/3/library/tk.html. [Accessed: 20 Feb 2017].
[14] raspberrypi.org “Raspbian” 2017. [Online]. Available: https://www.raspberrypi.org/downloads/raspbian/ [Accessed: 7- Feb- 2017].
Frequently asked questions
What is the purpose of the IoT-based Smart Band project?
The project aims to develop a smart watch capable of controlling home appliances using hand gestures, offering a more intuitive and convenient user experience compared to traditional switches or remotes. It focuses on ease of use, portability, and reliability.
What are the key components of the proposed system?
The system consists of a Raspberry Pi 3 (acting as the smart watch), an ESP8266 (serving as the control center), an MPU-6050 (accelerometer and gyroscope for gesture detection), and various sensors. The front end features a GUI developed using TkInter, while the back end handles interfacing, gesture detection, and communication.
How does the gesture control system work?
The MPU-6050 sensor detects hand gestures. Upon selecting an appliance from the smart watch GUI, the sensor starts sensing movement. The recognized gesture is then transmitted to the control center via Wi-Fi using the MQTT protocol, which subsequently relays the command to the corresponding appliance.
What algorithm does the system use?
The algorithm involves initializing the smart watch, connecting to Wi-Fi, entering a sleep state, selecting an appliance, performing a gesture, executing the corresponding action, and returning to the sleep state until another action is required. The system also includes checks for Wi-Fi connectivity and gesture recognition.
How is the system implemented?
The system requires the smart watch to connect to the control center's Wi-Fi. The smart watch remains in a sleep state until a user interacts with the GUI. The user selects an appliance, performs the gesture, and then the backend executes the function. Afterwards, the watch will return to the sleep state.
What are the potential future enhancements for the project?
Future work includes increasing the system's robustness by using advanced communication protocols and extending battery life through renewable energy sources like solar power. Also, enabling Internet connectivity to allow for remote control of appliances over long distances.
What is the role of Raspberry Pi 3 in the system?
The Raspberry Pi 3 acts as the smart watch. It hosts the GUI, processes user input, communicates with the MPU-6050 for gesture detection, and transmits commands to the control center.
What is the role of ESP8266 in the system?
The ESP8266 acts as the control center. It receives gesture commands from the Raspberry Pi via Wi-Fi and relays these commands to the appropriate appliance for execution.
What are the key benefits of this IoT-based smart band for home automation?
The key benefits include reduced physical effort, simplified control of appliances, increased power efficiency through sleep states, a modernized approach to home automation, and the potential for controlling devices remotely.
What is MQTT and how is it used in the system?
MQTT (Message Queue Telemetry Transport) is a lightweight messaging protocol used for transferring data from the Raspberry Pi (smart watch) to the ESP8266 (control center) over Wi-Fi.
What are some example gestures that can be used to control appliances?
Simple hand movements, such as horizontal, vertical, or circular gestures, can be programmed to control devices. The specific gestures and their corresponding actions are defined based on user requirements and a universal hand-gesture vocabulary.
- Quote paper
- Harshal Patil (Author), Maitrey Talware (Author), Saurabh Bhagwat (Author), Ritesh Dhisale (Author), Prof. Ajitkumar Shitole (Author), 2017, Iot-Based Smart Band to Achieve Home Automation with Gesture Detection and Control, Munich, GRIN Verlag, https://www.grin.com/document/357349