Remote Surveillance and Smart Stock Monitoring Robot. using Internet of Things

Transcription

1 Remote Surveillance and Smart Stock Monitoring Robot using Internet of Things Sindhu B M, Sindhu B Manjunath, Praveen Kumar H M, Mr. Rajasekar Mohan, Dept. of Electronics and Communication Engineering, PES Institute of Technology, Bangalore Abstract This paper describes Raspberry Pi based robotic platform with passive RFID reader and low power camera to carry out surveillance cum smart stock monitoring in large supermarkets. The robotic platform is equipped with the human interface for control using Android app and SMS using GSM. Android app employs Google Voice commands to steer the robot to the desired destination based on the pre-fed layout of the target location. Typically, the robot goes around the supermarket alongside the aisles of stocks equipped with RFID tags. As the robot traverses through the aisles, the RFID reader reads the RFID tags attached to the inventory. The assigned inventory information of the tags read is populated in the SD card of the robotic platform. This information can be directly utilized to update the inventory database on real-time basis. The course of the robot is changed through a password-protected mobile app through internet Google voice commands subject to availability of internet connection or simply SMS. Raspberry Pi camera is programmed to capture images at desired intervals or on encountering obstacles or certain events. High-quality images captured are sent to target users by attachment through internet. Thus the robot with its interfaces is capable of carrying out smart surveillance cum smart stock monitoring in supermarkets efficiently and elegantly. physical realm, by means of the widespread deployment of spatially distributed devices with embedded identification, sensing and/or actuation capabilities. Internet-of-Things envisions a future in which digital and physical entities can be linked, by means of appropriate information and communication technologies, to enable a whole new class of applications and services. This vision requires major technology improvements. After all, how would we connect everything on the planet? What type of wireless communications could be built into devices? What changes would need to be made to the existing Internet infrastructure to support billions of new devices communicating? What would power these devices? What must be developed to make the solutions cost effective? There were more questions than answers to the IoT concepts in Today, many of these obstacles have been solved. The size and cost of wireless radios has dropped tremendously. IPv6 allows us to assign a communications address to billions of devices. Electronics companies are building Wi-Fi and cellular wireless connectivity into a wide range of devices. ABI Research estimates over five billion wireless chips will ship in Mobile data coverage has improved significantly with many networks offering broadband speeds. There will be billions of objects connecting to the network with the next several years. For example, Cisco s Internet of Things Group (IOTG) predicts there will be over 50 billion connected devices by Keywords: Raspberry Pi, Raspberry Pi camera, surveillance, Android phone, SIM 900A GSM module, RFID module. I. INTRODUCTION The term Internet-of-Things is used as an umbrella keyword for covering various aspects related to the extension of the Internet and the Web into the II. LITERATURE REVIEW [1] Ad Hoc Networks - Internet of things: Vision, applications and research challenges: From this paper, the concept of IoT and how almost all devices can be connected globally via internet was learnt. We were also able to realize the applications of IoT and this helped us in getting ideas for our project. 1

2 [2] Secured Spy IP Control Robot Using Raspberry Pi: From this paper, we learnt about how to interface the motor driver circuit and we able to achieve robot movements. We also learnt about usage of relay (mode switching, isolation of motors from remaining circuit) and the need for voltage regulation. [3] Establishing SSH Connection and Interfacing GSM/GPRS Functionality with Raspberry Pi: From this paper, we learnt how to interface GSM to Raspberry Pi. We also learnt how to make SSH connection between client and server and to check it periodically. VI. ARCHITECTURE [4] Smart Surveillance Monitoring System Using Raspberry PI and PIR Sensor: From this paper, we learnt about Raspberry Pi Hardware architecture and steps to install Raspbian OS. [5] Remote Surveillance Robot System- A Robust Framework using Cloud: From this paper, we got the idea of Remote Surveillance Robot System which is the main idea of our project. III. COMPARISON OF PROPOSED PRODUCT WITH THE EXISTING ONES IN THE MARKET Existing products of the same kind are power-hungry, cloud dependent and have limited endurance. Also, there is no product in the market which uses RFID reader, GSM module, and Raspberry Pi Camera together. IV. NOVELTY OF THE PRODUCT None of the existing products have GSM/SMS/RFID/Raspberry Pi camera all in the same product. V. TARGET DISCIPLINES To create a smart robot which can be controlled from an Android phone application. The media captured can be saved for further use using micro SD card and will be sent to user via . RFID enabled - Smart Robot can be used for stock-taking in supermarkets, more efficient than manual stock-taking. The Android Phone Controlled Smart Robot is an application of the concept of Internet of Things. The Robot can be controlled from any place with internet access. The electronics of the Robot revolves around the Raspberry Pi board. The Robot is programmed for its basic motion and scripted in Python. The Python script is then linked to the DC motors of the Robot which can be controlled through an Android Phone as the Raspberry Pi is serially connected to the GSM module. The Google Voice commands are also linked to this. Also the Raspberry Pi camera application enables to take pictures through the Raspberry Pi camera connected to the board. The media captured can be sent to the user through , applying the IoT concept. IoT data differs from traditional computing. The data can be small in size and frequent in transmission. The number of devices, or nodes, that are connecting to the network are also greater in IoT than in traditional PC computing. Machine-to-Machine communications and intelligence drawn from the devices and the network will allow businesses to automate certain basic tasks without depending on central or cloud based applications and services. Using the concept of IoT, we have built a project involving both hardware components like Raspberry Pi to build the robot and integration of software mobile applications to control its motion and take pictures using an app for camera module of the Raspberry Pi. VII. HARDWARE and SOFTWARE TOOLS USED A. Hardware used Raspberry Pi 2B model 900Mhz quad-core ARM Cortex-A7 CPU 1GB RAM 2

3 Raspberry Pi camera 5 megapixel camera supports 1080p 30fps, 720p 60fps, 640x480p 60/90fps SIM 900A GSM module Dual-Band 900/ 1800 MHz Control via AT commands Low power consumption: 1.5mA (sleep mode) L293 Motor Driver circuit 16-pin IC used to control a set of two DC motors simultaneously in any direction Low power passive RFID EM4001 ISO based RFID IC 125Khz Carrier, 32-bit unique ID RFID tags IR sensors LM358 is a dual op-amp IC 5V Power Bank 12V/1.3Ah lead acid battery Relay 12V SPDT relay Buzzer Wi-Fi adapter 12V 100 RPM DC motors Robot Wheels and Chassis Toggle switch Female jumper wires A. Software used SD Formatter Used to format SD card Win32 Disk Imager Used To install Raspbian OS Raspbian OS (Wheezy Version) HyperTerminal Used to communicate with GSM Module Eclipse IDE for Android App VIII. SOCIETAL BENEFITS IX. The operating cost of business is reduced and hence the per unit cost of items is not inflated. STEP BY STEP IMPLEMENTATION 1. Configuring of SD card used in Raspberry Pi (Installation of Raspbian OS) To configure the SD card we need SD Formatter, Win32 Disk Imager and Raspbian OS (Wheezy version). Initially download the Raspbian OS from the raspberrypi.org website and unzip the files. Extracted.iso file is written on the SD card using Win32 Disk Imager and if incase the SD card data is to be erased completely, then we can use SD Formatter. 2. Configuring of Raspberry Pi To start off, first power up the Raspberry Pi using 5V adapter (normal smart phone charger). By default Username is pi and Password is raspberry, this can be removed later on for easy boot up and further work. Once login is successful, UI (User Interface) appears, in that using LX terminal and appropriate commands settings like enabling camera, disabling login system and many more changes can be done. Every time any changes is made it is necessary to reboot the Raspberry Pi as the changes made can effectively come into action. After all necessary changes are made, we can select the language in which we would like to code the whole program. 3. Interfacing of Raspberry Pi camera to robot As Raspberry Pi camera has good image quality of resolution 5mp, it is being used in our project to capture image when the robot detects an obstacle. This camera consumes 250mA of current whereas a normal webcam would consume around 550mA of current, so it will be optimum to use Raspberry Pi camera. Coming to the installation part of Raspberry Pi camera, it is very simple and just needs a single line command to be run in the LX terminal. 4. Interfacing of GSM Module to the robot There are different varieties of GSM modules available in the market, but in our project we are using SIM 900A GSM module to communicate with the robot. In the initial stages for interacting with GSM module and also for checking purpose, normal SIM card is being inserted into the SIM card slot of the GSM module, powered up using a 12V/2A adapter and connected to the pc through serial cable. HyperTerminal is the software that is being used by us to communicate with the GSM module, later on GSM module can be interfaced with the robot directly and can be coded in such a way that it eliminates the use of HyperTerminal software. At this stage interaction with the robot through GSM module is via SMS. Main intention of using GSM module is to control the motions of the 3

4 robot by sending just a SMS even by being in a faraway place from the robot. 5. Usage of IR sensors in the robot IR sensors are being used to detect the obstacles that would come in the path of robot. For obstacle detection purpose two IR sensors are being used in our project, one in the front part of the robot and other at the back part of the robot. As soon as the IR sensors detect any kind of obstacle during the motion of the robot, it sends a signal to the Raspberry Pi which makes the robot stop. 6. Captured images stored in SD card For demo purpose it is being coded in such a way that, whenever the IR sensor in the front part of the robot detects an obstacle an image will be captured by the Raspberry Pi camera. This captured image will be stored in the SD card (8/16 GB) being inserted in the Raspberry Pi module. 7. Enabling of Wi-Fi USB Wi-Fi adapter is connected to the USB port of the Raspberry Pi and is configured. We are using Wi-Fi as of now for the demo purpose, for future deployment of the robot in remote areas where Wi-Fi isn t available then dongle can be used in that case. stocks in supermarket. This eliminates the individual person s attention in taking stock of each and every item in the supermarket. The RFID tag details which is obtained by scanning them are temporarily stored in SD card and later will be sent to user via along with image captured during any obstacle detection. 11. Stage indication and switching A buzzer is used to notify the user while the robot is being booted up and 3 beeps before sending an e- mail. Similarly Relay is used to detect the mode changes of the robot like while changing from surveillance mode to RFID mode. X. CONCLUSION and FUTURE SCOPE The Smart Robot with its interfaces was built and was deployed in a supermarket. The course of the robot was controlled accurately though with few seconds of perceivable delay. Inventory tags could be read at close distances which can be enhanced seamlessly by incorporating a medium power RFID reader. Quality of images captured and received through was as per the program. 8. After connecting successfully to the Wi-Fi network, the captured images that is being stored in SD card is sent through to user. Since images captured is being sent to particular user via the data can be maintained confidentially. 9. Power bank and Independent movement of the robot A 12V/1.3Ah lead acid battery is used to power up the GSM module, motor driver circuit via power supply board (12V-5V converter). 5V power supply from the power bank is supplied to the Raspberry Pi, which in turn supplies power to the Raspberry Pi camera, Wi-Fi adapter etc. By using both battery and power bank the robot can stay up to 1 hour 30 minutes to 2 hours of continuous motion and also robot can move independently anywhere without wall socket wire connection restrictions. 10. Interfacing RFID This is the 2nd application of our robot. A low power passive RFID module is being interfaced to the robot to take Fig 1. Robot detecting obstacle and capturing image Fig 2. Robot reading RFID tags in Supermarket 4

5 XI. REFRENCES [1] Daniele Miorandi, Sabrina Sicari, Francesco De Pellegrini and Imrich Chlamtac, "Internet of things: Vision, applications and research challenges", Ad Hoc Networks, vol. 10, no. 7, pp , Fig 3. Screenshot of image sent via The future scope of improvisation for our project can be in various applications such as: Object Follower Robot: The robot can be programmed using opencv to follow a particular object. Path planning of mobile robot has a purpose to design an optimal path from an initial position to a target point. Minimum driving time, minimum driving distance and minimum driving error might be considered in choosing the optimal path and they are correlated to each other. Efficient driving trajectory is planned in a real situation where a mobile robot follows a moving object. Position and distance of the moving object are obtained using a web camera. Improving the mechanical design: of the robot by adding shock absorbers etc. This would enable it to endure rough and uneven terrains, inclined surfaces etc. Sensors: Embedding sensors in the Robot so that the data collected by various sensors can be used to transmit from distant places to the people concerned. [2] V Meenakshi, Ch. Lakshmi Saketh and K. Kalyan Kumar, "Secured Spy IP Control Robot Using Raspberry Pi", International Journal of Emerging Technology and Advanced Engineering, vol. 5, no. 2, pp , [3] Mrs.P.Suvitha Vani and Miss.Nithyappriya.G, "Establishing SSH Connection and Interfacing GSM/GPRS Functionality with Raspberry PI", International Journal of Innovative Research in Computer and Communication Engineering, vol. 2, no. 1, pp , [4] Sanjana Prasad, P. Mahalakshmi, A. John Clement Sunder and R. Swathi, "Smart Surveillance Monitoring System Using Raspberry PI and PIR Sensor", International Journal of Computer Science and Information Technologies, vol. 5, no. 6, pp , [5] Aditya Sundaram, Monel Gupta and Vinod Rathod, "Remote Surveillance Robot System- A Robust Framework using Cloud", IEEE International Symposium on Nanoelectronic and Information Systems, pp , Stock taking in supermarkets: The Smart Robot can be used for taking stock of items when the robot moves in the aisles as it has a RFID module. Since we have used a low power RFID, which works until a distance if 5cm, to broaden the scope of this project, one could use high power RFIDs that can effectively detect and store the item details. Data Utility: Inventory data of the RFID tags can directly update the inventory database and can produce useful reports. Autonomous movement: Obstacle avoidance algorithms can be incorporated to make the robot fully autonomous. 5