Study of Bluetooth Eyes Technology and Gesture Recognition Devices

Size: px

Start display at page:

Download "Study of Bluetooth Eyes Technology and Gesture Recognition Devices"

Thomasine Julia Manning
5 years ago
Views:

1 Study of Bluetooth Eyes Technology and Gesture Recognition Devices Mayank Kumar Gaur, Manjeet Kaur, *Upendra Kumar, Sakshi Sethi Amity University Gurgaon Haryana Priyanshu Gaur Meerut Institute of Engineering and Technology ABSTRACT This paper gives an insight into the main idea behind blue eyes technology (giving the computer the power of a human being). As human beings can understand one another s feelings, can guess the state of another person by observing his/her facial expressions [1]. Similarly, this technology aims at giving the computer the perceptual abilities like those of humans, that is giving the computers the ability to interact with we humans, that is the computers will be able to understand our state of mind through our facial expressions, saccadic activity. The technology uses many different types of emotional sensors like emotional eyes, expression glasses and many more. KEYWORD: blue eye, saccadic, emotional sensor, static motion. 1. INTRODUCTION The system incorporating this technology measures the user s visual attention by measuring his/her saccadic activity and heart beat rate, blood oxygenation levels against normal which are already stored in the systems and triggers the alarm if the above results are abnormal. For the hardware part, the system consists of mobile measuring device integrated with the Bluetooth module which further provides the wireless interface between the sensors worn by the user and the central acquisition unit which is also a part of the hardware[1][2]. The main aim behind the software used in this technology is constantly look after the working operator s physiological condition and to insure that any instant change in the condition of the operator brings a change the operation of the software which further performs real time buffering and physiological analysis of the incoming data and finally triggers an alarm. 2. HARDWARE 2.1 Data Acquisition Unit: The data acquisition unit involved is the main mobile unit of the system whose main task is to manage the Bluetooth connections. The jazz multi sensor is used to supply raw digital data regarding the position of the eyes and blood oxygenation levels The modules of DAU are listed in table 1 below: 178

TABLE 1 S.NO MODULE PART NUMBER 1. Atmel microcontroller system core 89C52 2. Bluetooth module ROK10108 3. LCD display HD44780 4. EEPROM 24C16-I2C 5. 13 bit PCM codec 6.

2 TABLE 1 S.NO MODULE PART NUMBER 1. Atmel microcontroller system core 89C52 2. Bluetooth module ROK LCD display HD EEPROM 24C16-I2C bit PCM codec 6. Jazz multi sensor interface Beeper and led indicators AA Batteries Voltage monitor CENTRAL PROCESSING UNIT: The central processing unit contains the Bluetooth module with same part number as used in DAU, a PCM codec for data transmission and the module is interfaced to PC using parallel, serial and USB cable. Inside, there is Atmel 89C2051 microcontroller which handles UART transmission and I2C EEPROM (ID card programming). Figure-1: Central Processing Unit 3. SOFTWARE The various modules included in software and central system unit are as:- 3.1 DATA ANALYSIS MODULE:-It performs the analysis of the raw digital data which is used to obtain information about the physiological condition. 3.2 DATA LOGGER MODULE The raw or processed data and alerts and the operator s voice are stored 3.3 VISUALIZATION MODULE: It can be set in an off-line mode, where all the data is fetched from the database. 3.4 THE CONNECTION MANAGER: It enables communication with the CSU hardware, searching new devices in the covered range, establishing Bluetooth connections, incoming data buffering, sending alerts. 179

4. TYPES OF THE EMOTIONAL SENSORS TABLE 2 S/N Body Part Hardware/Sensor 1. For hand 1.1Emotion mouse 1.2Sentic mouse 2. For Eyes 2.1Expression Glasses 2.2Eye Tracking 2.3Magic Pointing 3. For body 3.

3 4. TYPES OF THE EMOTIONAL SENSORS TABLE 2 S/N Body Part Hardware/Sensor 1. For hand 1.1Emotion mouse 1.2Sentic mouse 2. For Eyes 2.1Expression Glasses 2.2Eye Tracking 2.3Magic Pointing 3. For body 3.1conductor jacket 4. For voice 4.1 artificial voice recognition 4.1. THE EMOTION MOUSE:- The device is capable of measuring heart rate, temperature, galvanic skin response and minute body movements and matches them with six emotional states: happiness, anger, fear, surprise sadness and disgust. The mouse consists a set of sensors, including detectors like infrared detectors and the chips that are temperature-sensitive. These components will also be embedded into other commonly used items such as office chairs, the steering wheel, the keyboard and the phone's handle. Integrating the system into the steering wheel, for example, could allow an alert to be sounded when a driver becomes drowsy [3][4]. Information Obtained From Emotion Mouse Behavior: Mouse movements, Button click frequency, Finger pressure when a user presses his/her button Physiological information: Heart rate (Electrocardiogram (ECG/EKG), Skin temperature (Thermistor), Skin electricity (Galvanic skin response, GSR), Electromyographic activity (Electromyogram, MG). Figure 2: Emotion Mouse SENTIC MOUSE:-It includes directional pressure sensor for aid in recognition of attraction and avoidance 180

4 Figure 3: Sentic Mouse 4.2 EYES: EXPRESSION GLASSES Figure 4: Eyes: Expression Glasses It is a wearable device which allows any viewer to visualize the confusion and interest levels of the wearer. Figure 5: Eyes Expression 181

5 4.3 BODY: CONDUCTOR S JACKET This jacket helps to extend the conductor s ability to express emotion and intentionality. 4.4 ARTIFICIAL INTELLIGENT SPEECH RECOGNITION It involves two basic ideas: 1. Studying the thought processes of human beings. 2. Deals with representing those processes via machines (like robots, computers etc). Further, the input words are scanned and matched against internally stored words that are known. Identification of a key word causes some action to be take place [4] [5]. 5. APPLICATIONS OF BLUE EYES In automobile industry: Ex: Cars to check the sincereness of driver. In voice control applications To create Face Responsive Display and Perceptive Environment In providing security and controlling the machines 6. LIMITATIONS OF BLUE EYES Target is not selected if not looked at for a set threshold Target is selected if stared at without user intention Sometimes the speed of speech is more than speed of speech or voice recognition system 7. FUTURE ENHANCEMENTS In the future, ordinary household devices- such as Televisions, Ovens may be able to do their jobs when we look at them and speak to them. Online airline and hotel booking will become much easier. Multi-tasking 8. CONCLUSION It provides more delicate and user friendly facilities in computing devices. The gap between the electronic and physical world is reduced. The computers can be run using implicit commands instead of the explicit commands. Future applications of blue eye technology are limitless. One of the benefits of speech recognition system is that it enables user do other works simultaneously. The user can concentrate on observation and manual operations while having a control on the machinery by voice input commands. 9. REFERENCES [1]. [2]. [3]. Bluetooth Module, Ericsson Microelectronics, [4]. AT89C52 8-bit Micro-controller Datasheet, Atmel [5]. [6]. eyes technology 182

International Journal of Emerging Technology in Computer Science & Electronics (IJETCSE) ISSN: Volume 21 Issue 4 APRIL 2016.

International Journal of Emerging Technology in Computer Science & Electronics (IJETCSE) ISSN: Volume 21 Issue 4 APRIL 2016. OPTIC CEASE R.Ragini Priya #1 and C.Sachin Nishanth *2 # B.Tech, Information Technology, Sri Venkateswara College of Engineering, Chennai * B.Tech, Information Technology, Sri Venkateswara College of Engineering,