Working with Sensors & Internet of Things

Transcription

1 Working with Sensors & Internet of Things Mobile Application Development 2015/16 Fall 10/9/2015 Satish Srirama Mohan Liyanage Satish Srirama

2 Mobile sensing More and more sensors are being incorporated into today s smartphones These sensors are enabling new applications across a wide variety of domains, such as healthcare, social networks, safety, environment, etc. 10/9/2015 Satish Srirama 2 Image Source -

3 What is a Sensor? A sensor is a physical or virtual object that can sense events or changes in its environment, and produce corresponding output Most of the times sensor output will be an electrical/ optical pulse 10/9/2015 Satish Srirama 3

4 Mobile phone s built-in sensors MIC Camera Temperature Location (GPS or Network) Orientation Accelerometer Proximity Pressure Light Note: not every device has all kinds of sensors Image Source - 10/9/2015 Satish Srirama 4

5 The Android platform supports three broad categories of sensors 1. Motion sensors These sensors measure acceleration forces and rotational forces along X,Y,Z axes. Includes accelerometers, gravity sensors, gyroscopes, and rotational vector sensors. 2. Environmental sensors To measure various environmental parameters Ambient air temperature and pressure Illumination Humidity. Includes barometers, photometers, and thermometers, etc. 10/9/2015 Satish Srirama 5

6 Sensor Types -continued 3. Position sensors Measure the physical position of a device Includes orientation sensors and magnetometers Note: Some of these sensors are always hardwarebased (accelerometer, gyroscope, temperature, light, magnetometer) and some of these sensors (gravity, linear acceleration, rotation vector )can be either hardware-based or software-based (virtual). 10/9/2015 Satish Srirama 6

7 Motion Sensors Accelerometer Measures the acceleration force on all three physical axes (X,Y,Z) Useful for monitoring device movement like tilt, shake, rotation, or swing Image Source - /library/prerelease/ios/docu mentation/uikit/reference/ UIAcceleration_Class/index. html Zompopo: Mobile Calendar Prediction Based on Human Activities Recognition Using the Accelerometer and Cloud Services:Srirama, 10/9/2015 Satish Narayana, Huber Flores, and Carlos Satish Paniagua. Srirama NGMAST IEEE,

8 Gyroscope Motion Sensors -continued Measures a device's rate of rotation (angular velocity) When the device is not rotating, the sensor values will be zero 10/9/2015 Satish Srirama Image Source 8

9 Magnetic Field Position Sensors Monitor changes in the earth's magnetic field on X,Y,Z axes With the orientation sensor, you can determine the position of a device 10/9/2015 Image Source - Satish Srirama 9

10 Environmental Sensors Android provides four hardware-based sensors to monitor Relative ambient humidity Illuminance Ambient pressure Ambient temperature 10/9/2015 Satish Srirama 10

11 Environmental Sensors -continued Proximity sensor Most proximity sensors are simply light sensors(ir) that will detect "proximity Reduce display power consumption by turning off the LCD backlight Disable the touch screen to avoid accidental touch events (the ear contact with the screen and generating touch events while on a call) 10/9/2015 Satish Srirama 11

12 Sensor Framework You can access the raw sensor data by accessing the Android sensor framework Android s sensors are controlled by external services The framework has provided call back to obtain sensor data App Register Callback SensorManager Sensor Event Sensor Event 10/9/2015 Satish SensorEventListener Srirama call back 12

13 Sensor Framework -continued The Android sensor framework contains the following classes and interfaces SensorManager This class provides various methods for Accessing and listing sensors Registering and unregistering sensor event listeners SensorManager msensormanager; msensormanager = (SensorManager)getSystemService(SENSOR_SERVICE); ServiceManager provides access to Sensor Manager Service Sensor A class representing a sensor Uses to create an instance of a specific sensor Sensor maccelerometer; maccelerometer = msensormanager.getdefaultsensor(sensor.type_accelerometer); 10/9/2015 Satish Srirama 13

14 Sensor Framework -continued SensorEvent The system uses this class to create a sensor event object, which holds information such as the sensor's type, raw sensor data, of a of a sensory event SensorEventListener Provides two callback methods that receive notifications (sensor events) When sensor accuracy change public void onaccuracychanged(sensor sensor, int accuracy) { // Do something here if sensor accuracy changes } When sensor values change public void onsensorchanged(sensorevent event) { // Many sensors return 3 values, one for each axis. float value1 = event.values[0];. // Do something with this sensor value. } 10/9/2015 Satish Srirama 14

15 Sensor Framework -continued Important: Make sure to disable any sensor when you don t use or when the sensor activity pauses protected void onpause() { super.onpause(); msensormanager.unregisterlistener(this); } The system will not disable sensors when the screen turns off that leads to the battery will drain in a few hours You can register sensor listener when the activity resumed protected void onresume() { super.onresume(); msensormanager.registerlistener(this, maccelerometer, SensorManager.SENSOR_DELAY_NORMAL); } 10/9/2015 Satish Srirama 15

16 Course Exercise 1 Identify which sensors are on the device 10/9/2015 Satish Srirama 16

17 Course Exercise 2 Reading accelerometer data 10/9/2015 Satish Srirama 17

18 @Override public final void onsensorchanged(sensorevent event) { float x = event.values[0]; float y= event.values[1]; float z = event.values[2]; tv1.settext( "X : " +x+" Y : "+y+" Z : "+z); protected void onresume() { super.onresume(); msensormanager.registerlistener(this, macc, SensorManager.SENSOR_DELAY_NORMAL); protected void onpause() { super.onpause(); msensormanager.unregisterlistener(this); } } 10/9/2015 Satish Srirama 18

19 Working with the sensor simulator Download and extract ds/detail?name=sensorsimulator-2.0- rc1.zip&can=2&q=sensorsimulator Execute sensor simulator $ java jar sensorsimulator-2.0-rc1.jar 10/9/2015 Satish Srirama 19

20 10/9/2015 Satish Srirama 20

21 Communicate with the AVD Install app in AVD adbinstall SensorSimulatorSettings-2.0-rc1.apk (adb command in /android-sdk/platform-tools/) Set IP address in AVD 10/9/2015 Satish Srirama 21

22 Course Exercise 3 Orientation indicator that displays the device orientation as Left, Middle and Right 10/9/2015 Satish Srirama 22

23 Mobile Sensing and Internet of Things 10/9/2015 Satish Srirama 23

24 Internet of Things (IOT) International Telecommunication Union defined IoT as A global infrastructure for the information society enabling advanced services by interconnecting (physical and virtual) things based on existing and evolving, interoperable information and communication technologies (ITU Internet report-2005) 10/9/2015 Satish Srirama 24

25 Internet of Things (IOT) -continued European Research Cluster on the Internet of Things defined IoTas: The Internet of Things allows people and things to be connected Anytime, Anyplace, with Anything and Anyone, ideally using Any path/network and Any service. 10/9/2015 Satish Srirama 25

26 Internet of Things (IOT) -continued Athing, Canbeapersonwithaheartmonitorimplant A farm animal with a biochip transponder An automobile that has built-in sensors Other natural or man-made objects With unique identifier and the ability to communicate over the internet without requiring human interaction. 10/9/2015 Satish Srirama 26

27 Why it is so important? More connected devices than people Cisco believes the market size will be $19 trillion by /9/2015 Satish Srirama 27

28 Environment Protection Great Barrier Reef in Australia Buoys equipped with sensors collect biological, physical, and chemical data to minimize and prevent reef damage Source : Kip Compton, VP Internet of Things (IoT) Systems and Software Group The Internet of Things: What Does it Take to Make the Internet of Everything 10/9/2015 Satish Srirama 28 Real?

29 Smart Home Scenario Sensing as a Service Model for Smart Cities Supported by Internet of Things, CharithPerera1, ArkadyZaslavsky, Peter Christen, Dimitrios Georgakopoulos, TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES Trans. Emerging Tel. Tech /9/2015 Satish Srirama 29

30 Smart Healthcare Medication in The United States Smart pill bottles remind patients to take their medication and records that the patient has taken the correct dosage Source : Kip Compton, VP Internet of Things (IoT) Systems and Software Group The Internet of Things: What Does it Take to Make the Internet of Everything 10/9/2015 Satish Srirama 30 Real?

31 Smart health Dr. M, project KAIST 10/9/2015 Satish Srirama 31

32 Smart Agriculture Minimizing the Use of Insecticides Smart trapping solutions compile data and map the number of different types of insects that have been detected Source : Kip Compton, VP Internet of Things (IoT) Systems and Software Group The Internet of Things: What Does it Take to Make the Internet of Everything 10/9/2015 Satish Srirama 32 Real?

33 Where Mobiles can Fit? Most of the times IOT sensors do not have a sufficient amount of energy and processing power to connect directly to the internet through Wi-Fi or mobile networks Especially when the sensors deploy sparsely, a mobile device can work as a sink/relay to collect the sensor data and upload them to the backend servers Eg: Mobile crowd sensing, Wildlife tracking etc. 10/9/2015 Satish Srirama 33

34 Mobile Sensing with Non-integrated Sensors Mobile phones can collect data from external sensors and upload them to the backend servers or provide data directly to the end users(mobile Host*) Wildlife tracking, logistics, urban sensing, etc. Android phones can communicate with sensors over the Air interface (Wi-Fi, Bluetooth, NFC, ZigBee, etc.) *S. N. Srirama: Mobile Hosts in Enterprise Service Integration, PhD thesis, RWTH Aachen University, September, /9/2015 Satish Srirama 34

35 Arduino Sensor kit Basic prototype board with the Arduino Mega ADK microcontroller and the sensor shield Microcontroller 10/9/2015 Sensor shield Satish Srirama 35

36 Demo Reading ambient temperature Setup Mega ADK microcontroller Bluetooth module and temperature sensor App to communicate with the Arduino 10/9/2015 Satish Srirama 36

37 Mega ADK microcontroller & sensor shield Android APP Bluetooth low energy(ble) shield 10/9/2015 Satish Srirama 37

38 How does it work? Temperature sensor generates an analog signal according to the temperature variance Microcontroller do the A/D conversion and forward data to the Bluetooth module Arduino code 10/9/2015 Satish Srirama 38

39 How does it work? -continued Bluetooth module transmits data to the Android device over the established connection The Android app reads data over the established BLE connection, processed and present to the end user 10/9/2015 Satish Srirama 39

40 Control LEDs over the WEB Running a small web server on the Arduino board which provides controlling LEDs through Web interface Setup 10/9/2015 Satish Srirama 40

41 IOT research in Mobile Cloud Lab The goal of this research is to overcome the challenges of cyber-physical systems in the Internet of Things Our research interestsare Middleware Energy-efficient Things Framework Mobile-hosted Things Middleware (MHTM) Mobile-hosted Cloud Middleware (MHCM) Mobile Resource Composition Mediation Framework (MRCMF) Trust Trustworthy Internet of Things Application Real-time Augmented Reality using Context-aware Cloud services with Mobile Hosts 10/9/2015 Satish Srirama 41

42 Home assignment 2 An object moves from left to right (and viceversa) based on the orientation of the device 10/9/2015 Satish Srirama 42

43 Home assignment 2-continued A touch event makes the object to jump over an obstacle Submission deadline is 22 nd October /9/2015 Satish Srirama 43

44 References/Suggested readings C. Chang, S. N. Srirama, M. Liyanage: A Service-Oriented Mobile Cloud Middleware Framework for Provisioning Mobile Sensing as a Service, The 21st IEEE International Conference on Parallel and Distributed Systems (ICPADS 2015), December 14-17, IEEE. (Accepted for Publication) C. Chang, S. N. Srirama, J. Mass: A Middleware for Discovering Proximity-based Service-Oriented Industrial Internet of Things, 12th IEEE International Conference on Services Computing (SCC 2015), June 27 -July 2, 2015, pp IEEE. C. Chang, S. Loke, H. Dong, F. Salim, S. N. Srirama, M. Liyanage, S. Ling: An Energy-Efficient Interorganizational Wireless Sensor Data Collection Framework, The IEEE 22nd International Conference on Web Services (ICWS 2015), June 27 -July 2, 2015, pp IEEE. B. Zhou, A. Dastjerdi, R. Calheiros, S. N. Srirama, R. Buyya: A Context Sensitive Offloading Scheme for Mobile Cloud Computing Service, 8th IEEE International Conference on Cloud Computing (CLOUD 2015), June 27 -July 2, 2015, pp IEEE. M. Liyanage, C. Chang, S. N. Srirama: Lightweight Mobile Web Service Provisioning for Sensor Mediation, 4th International Conference on Mobile Services (MS 2015), June 27 -July 2, 2015, pp IEEE. (Won Best Paper Award) S. N. Srirama, A. Ostovar: Optimal Resource Provisioning for Scaling Enterprise Applications on the Cloud, The 6th IEEE International Conference on Cloud Computing Technology and Science (CloudCom-2014), December 15-18, 2014, pp IEEE. C. Chang, S. N. Srirama, S. Ling: SPiCa: A Social Private Cloud Computing Application Framework, The 13th International Conference on Mobile and Ubiquitous Multimedia (MUM 2014), November 25-28, 2014, pp ACM. J. Mass, S. N. Srirama, H. Flores, C. Chang: Proximal and Social-aware Device-to-Device Communication via Audio Detection on Cloud, The 13th International Conference on Mobile and Ubiquitous Multimedia (MUM 2014), November 25-28, 2014, pp ACM. 10/9/2015 Satish Srirama 44