Indoor navigation using smartphones Chris Hide IESSG, University of Nottingham, UK
Overview Smartphones Available sensors Current positioning methods Positioning research at IESSG 1. Wi-Fi fingerprinting 2. Inertial navigation 3. Video+inertial+GPS navigation 4. Other research Conclusions
Smartphone sensors GPS Microphone Wi-Fi Ambient light sensor 3G/GPRS 3-axis accelerometer Bluetooth Proximity sensor 3-axis gyro FM radio 3-axis magnetometer Camera
Current smartphone positioning
Current positioning methods GPS Microphone Wi-Fi Ambient light sensor 3G/GPRS 3-axis accelerometer Bluetooth Proximity sensor 3-axis gyro FM radio 3-axis magnetometer Camera
Current positioning methods Cell-ID Wi-Fi GPS 200m
1. Wi-Fi fingerprinting
Wi-Fi fingerprinting GPS Microphone Wi-Fi Ambient light sensor 3G/GPRS 3-axis accelerometer Bluetooth Proximity sensor 3-axis gyro FM radio 3-axis magnetometer Camera
Wi-Fi fingerprinting Measure signal strengths to all Access Points in view Match measured signal strengths to database Requires database of: Location signal strengths to all Access Points (APs) in view Signal strengths 1. Position, ID1, SS1, ID2, SS2, ID3, SS3,... 2. Position, ID1, SS1, ID2, SS2, ID3, SS3,... 3. Position, ID1, SS1, ID2, SS2, ID3, SS3,... 4. Position, ID1, SS1, ID2, SS2, ID3, SS3,... 5.... Position
Data collection Data collected on ground floor of Nottingham Geospatial Building HP laptop with Wi-Fi Netstumbler for Wi-Fi data collection Foot mounted IMU Microstrain 3DM-GX3 USB communication and power Outputs NMEA data Basic Wi-Fi fingerprinting software developed at IESSG
Signal strength for one AP Signal strength to AP 00:23:33:16:3C:90 >-40dB -40 to -50dB -50 to -60dB -60 to -70dB -70 to -80dB < -80dB
Basic Wi-Fi fingerprinting
Wi-Fi fingerprinting Works better indoors where walls/ceilings/furniture will attenuate signals the most i.e. Accuracy comes from signal strength varying spatially Advanced algorithms Particle filtering How do we build databases? Skyhook use fleet of vehicles with GPS (tribe sourcing) Google use crowd sourcing(?) But what about inside where GPS isn t working? Slow database generation using building plans Scalability? How do we keep the database up-to-date?
2. Inertial navigation
Inertial navigation GPS Microphone Wi-Fi Ambient light sensor 3G/GPRS 3-axis accelerometer Bluetooth Proximity sensor 3-axis gyro FM radio 3-axis magnetometer Camera
Inertial Navigation 3 gyros and 3 accelerometers Orientation from integrating gyros Displacement from rotating measurements to Earth frame (using gyros), removing gravity and double integrating accelerometers Not very accurate! MEMS getting better Cheaper (higher volumes e.g. Wii, smartphones) Better manufacturing Calibration Successful results usually from Good sensors Integration with GPS, magnetometers, zero velocity, Step detection algorithms
Inertial Navigation Time (s) Horiz error (m) 60 231 120 891 180 2781 240 6297 300 11819 360 19287
3. Computer Vision + Inertial + GPS
Computer Vision + Inertial Navigation GPS Microphone Wi-Fi Ambient light sensor 3G/GPRS 3-axis accelerometer Bluetooth Proximity sensor 3-axis gyro FM radio 3-axis magnetometer Camera
Concept: Video Aided Inertial Successive images used to compute direction camera is moving Used to correct IMU drift
Computer Vision Ground plane Homography algorithm Single camera looking at plane Compute rotation and translation between images t 1
Examples... Computer Vision Blue (inlier correspondences) Red (outlier correspondences)
Integration INS corrections IMU Rotation, Acceleration INS Position, Velocity, Attitude Kalman filter Ranges, Ephemeris Position, Velocity GPS PVT computation Camera Image Computer Vision Translation
Experiment GPS Power
Position accuracy Time (s) Horiz error (m) 60 0.4 120 0.4 180 0.9 240 3.0 300 0.9 360 3.7
GPS+IMU+Vision Advantages Good position accuracy Makes use of sensors already on smartphones Handheld Works with or without GPS Disadvantages Needs to be initialised e.g. with GPS Not tested with real smartphones (yet) Problems in low light conditions Computationally expensive
4. Other research
Other research GPS Microphone Wi-Fi Ambient light sensor 3G/GPRS 3-axis accelerometer Bluetooth Proximity sensor 3-axis gyro FM radio 3-axis magnetometer Maps Camera
Magnetometers Other research Total magnetic field varies spatially Image matching (image bag-of-words) Build database of images and locations (like Wi-Fi) Search for an image match to get location Map matching Already used for inertial and Wi-Fi (particle filtering) Walls and doors constrain user motion Direction of travel
Conclusions Identified some promising technologies for navigation GPS, Wi-Fi, gyros, accelerometers, magnetometers, cameras, maps sensors already available on smartphones (although not necessarily that accurate) non-dedicated infrastructure positioning e.g. Wi-Fi, images, magnetic field what else? Other sensors? needs a strong case to appear on a smartphone e.g. NFC Integration solution will comprise of several technologies? use inertial navigation to combine together?
Chris Hide IESSG, University of Nottingham, UK