Parking Lot Practical IOT COURSE

Transcription

1 Parking Lot Practical IOT COURSE Richard Verhoeven Qingzhi Liu December 11, 2018, Eindhoven

2 Parking System Internet (wifi) Server Parking Lot Owner Parking Spot Vehicle From: Libelium.com / System Architecture and Networking Group PAGE 1

3 Parking Reservations / System Architecture and Networking Group PAGE 2

4 System Entities Parking Spot Properties Identity, state (Free, Reserved, Occupied) Location Reservation/user info: time, vehicle id. Services Change state Inspect state, polling or through observations Recognize vehicle license plate Firmware update / System Architecture and Networking Group PAGE 3

5 System Entities - Server Data Store Record state changes of parking spots Which parking spot is occupied when? Record vehicle behavior How long did a vehicle park? Visualizer Show the current state of the parking lot Broker / Manager Contact point for vehicles to reserve a parking spot Maintain the current state of the parking lot A parking spot assignment policy Optional: collect and analyze license plates / System Architecture and Networking Group PAGE 4

6 System Entities - Vehicle User interaction Contact the server to reserve a parking spot Interaction with camera Put image of license plate in front Advanced simulation (optional) Move through 2D space Decide where it wants to park Discover a parking spot (through the broker) Optionally, make a reservation Move to and take a parking spot Release the parking spot and the reservation / System Architecture and Networking Group PAGE 5

7 System Architecture Server / Broker (laptop or Raspberry Pi) Camera Parking spot (Raspberry Pi) Vehicle (simulation or web browser) / System Architecture and Networking Group PAGE 6

8 Protocol - LWM2M Objects Object Objec t ID Notes Parking Spot Parking Spot specific information Specification Private Objects Location 6 Location of the Parking Spot OMA LWM2M Firmware Update 5 Firmware of the Device OMA LWM2M / System Architecture and Networking Group PAGE 7

9 Protocol Parking Spot Object Resource Name Parking Spot ID Parking Spot State Resource ID Value Notes IoT-PiNN The same as End Point Name for the Parking Spot device. It is based on the hostname free, The value reflects the status of the parking reserved, spot. occupied Vehicle ID License plate number License plate number of the vehicle that reserved or occupied the parking spot. When the spot is free, the value is empty ( ). Billing Rate ,0 Costs for parking at that spot, in /s. The parking manager can adjust the rates to affect parking behavior. The rate could include electric charging fees. Vehicle Plate Image JPEG image An image of the license plate of the parked vehicle. / System Architecture and Networking Group PAGE 8

10 Protocol Location Object / System Architecture and Networking Group PAGE 9

11 Protocol Firmware Update Object / System Architecture and Networking Group PAGE 10

12 Scenario Registration After discovery of the LWM2M server: / System Architecture and Networking Group PAGE 11

13 Scenario Reserve a parking spot Ask broker for available spots Select a parking spot Inform the parking spot of the reservation / System Architecture and Networking Group PAGE 12

14 Scenario Sensing Camera / System Architecture and Networking Group PAGE 13

15 Scenario Visualization Service Present the current state of the parking area Is a spot free, reserved or occupied? Live update Retrieve the total number of free, reserved and occupied spots Retrieve a static overview of the parking area Identity, state and vehicle ID for all parking spots / System Architecture and Networking Group PAGE 14

16 Scenario Visualization / System Architecture and Networking Group PAGE 15

17 Scenario Plate Recognition & Transfer Capture image with the Raspberry Pi camera or take the next image from a directory Perform license plate recognition Use alpr to do this Returns license plate number and detection accuracy Update state of the parking spot Send best image to server as evidence Block transfer / System Architecture and Networking Group PAGE 16

18 Scenario Check Plate Number A reserved parking spot is equipped with a camera The camera recognizes a license plate The broker is informed of the arrival Contact a (online) database to verify the vehicle Notify parking manager if needed Collect evidence List lookup is fine ovi.rwd.nl could be used for Dutch Does your country have an online vehicle database? / System Architecture and Networking Group PAGE 17

19 Scenario Database Optimization Store pictures of license plates in a database Blob data in MySQL File on disk, name in SQLite Only save one best picture in the database Evidence for one parking event / System Architecture and Networking Group PAGE 18

20 Scenario Database Optimization Wait some time, so parking spot can select best image / System Architecture and Networking Group PAGE 19

21 Scenarios Localization & Guidance Indoor localization in a parking garage Server keeps track of the location of cars Parking spots report license plate in sequence Integration with lighting for route guidance Vehicle has reserved a spot and enters the parking garage Lights are activated to direct the vehicle to the empty spot Additional RPi can be provided for these scenarios / System Architecture and Networking Group PAGE 20

22 Implementation Try to get the basic functionality working Some tutorials and hints are provided In case of problems, ask for support Investigate the more complex functionality How difficult is it? How would you solve it? / System Architecture and Networking Group PAGE 21

23 Raspberry Pi with Camera Stable Package like this!! Warmer Use like this!! Unstable Cooler / System Architecture and Networking Group PAGE 22

24 Raspberry Pi - Distribution One Raspberry per group For parking system assignment Return at the end of the assignment Before the exam Provide your student card Photo will be taken as evidence Photos will be inspected when Raspberries don t return or when hardware misbehaves Change the default password and WiFi settings / System Architecture and Networking Group PAGE 23

25 Raspberry Pi - Software GIT repositories of CoAP and LwM2M frameworks ~/reference/leshan LwM2M - Java ~/reference/wakaama LwM2M - C ~/reference/txthings CoAP Python OMA LwM2M objects In ~/OMA, Java in ~/OMA/Leshan, C in ~/OMA/Wakaama Java and C code generated with ~/reference/codegen/ Useful tools raspistill take picture with camera alpr detect and extract license plate from picture / System Architecture and Networking Group PAGE 24

26 Raspberry Pi Network Access Use mdns for device discovery Raspberry Pi N is accessible as iot-pin.local. Use Bonjour, Avahi or built-in tools to find device Works in almost every network configuration WiFi AP with SSID iot-tue and PSK 2IMN Configure a matching hotspot Adjust the WiFi configuration afterwards sudo raspi-config Network Options Change default user password sudo raspi-config Wi-fi / System Architecture and Networking Group PAGE 25