A Backend for Sensor Data

Transcription

1 A Backend for Sensor Data

2 Overview Hardware Sensors, Arduino & Raspberry Pi integration Software Sending data around Storing data Access, analysis and visualization

3 Hardware Dust MQ2 MQ135 DHT11 Temp. Humidity BMP180 Temp. Pressure

4 Arduino C GUIs PHP, JavaScript & InfluxDB SQL dialect Sensors Chronograf, Grafana,... Arduino RESTstyle calls Python USB Serial Raspberry Pi Data storage Json via Internet RESTstyle webservice InfluxDB line format Any other sensor data Yii based web interface Influx DB

5 Ingest: Data Flow Json via Internet RESTstyle webservice InfluxDB line format Influx DB {"esp8266id": "tomsensors", "software_version": "arduino2.py", "sensordatavalues":[{"value_type":"dust", "value":"736.41"},{"value_type":"mq2", "value":"356.0"},{"value_type":"mq135", "value":"247.0"},{"value_type":"dht11temperature", "value":"19.0"},{"value_type":"dht11humidity", "value":"19.0"},{"value_type":"bmp180pressure", "value":"947.66"},{"value_type":"bmp180temperature", "value":"20.4"},{"value_type":"bmp180altitude", "value":"560.98"}]} sidtomsensors dust=736.41,mq2=356.0,mq135=247.0,dht11temperature=19.0,dht11humidity=19.0,b MP180pressure=947.66,BMP180temperature=20.4,BMP180altitude=

6 InfluxDB NoSQL database specialized on time series Part of bigger software stack (including Chronograf) SQL like query syntax: select max(bmp180pressure), name: sidtomsensors time max T00:00:00Z min(bmp180pressure) from sidtomsensors; min curl -G " --data-urlencode "q=select max(bmp180pressure), min(bmp180pressure) from sidtomsensors" --data-urlencode "db=feinstaub" {"results":[{"statement_id":0,"series":[{"name":"sidtomsensors","columns":["time","ma x","min"],"values":[[" t00:00:00z",949.35,946.68]]}]}]}

7 GUI Build with PHP based framework Yii Similar to Django Bootstrap already on board User management Forms Diagrams & charts Current features: CSV import from Madavi server Generic query execution (inc. CSV export) Geo visualization done with JLeaflet JavaScript library Chart & graph visualizations

8 Demo!

9 Thanks!

10 Some more things...

11 Tools, libraries, frameworks,... BagIt: File Packaging Format Colorbrewer2: Color advice for cartography Swagger: The Worlds most popular API Tooling Affinity Photo PyCharm: Python IDE Orange: Data Mining Fruitful and Fun JLeaflet: JavaScript Library for interactive maps InfluxDB: Time Series DB JsonAPI: A specification for building APIs in Json Slack: Online collaboration Yii: The Fast, Secure and Professional PHP Framework Sensor stuff Arduino & Raspi,...

12 Orange: Data Mining Fruitful and Fun Data analytics Data visualization Machine learning Open source machine learning and data visualization for novice and expert. Interactive data analysis workflows with a large toolbox.

13 Features Interactive Data Visualization Visual Programming Add-ons Extend Functionality Teachers and Students Love It