SensorTile Miniature Multi-Sensor Module

Transcription

1 SensorTile Miniature Multi-Sensor Module SensorTile Development Kit Reference Software and Applications Smart Acoustic Audio libraries Virtual Reality With SensorTile

2 SensorTile Development Kit SensorTile Kit: STEVAL-STLKT01V1 SensorTile Core System STLCS01V1 Programming development kit Programming cable Standalone mode bundle SensorTile Cradle expansion STLCX01V1 SensorTile Cradle Board STLCR01V1 Plastic Box LiPo Battery

3 SensorTile Sensors, MCU, Connectivity SensorTile Core System: STLCS01V1 13.5mm MP34DT04 Digital Microphone 64dB SNR, 120dBSPL LD39115J18R LDO 150 ma low quiescent current low noise 1.8V STM32L476 Cortex-M4 Up to 100DMIPS 80MHz in run mode LSM6DSM 3D Acc+3D Gyro 1.6kHz Hz LSM303AGR 3D Acc+3D Mag 20 Hz (HR mode) Accel/Mag independent power down mode 13.5mm LPS22HB Barometer Water & Dust Resistant 1-75Hz, 1Hz Antenna Clearence Area BALF-NRG-01D3 Balun Filter BlueNRG-MS Bluetooth low energy Concurrent master/slave BT4.1 Bottom View

4 SensorTile Core System - Architecture Connections: Bottom side View Solderable Plugin

5 SensorTile Cradle Board Host board for Standalone Mode Solderable SensorTile Footprint Breakable SWD interface for programming E.g. may use STLink on STM32Nucleo HTS221 Humidity and Temperature sensor Battery Charger Bottom Side View SD Card Micro-USB interface Battery Connector ON/OFF Switch

6 SensorTile Cradle: STLCR01V1 SensorTile Cradle SensorTile Footprint Solderable HTS221 Humidity and Temperature sensor TOP VIEW BOTTOM VIEW STBC08 Li-Ion Battery charger with thermal regulation Micro-SD Card slot STC3115IQT Fuel-Gauge USBLC6-2P6 ESD Protecition LDK120M-R 200 ma low quiescent current very low noise LDO Micro USB ON/OFF switch Battery Plug SWD SWD programming interface

7 SensorTile Cradle expansion Board Host board for firmware development plug, program, unplug the Core System SensorTile Connector SWD programming i/f Use with any STM32Nucleo ST-Link Arduino Connectors Reset button bridging into developer communities Micro-USB i/f Audio DAC and 3.5mm Audio Jack

8 SensorTile Cradle Expansion SensorTile Cradle Expansion: STLCX01V1 SensorTile Footprint ST2378ETTR 8-Bit Level Translator 3.3V 1.8V Arduino Connector SWD & Reset SWD programming interface and reset button USBLC6-2P6 ESD Protecition LDK120M-R 200 ma low quiescent current very low noise LDO Micro USB & 3.3V Regulator Audio DAC & 3.5mm jack

9 SensorTile Embedded Software for Design and Prototyping Modular design environment to fast prototype your designs in all application domains Custom Applications AUDIO Motion Environmental BLE Application Libraries IoT Smart Things Wearable STM32Cube middleware STM32Cube Hardware Abstraction Layer Cloud SensorTile HW Kit Core System, Cradle, Cradle expansion Home applications Building automation SensorTile Development Kit is built on STM32Cube and supported by the STM32 Open Development Environment

10 SensorTile Software platform Starter Projects BlueMicrosystem BlueVoice Function Pack Core System

11 BlueMicrosystem STM32 OTA Firmware upgrade BMS Android and ios App free download

12 BlueMicrosystem Carry Position Native, out-of-the-box support for Activity Recognition Gesture Recognition Software libraries Sensor Fusion and OPEN.Framework Source code example projects

13 SensorTile & BlueVoice SensorTile Terminal Mobile Device Cloud-based Services «Natural Language» Platform Signals Comm Interface

14 SensorTile-powered Sensors-to-Cloud Integrated architecture Integrated SensorTile Terminal & 3 rd Party SW libs Gateway Cloud-based Services Signal Processing Sensing Communication

15 Putting together SW libraries 15 4-MEMS microphones array OpenSoftware.X SmartAcoustic1 Example project in source code built on STM32Cube software technology Includes acoustic Beam Forming, Echo Cancellation, and Source Localization. Immediate test and performance evaluation Source Localization User-selectable angle resolution User-selectable activation treshold Based on 4 MEMS microphones 360 localization range reference audio Beamforming Acoustic Echo Cancellation User-selectable neam direction User-selectable beamforming algorithm Based on 4 MEMS microphones GUI highlights the chosen microphone couple Based on a single MEMS microphone Reference audio is stored on STM32 FLASH Uses Audio OUT to play back audio while streaming cleaned speech on USB

16 SmartAcoustic1 GUI 16 Evaluation system Software reference design Multi platform support Supports STM32 Nucleo expansion boards X-NUCLEO-CCA01M1 X-NUCLEO-CCA02M1 connected to a NUCLEO-F446RE board Supports BlueCoin Integrated Audio and Sensors platform

17 Entry Level to Advanced Audio in 3 steps 17 MEMS microphones on Function Packs Advanced Free-Licensed Premium libraries Audio Over BLE Beamforming Source Localization Acoustic Echo-Cancellation Integrated Development Platforms

18 MEMS microphone array Audio SW IP and Ecosystem 18 reference 3 rd party ASR osxacousticsl embedded cloud osxacousticbf osxacousticec Trigger ASR Audio Analytics Noise Reduction Statistical Dereverberation Auto Gain Control - Voice Activity Detection - Statistical moments - Noise estimation -... Each osxacoustic library may be easily replaced by 3 rd party SW IP All are released under free evaluation and production licensing

19 Virtual Reality (VR) demo Provides real sense of presence and immersive experience using sensortile. Showcases low noise, drift and LSM6DSL current consumption ST Sensor Fusion algorithms. OpenSoftware.X SmartAcoustic1 MotionFx and ST MEMS sensors performances allow Low latency (<6 ms) to overcome motion sickness. Demo is conducted with: Google Pixel phone SensorTile (running motionfx and connected to the phone via USB) Google Cardboard ST devices used STEVAL-STLKT01V1 LSM6DSM LSM303AGR STM32L4 SensorTile solid with CardBoard sends Sensor Fusion data Cardboard USB Android 7.0 Mobile running VR Reality App