Tegra Goes Industry: Embedded Hyperspectral Imaging

Transcription

1 Tegra Goes Industry: Embedded Hyperspectral Imaging GPU Technology Conference Munich, 11 October 2017 Michael Schoeffmann Session Id: 23161

2 Embedded Hyperspectral Imaging Introduction What is Hyperspectral Imaging? Hyperspectral Environment / Workflow Application Examples Embedded Hyperspectral Imaging 2

3 Introductory Example Rice Processing: Customers Expect Pure Rice 3

4 Introductory Example Rice Processing: Customers Expect Pure Rice In Production Rice Is Contaminated 4

5 Introductory Example Rice Processing: Customers Expect Pure Rice In Production Rice Is Contaminated Undesired, e.g. Wood 5

6 Introductory Example Rice Processing: Customers Expect Pure Rice In Production Rice Is Contaminated Undesired, e.g. Wood Forbidden, e.g. Maggots Indistinguishable in Visible Light 6

7 Introductory Example Rice Processing: Customers Expect Pure Rice In Production Rice Is Contaminated Undesired, e.g. Wood Forbidden, e.g. Maggots Indistinguishable in Visible Light Clearly visible in Extended Light Range 7

8 What is Light? Many object properties detectable in visible range, what if we extend this by the invisible range? 8

9 What is Light? Many object properties detectable in visible range, what if we extend this by the invisible range? Common ranges: Visible, Infrared Also used: Terahertz, UV 9

10 Light Measurement Molecules interact with light A certain wavelength may be reflected, transmitted, absorbed or altered to some extent Light Source Object consisting of Molecules Transmitted Light Transmitted and reflected light can be measured directly Reflected Light Measurement provides a spectral fingerprint of a substance Absorbed Light 10

11 Hyperspectral Data vs RGB Hyperspectral cubes can have any number of channels instead of only RGB Depending on the acquisition technology, currently up to wavelength positions 11

12 Hyperspectral Data Models Hyperspectral models extract desired information Hyperspectral models project information to e.g. RGB or grayscale Hyperspectral models provide information in interpretable images 12

13 Hyperspectral Imaging What we heard so far Light is not limited to the visual range Reflected or transmitted light provides a spectral fingerprint of examined objects Hyperspectral cubes contain much more information than RGB images Hyperspectral models provide desired information in interpretable images 13

14 Hyperspectral Environment - Motivation 14

15 Hyperspectral Imaging Two Main Challenges Find the application relevant information. Apply the application in the field. 15

16 Hyperspectral Environment Two-tier approach Deploy Perception STUDIO Acquire and work with hyperspectral data WYSIWYG Editor for hyperspectral models Compile configurations for real-time processing Perception CORE GPU accelerated processing engine for configurations Camera abstraction, standardization and calibration Standard machine vision interfaces Ready for Deployment in Industry 16

17 Perception Studio Develop an Application Customer needs no experience in Spectroscopy Image processing Acquisition technology Simple world of images Workflow Setup camera Acquire data cube Describe data cube Select method See output Generate model Apply to Core 17

18 Abstraction, Standardization Compatibility Perception Core Deployed Application Industrial PC Processing Box Module Chip Performance, Applicability cal.pac k... user device RAM Camera GEV UDP... CamLink camera input memory streaming outp. Machine Vision Appl. configuration GEV UDP CamLink Application line scan area scan (snapshot) wavelength scan (MEMS) GPU Eth. Usability, Selectivity CI Chemical Imaging CCI Chemical Color Imaging C Colorimetry IF Interferometry 18

19 Application Example: Pharmaceutical in Blister 19

20 Application Example: Mining 20

21 Application Example: Polymer Recycling 21

22 Application Example: API Distribution 22

23 Embedded Hyperspectral Imaging: Why Tegra? Performance Size, Weight & Power Consumption Efficient Code Development No moving parts Development Processing Power 23

24 Embedded Hyperspectral Imaging: Special Purpose Device Object Blood Vessel Camera Output Vein Model Object Moisture Camera Output Moisture Model 24

25 Distribution of Hyperspectral Systems 25

26 Thank you for your attention!