Neue Verfahren der Bildverarbeitung auch zur Erfassung von Schäden in Abwasserkanälen?

Transcription

1 Neue Verfahren der Bildverarbeitung auch zur Erfassung von Schäden in Abwasserkanälen? Fraunhofer HHI

2 Fraunhofer-Gesellschaft Fraunhofer is Europe s largest organization for applied research. 69 institutes and research units in Germany Research cooperation around the world staff members Budget: more than 2.1 billion Research highlights: MP3 audio codec, H.264, H.265 video codec, LTE mobile communications standard Fraunhofer HHI

3 Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute, HHI 1928 Founding of Heinrich Hertz Institute in Berlin Since 1960s Research on fiber optical transmission Since 1980s Research on digital video coding Since 2003 Member of Fraunhofer-Gesellschaft Since 2009 Branch site in Goslar, Germany Fraunhofer HHI

4 Facts and Figures Last updated: 2015 Fraunhofer HHI

5 Departments Photonic Network and Systems Photonic Components Fiber Optical Sensor Systems Wireless Communications and Networks Vision and Imaging Technologies Video Coding and Analytics Photo: fotolia.com/seanpavonephoto Edit: Fraunhofer HHI Fraunhofer HHI

6 Image Processing Pipeline Processing & Analysis scene acquisition geometry motion / deformation semantic data inspection rendering & display Fraunhofer HHI

7 2D Scene Capturing Projection of 3D scene into 2D image plane Loss of 1 dimension Still images or video Higher and higher resolution Fraunhofer HHI

8 Image Reprojection perspective camera fisheye camera Camera calibration determines parameters of projection Image can be reprojected onto any other surface But viewing position cannot be changed Fraunhofer HHI

9 Image Reprojection perspective camera fisheye camera Fraunhofer HHI

10 Spectral Sensitivity NIR imaging RGB image of tumor 500nm Regular camera and humans: RGB colors Multi-spectral imaging can provide material properties Information invisible to humans thermal imaging Fraunhofer HHI

11 3D Scene Capturing disparity d=x l -x r x l x r z~ 3D geometry can be estimated from multiple views (photogrammetry) Ill-posed problem Requires determination of corresponding points between views Epipolar geometry constrains search space triangulation Fraunhofer HHI

12 Depth Estimation from Stereo Images captured with high resolution (10-20 MP) Dense reconstruction from 2 or more views Arbitrary objects Reconstruction of entire head or persons (incl. hair, eyes, etc.) Fraunhofer HHI

13 High Detail 3D Reconstruction [Blumenthal, Computers & Graphics 2014] Fraunhofer HHI

14 Textured 3D Model from 2 Views Fraunhofer HHI

15 3D Models in Security Applications augmented reality visualization security gates Fraunhofer HHI

16 High Quality 3D Reconstruction Fraunhofer HHI

17 Aerial Surveillance, Object Detection Fraunhofer HHI

18 Analysis of Vegetation and Landscapes Fraunhofer HHI

19 Inspection of Laser Welds Fraunhofer HHI

20 3D Recording of Footprints Fraunhofer HHI

21 Support of Large Range of Object Sizes Fraunhofer HHI

22 Tracking and Motion Estimation camera motion object motion Object / camera motion can be determined from point correspondences 3D motion requires additional priors (e.g. static scene, deformation model) Dense / sparse motion models Fraunhofer HHI

23 3D Motion Tracking of Robot 3D tracking of motion path Corresponding points with epipolar constraint Assumption of near cylindrical pipe shape Fraunhofer HHI

24 Enhanced Surface Textures Projection onto 3D cylinder surface Correction of lighting artifacts Compared to simple unwrap higher resolution less stitching artifacts unwrapping with 3D motion Panoramo Fraunhofer HHI

25 Deformable Surface Tracking Fraunhofer HHI

26 Deformable Surface Tracking Fraunhofer HHI

27 3D Surface Tracking for Navigated Surgery Fraunhofer HHI

28 Image Analysis with Machine Learning [ImageNet] Deep neural networks highly successful for many image analysis tasks image classification (e.g. detection of defects in pipes) scene labeling / segmentation image synthesis Fraunhofer HHI

29 Image Classification (labeled) Training data Classifier Testing Training Fish Fraunhofer HHI

30 Convolutional Neural Network Fraunhofer HHI

31 Explanation of Black Box Black box classifier Explanation of deep neural network decisions Visualization via relevance feedback Fraunhofer HHI

32 Detection of Morphing Attacks Original Morph Detection of morphing attacks in ABC Gates Anomaly detection in passport images Sematic image forensics Machine learning Fraunhofer HHI

33 Creation of Face Morphs Morphing pipeline with exchangeable components Feature detection Warping Blending Automatic alignment of face images based of feature points/feature lines Automatic adaptive blending that prevents visible cuts Field warping Alpha blending (α=.5) Piecewise affine Our adaptive Original image source: pics.stir.ac.uk Fraunhofer HHI

34 Detection of Face Morphs Morphing attack detection using Deep Neural Networks Creation of training and test datasets >1500 original images Image pre-processing (filtering, noise) to increase variations in dataset Comparison of different network architectures Fraunhofer HHI

35 VR / AR for Interaction and Assistance Fraunhofer HHI

36 Dynamic 3D Scene Capturing Fraunhofer HHI

37 TimeLab Fraunhofer HHI

38 Omnidirectional Video High resolution 360 video No stitching artifacts 2D and 3D Real-time end to end streaming Fraunhofer HHI

39 Sample Productions Fraunhofer HHI

40 Summary Image processing and analysis is a powerful tool for many applications Significant progress in imaging hardware High-resolution, ubiquitous and cheap cameras VR / AR glasses Increased computing power (mobile devices, graphics boards) Machine learning enables novel AI technologies New applications in water resource management? Fraunhofer HHI

41 Fraunhofer-Institut für Nachrichtentechnik, Heinrich-Hertz-Institut, HHI WE PUT SCIENCE INTO ACTION. Contact: Einsteinufer Berlin Fraunhofer HHI