Fraunhofer Heinrich Hertz Institute: Innovations in Medical Technology

Size: px

Start display at page:

Download "Fraunhofer Heinrich Hertz Institute: Innovations in Medical Technology"

Merry Sparks
6 years ago
Views:

1 : Innovations in Medical Technology Michael Witte - Berlin, Germany / Cambridge, MA

Within the Association Key figures Association 80 research units 22.

0 billion EUR HHI is a member of the following Groups Microelectronics Information and

2 Within the Association Key figures Association 80 research units employees Budget (2012): 2.0 billion EUR HHI is a member of the following Groups Microelectronics Information and Communication Technology (ICT, Guest) Defense and Security research (Guest) Alliances Embedded Systems Ambient Assisted Living AAL Digital Cinema Cluster Secure Identity

3 Facts and Figures n Development and distribution of the operating business 12% 7% 23% 303 employees 221 students 2% 9% 75% third-party funding 16% 55% % industry contracts % Operating budget: 22 m Euro 36% Operating budget: 38 m Euro 22% Basic financing National projects Industry contracts EU projects Other projects

4 Global Activities Industrial Customers 24 Countries 129 Cities

5 HHI Business Competencies - Medical n We cover the complete value chain

6 HHI Business Competencies - Medical n Bundling competencies for medical solutions - a few examples n Autoreoscopic 3D displays for diagnosis and education n Touchless interaction for sterile environment n Electronic, wireless 3D endoscopy and embedded systems n Highspeed data transmission in OR (fixed, wireless, optical) n Wireless sensor networks (generating/transmitting vital patient data) n Tracking & Sensing based on fiber optical sensing n Evaluation Studies (e.g. 3D Visualization in Laparoscopy, joint study with Klinikum r.d. Isar,, TUM) n Strategic Studies (current: HMI, Medical (3D) Visualization, Wireless in MedTech etc.)

7 Spectrum of Technologies Examples & Applications 7

for optimal shift of pixels on display n Large

8 3D - Autosterescopic Display n Autostereoscopic 3D no glasses needed n Integrated head/eye-tracking provides for optimal shift of pixels on display n Large sweet-spot and optimal depth perception Lenticular lens plate Pixel 8

3D - Multi-View n Pick-up and encode N parallel

Adopted for stereo (N=2) on Blu-ray disks Digital

9 3D - Multi-View n Pick-up and encode N parallel views or render display-specific views from generic depth-based format Multi-view camera Set-Up (N=16) n Transmit N parallel views n Display N views n Adopted for stereo (N=2) on Blu-ray disks Digital Cameras Virtual Cameras Examples of test sequences (N=8) 9

10 3D Construction of Static Objects 10

11 3D Augmented Reality - Real Time n Combination of real and virtual parts in Real-Time n Augmented reality visualization without glasses or other technical aids n Sophisticated image processing even on deformed surfaces n Estimation of deformation and shading 11

12 3D Augmented Reality - Real Time n Tracking of 3D liver motion using 3D model from scan n Real-time estimation (30fps) n Currently from single camera n Image projected (virtually) onto 3D model 12

prosthesis) n Less invasive than current

13 3D tracking - Real Time n 3D limb tracking without markers (knee prosthesis) n Less invasive than current fiduciary marker pins (femoral and tibial) n Optimal positioning and orientation of implant n Convenient visualization 3D real-time tracking of lower limbs to provide for optimal positioning and orientation of knee prosthesis 13

14 Image/Video Processing - Real Time n Videokymography of vocal cords (high speed imaging) stabilized video sequence original video sequence 14

15 Stabilization of Endoscopic Video

16 Video Coding n Scalable Video Coding (SVC) n Enables generation of scalable video bitstream in a single encoding process n Real-time processing of HD video data in 720p/30Hz 16

Content Based Media Retrieval n The Visuable Table of Content n Novel search, filter and presentation methods for large multimedia archives n Structure videos into

17 Content Based Media Retrieval n The Visuable Table of Content n Novel search, filter and presentation methods for large multimedia archives n Structure videos into scenes, shots and subshots for content-based photo and video search n Captures and analyses images during the actual recording process n Capable of learning semantic concepts 17

18 ipoint - Camera Based Finger Tracking Tom Cruise Minority Report, Tom Cruise 2006 Minority Report,

19 ipoint - Camera Based Finger Tracking n Touchless pixel-precise 3D real time tracking n Definition of semantic patterns n Multipointing interaction ipoint Presenter *Internet Link: 19

20 Your Finger as the Remote Control Karl Storz MI-report Manipulating 3D objects Johann Lafer TV-Kitchen control Interactive shopping window 20

21 Data Network - Visible Light n WLAN via visible light or IR links n World record with lighting LED: 500 Mbit/s n No EMI with radio systems or equipment n Simple shielding by opaque surfaces n Applications: n OR lights n On-route data streaming 21

22 TeraHertz - Application (Handheld) n Looking through walls n Explosives/liquids screening n Cavity detection in teeth n Measuring surface water content n Medical application, ie. skin carcinoma n Drying process of wet materials (paper) Smallest THz tip (1550 nm)* Cavity Liquid screening Tooth Skin Carcinoma * Integration of THz antenna on multi-layer chip packaged into fiber coupled THz tip (emitter / receiver) 22

23 Fiber Bragg Grating (FBG) Sensors n Femtosecond laser waveguide FBG processing n Ultradurable glassfiber, T max = 800 C (1470 F), r bend < 5mm Protective coating Laser Fiber Bragg Grating Inner primary coating Cladding Core of Glassfiber input signal transmission IN AWG OUT reflection FBG1 FBG2 FBG3 FBG4 FBG1 FBG2 FBG3 FBG4 FBG1 FBG2 FBG3 FBG4 23

24 3D Shape Sensing for Navigation n The 3D profile is provided by 3 FBG s per sensor level n The demo shows 2 sensor levels n For the endoscopy are 10 sensor levels vailable (accuray < 1 mm) n The approbriate setting of the sensors allows an automatic kompensation of the temperature n Processing of FBG sensors through femtosecond laser processing (ability of an autoclaviature setting)

25 Project 3D in Laparoscopy 2012 n Study for evaluating the benefits of 3D in the medical arena Cooperation with TUM, Klinikum r.d.i. Field of application: Laparoscopy Sponsored by industrial partners n Importance: : first study worldwide with consideration of 3D with and without glasses

26 Highlights 2013 n 3D Visualization in the Medical Arena Evaluation of the benefits of 3D in Preoperativ Planning/ Intervential Radialogy n 3Dmed: Stereoscopic Processing and Visualization for Medical Purposes (Testbed and Network Platform) n Navigation based on FBG Sensing (3D Shape Sensing) n Expert Conference: Medical (3D-) Visualization

27 Contact:

The Fraunhofer Heinrich Hertz Institute

The Fraunhofer Heinrich Hertz Institute The Driving the Gigabit Society Copyrights BVMed-Bilderpool, Einsteinufer 37, 10587 Berlin www.hhi.fraunhofer.de Facts and Figures Development and distribution of the operating business 7% 23% 303 employees