Direct Co-Calibration of Endobronchial Ultrasound and Video

Size: px
Start display at page:

Download "Direct Co-Calibration of Endobronchial Ultrasound and Video"

Transcription

1 Direct Co-Calibration of Endobronchial Ultrasound and Video Philipp Dressel 1, Marco Feuerstein 1,2, Tobias Reichl 1,2, Takayuki Kitasaka 3, Nassir Navab 1, Kensaku Mori 2,4 1 Computer Aided Medical Procedures (CAMP), Technische Universität München, Germany 2 Graduate School of Information Science,, Japan 3 Faculty of Information Science, Aichi Institute of Technology, Japan 4 Information and Communications Headquarters,, Japan

2 9/20/2010 Philipp Dressel, Computer Aided Medical Procedures, Technische Universität München 2 Introduction Endobronchial ultrasound (EBUS) Navigation solutions may require US/Cam calibration

3 9/20/2010 Philipp Dressel, Computer Aided Medical Procedures, Technische Universität München 3 Ultrasound plane Camera coordinates Bronchoscope head Ultrasound coordinates Camera frustum

4 9/20/2010 Philipp Dressel, Computer Aided Medical Procedures, Technische Universität München 4 Camera Fibreoptic Low resolution High distortion Introduction CAM H US Ultrasound Surface contact Low imaging depth Noise?

5 Method 9/20/2010 Philipp Dressel, Computer Aided Medical Procedures, Technische Universität München v u US CAM s v s u H K y x ), ( ), ( ), ( u s v s v u K y x Image scaling Camera image coordinates Camera matrix Ultrasound image coordinates Ultrasound scaling

6 Method Measure phantom in advance Allows calibration from single image pair Estimate camera pose using method of Wengert (also considering distortion and adjusting for velocity in water with refractive index 1.33) Estimate ultrasound pose using Z-fiducial method Combine series of images for increased accuracy 9/20/2010 Philipp Dressel, Computer Aided Medical Procedures, Technische Universität München v u US P P CAM s v s u H H K y x

7 9/20/2010 Philipp Dressel, Computer Aided Medical Procedures, Technische Universität München 7 Method: Z-fiducials C A N Z M D B Method: [Hsu, P., Prager, R., Gee, A., Treece, G.: Real-time freehand 3D ultrasound calibration. Ultrasound in Medicine & Biology 34(2) (2008) ]

8 9/20/2010 Philipp Dressel, Computer Aided Medical Procedures, Technische Universität München 8 Phantom

9 9/20/2010 Philipp Dressel, Computer Aided Medical Procedures, Technische Universität München 9 Results Use tool tip to mark corresponding locations Move until tip is visible in ultrasound

10 9/20/2010 Philipp Dressel, Computer Aided Medical Procedures, Technische Universität München 10 Results Sample point locations Compute cumulative pixel distance of point pairs Proposed method Hand-eye & single-wall + *... Camera point Ultrasound point US plane thickness Correspondences

11 cumulative pixel error cumulative pixel error 9/20/2010 Philipp Dressel, Computer Aided Medical Procedures, Technische Universität München 11 Results Hand-eye & single-wall Proposed method n i i cpe p y qy i measurement measurement cpe n i1 i p y q i y

12 9/20/2010 Philipp Dressel, Computer Aided Medical Procedures, Technische Universität München 12 Conclusion Compared to hand-eye and single-wall: Comparable accuracy Higher precision Faster Build more complex phantom once Calibrate quickly many times

A New Approach to Ultrasound Guided Radio-Frequency Needle Placement

A New Approach to Ultrasound Guided Radio-Frequency Needle Placement A New Approach to Ultrasound Guided Radio-Frequency Needle Placement Claudio Alcérreca 1,2, Jakob Vogel 2, Marco Feuerstein 2, and Nassir Navab 2 1 Image Analysis and Visualization Lab., CCADET UNAM, 04510

More information

An Application Driven Comparison of Several Feature Extraction Algorithms in Bronchoscope Tracking During Navigated Bronchoscopy

An Application Driven Comparison of Several Feature Extraction Algorithms in Bronchoscope Tracking During Navigated Bronchoscopy An Application Driven Comparison of Several Feature Extraction Algorithms in Bronchoscope Tracking During Navigated Bronchoscopy Xióngbiāo Luó 1, Marco Feuerstein 1,2, Tobias Reichl 2, Takayuki Kitasaka

More information

Modified Hybrid Bronchoscope Tracking Based on Sequential Monte Carlo Sampler: Dynamic Phantom Validation

Modified Hybrid Bronchoscope Tracking Based on Sequential Monte Carlo Sampler: Dynamic Phantom Validation Modified Hybrid Bronchoscope Tracking Based on Sequential Monte Carlo Sampler: Dynamic Phantom Validation Xióngbiāo Luó 1, Tobias Reichl 2, Marco Feuerstein 2, Takayuki Kitasaka 3, and Kensaku Mori 4,1

More information

Single Camera Calibration

Single Camera Calibration Single Camera Calibration using Partially Visible Calibration Objects Based on Random Dots Marker Tracking Algorithm *Yuji Oyamada1,2, Pascal Fallavollita2, and Nassir Navab2 1. Keio University, Japan

More information

Image Thickness Correction for Navigation with 3D Intra-cardiac Ultrasound Catheter

Image Thickness Correction for Navigation with 3D Intra-cardiac Ultrasound Catheter Image Thickness Correction for Navigation with 3D Intra-cardiac Ultrasound Catheter Hua Zhong 1, Takeo Kanade 1,andDavidSchwartzman 2 1 Computer Science Department, Carnegie Mellon University, USA 2 University

More information

Towards an Estimation of Acoustic Impedance from Multiple Ultrasound Images

Towards an Estimation of Acoustic Impedance from Multiple Ultrasound Images Towards an Estimation of Acoustic Impedance from Multiple Ultrasound Images Christian Wachinger 1, Ramtin Shams 2, Nassir Navab 1 1 Computer Aided Medical Procedures (CAMP), Technische Universität München

More information

Rigid Body Motion and Image Formation. Jana Kosecka, CS 482

Rigid Body Motion and Image Formation. Jana Kosecka, CS 482 Rigid Body Motion and Image Formation Jana Kosecka, CS 482 A free vector is defined by a pair of points : Coordinates of the vector : 1 3D Rotation of Points Euler angles Rotation Matrices in 3D 3 by 3

More information

GPU Ultrasound Simulation and Volume Reconstruction

GPU Ultrasound Simulation and Volume Reconstruction GPU Ultrasound Simulation and Volume Reconstruction Athanasios Karamalis 1,2 Supervisor: Nassir Navab1 Advisor: Oliver Kutter1, Wolfgang Wein2 1Computer Aided Medical Procedures (CAMP), Technische Universität

More information

A hybrid opto-inertial Tracking System Prototype

A hybrid opto-inertial Tracking System Prototype A hybrid opto-inertial Tracking System Prototype Faisal Kalim Faisal.kalim@tum.de Supervisor: Benjamin Busam Partners: IFL & FRAMOS Final Presentation Computer Aided Medical Procedures (CAMP) Technische

More information

Precise Ultrasound Bone Registration with Learning-based Segmentation and Speed of Sound Calibration

Precise Ultrasound Bone Registration with Learning-based Segmentation and Speed of Sound Calibration Precise Ultrasound Bone Registration with Learning-based Segmentation and Speed of Sound Calibration Mehrdad Salehi 1,2, Raphael Prevost 1, José-Luis Moctezuma 3, Nassir Navab 2, and Wolfgang Wein 1 1

More information

CALIBRATION ALGORITHM FOR FREEHAND ULTRASOUND

CALIBRATION ALGORITHM FOR FREEHAND ULTRASOUND CALIBRAION ALGORIHM FOR FREEHAND ULRASOUND 1 YAO RAO, YAO PENG 1 Aeronautic College, Shanghai University of Engineering Science, Shanghai 0160, China School of Economics & Management, Beihua University,

More information

GPU-accelerated Rendering for Medical Augmented Reality in Minimally-invasive Procedures

GPU-accelerated Rendering for Medical Augmented Reality in Minimally-invasive Procedures GPU-accelerated Rendering for Medical Augmented Reality in Minimally-invasive Procedures Matthias Wieczorek 1, André Aichert 1, Oliver Kutter 1, Christoph Bichlmeier 1, Jürgen Landes 2, Sandro Michael

More information

Towards systematic usability evaluations for the OR: an introduction to OR-Use framework

Towards systematic usability evaluations for the OR: an introduction to OR-Use framework Towards systematic usability evaluations for the OR: an introduction to OR-Use framework Information Processing in Computer Aided Interventions June 27, 2012, Pisa, Italy Ali Bigdelou, Aslı Okur, Max-Emanuel

More information

We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors

We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists 3,800 116,000 120M Open access books available International authors and editors Downloads Our

More information

Deformable Registration of Bronchoscopic Video Sequences to CT Volumes with Guaranteed Smooth Output

Deformable Registration of Bronchoscopic Video Sequences to CT Volumes with Guaranteed Smooth Output Deformable Registration of Bronchoscopic Video Sequences to CT Volumes with Guaranteed Smooth Output Tobias Reichl 1, Xiongbiao Luo 2, Manuela Menzel 3, Hubert Hautmann 3, Kensaku Mori 4, and Nassir Navab

More information

Virtual Touch : An Efficient Registration Method for Catheter Navigation in Left Atrium

Virtual Touch : An Efficient Registration Method for Catheter Navigation in Left Atrium Virtual Touch : An Efficient Registration Method for Catheter Navigation in Left Atrium Hua Zhong 1, Takeo Kanade 1, and David Schwartzman 2 1 Computer Science Department, Carnegie Mellon University, USA,

More information

Real-time 3D reconstruction: applications to collision detection and surgical workflow monitoring

Real-time 3D reconstruction: applications to collision detection and surgical workflow monitoring Real-time 3D reconstruction: applications to collision detection and surgical workflow monitoring Nassir Navab! Alexander Ladikos, Nicolas Padoy, Diana Mateus and Cedric Cagniart! Presented by Nicolas

More information

3D Guide Wire Navigation from Single Plane Fluoroscopic Images in Abdominal Catheterizations

3D Guide Wire Navigation from Single Plane Fluoroscopic Images in Abdominal Catheterizations 3D Guide Wire Navigation from Single Plane Fluoroscopic Images in Abdominal Catheterizations Martin Groher 2, Frederik Bender 1, Ali Khamene 3, Wolfgang Wein 3, Tim Hauke Heibel 2, Nassir Navab 2 1 Siemens

More information

Vision-based endoscope tracking for 3D ultrasound image-guided surgical navigation [Yang et al. 2014, Comp Med Imaging and Graphics]

Vision-based endoscope tracking for 3D ultrasound image-guided surgical navigation [Yang et al. 2014, Comp Med Imaging and Graphics] Vision-based endoscope tracking for 3D ultrasound image-guided surgical navigation [Yang et al. 2014, Comp Med Imaging and Graphics] Gustavo Sato dos Santos IGI Journal Club 23.10.2014 Motivation Goal:

More information

A Method for Tracking the Camera Motion of Real Endoscope by Epipolar Geometry Analysis and Virtual Endoscopy System

A Method for Tracking the Camera Motion of Real Endoscope by Epipolar Geometry Analysis and Virtual Endoscopy System A Method for Tracking the Camera Motion of Real Endoscope by Epipolar Geometry Analysis and Virtual Endoscopy System Kensaku Mori 1,2, Daisuke Deguchi 2, Jun-ichi Hasegawa 3, Yasuhito Suenaga 2, Jun-ichiro

More information

Endoscopic Navigation for Minimally Invasive Suturing

Endoscopic Navigation for Minimally Invasive Suturing Endoscopic Navigation for Minimally Invasive Suturing Christian Wengert 1, Lukas Bossard 1, Armin Häberling 1, Charles Baur 2, Gábor Székely 1, and Philippe C. Cattin 1 1 Computer Vision Laboratory, ETH

More information

arxiv: v3 [cs.cv] 12 Jun 2018

arxiv: v3 [cs.cv] 12 Jun 2018 Markerless Inside-Out Tracking for Interventional Applications Benjamin Busam 1,2, Patrick Ruhkamp 1,2, Salvatore Virga 1, Beatrice Lentes 1, Julia Rackerseder 1, Nassir Navab 1,3, Christoph Hennersperger

More information

University of Cambridge Department of Engineering Trumpington Street Cambridge CB2 1PZ United Kingdom

University of Cambridge Department of Engineering Trumpington Street Cambridge CB2 1PZ United Kingdom Comparison of Freehand 3D Ultrasound Techniques Using a Stylus P-W. Hsu, G. M. Treece, R. W. Prager N. E. Houghton and A. H. Gee CUED/F-INFENG/TR 579 June 2007 University of Cambridge Department of Engineering

More information

Fully Automatic Endoscope Calibration for Intraoperative Use

Fully Automatic Endoscope Calibration for Intraoperative Use Fully Automatic Endoscope Calibration for Intraoperative Use Christian Wengert, Mireille Reeff, Philippe C. Cattin, Gábor Székely Computer Vision Laboratory, ETH Zurich, 8092 Zurich, Switzerland {wengert,

More information

Markerless Endoscopic Registration and Referencing

Markerless Endoscopic Registration and Referencing Markerless Endoscopic Registration and Referencing Christian Wengert 1, Philippe Cattin 1, John M. Duff 2, Charles Baur 3, and Gábor Székely 1 1 Computer Vision Laboratory, ETH Zurich, 8092 Zurich, Switzerland

More information

Coordinate Transformations, Tracking, Camera and Tool Calibration

Coordinate Transformations, Tracking, Camera and Tool Calibration Coordinate Transformations, Tracking, Camera and Tool Calibration Tassilo Klein, Hauke Heibel Computer Aided Medical Procedures (CAMP), Technische Universität München, Germany Motivation 3D Transformations

More information

ABSTRACT 1. INTRODUCTION

ABSTRACT 1. INTRODUCTION Tracked ultrasound calibration studies with a phantom made of LEGO bricks Marie Soehl, Ryan Walsh, Adam Rankin, Andras Lasso, Gabor Fichtinger Queen s University, Kingston ON, Canada ABSTRACT PURPOSE:

More information

New Approaches to Online Estimation of Electromagnetic Tracking Errors for Laparoscopic Ultrasonography

New Approaches to Online Estimation of Electromagnetic Tracking Errors for Laparoscopic Ultrasonography New Approaches to Online Estimation of Electromagnetic Tracking Errors for Laparoscopic Ultrasonography Marco Feuerstein 1, Tobias Reichl 2,3, Jakob Vogel 3, Joerg Traub 3, and Nassir Navab 3 1 Department

More information

Autonomous Navigation for Flying Robots

Autonomous Navigation for Flying Robots Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 3.2: Sensors Jürgen Sturm Technische Universität München Sensors IMUs (inertial measurement units) Accelerometers

More information

Deformable Registration of Bronchoscopic Video Sequences to CT Volumes with Guaranteed Smooth Output

Deformable Registration of Bronchoscopic Video Sequences to CT Volumes with Guaranteed Smooth Output Deformable Registration of Bronchoscopic Video Sequences to CT Volumes with Guaranteed Smooth Output Tobias Reichl 1, Xiongbiao Luo 2, Manuela Menzel 3, Hubert Hautmann 3, Kensaku Mori 4, and Nassir Navab

More information

Introduction to Medical Image Registration

Introduction to Medical Image Registration Introduction to Medical Image Registration Sailesh Conjeti Computer Aided Medical Procedures (CAMP), Technische Universität München, Germany sailesh.conjeti@tum.de Partially adapted from slides by: 1.

More information

Inside-Out Tracking for Flexible Hand-held Nuclear Tomographic Imaging

Inside-Out Tracking for Flexible Hand-held Nuclear Tomographic Imaging Inside-Out Tracking for Flexible Hand-held Nuclear Tomographic Imaging Philipp Matthies 1,2, Chen-Hsuan Shih 3, Jakob Vogel 4, Álvaro Sánchez5, Tobias Lasser 1, Benjamin Frisch 1, Michael Friebe 2,6, and

More information

Real-Time 4D Ultrasound Mosaicing and Visualization

Real-Time 4D Ultrasound Mosaicing and Visualization Real-Time 4D Ultrasound Mosaicing and Visualization Laura J. Brattain 1,2 and Robert D. Howe 1 1 Harvard School of Engineering and Applied Sciences, Cambrige, MA 02138 2 MIT Lincoln Laboratory, 244 Wood

More information

Multi-View 3D-Reconstruction

Multi-View 3D-Reconstruction Multi-View 3D-Reconstruction Cedric Cagniart Computer Aided Medical Procedures (CAMP) Technische Universität München, Germany 1 Problem Statement Given several calibrated views of an object... can we automatically

More information

Markerless Endoscopic Registration and Referencing

Markerless Endoscopic Registration and Referencing Markerless Endoscopic Registration and Referencing Christian Wengert 1, Philippe Cattin 1, John M. Duff 2, Charles Baur 3, and Gábor Székely 1 1 ETH Zurich - Computer Vision Laboratory, Sternwartstrasse

More information

A Novel Phantom-Less Spatial and Temporal Ultrasound Calibration Method

A Novel Phantom-Less Spatial and Temporal Ultrasound Calibration Method A Novel Phantom-Less Spatial and Temporal Ultrasound Calibration Method Ali Khamene and Frank Sauer Imaging and Visualization Dept., Siemens Corporate Research, 755 College Road East, Princeton NJ 08540,

More information

The Concept of Evolutionary Computing for Robust Surgical Endoscope Tracking and Navigation

The Concept of Evolutionary Computing for Robust Surgical Endoscope Tracking and Navigation The Concept of Evolutionary Computing for Robust Surgical Endoscope Tracking and Navigation Ying Wan School of Computing and Communications University of Technology, Sydney This dissertation is submitted

More information

Rectification and Disparity

Rectification and Disparity Rectification and Disparity Nassir Navab Slides prepared by Christian Unger What is Stereo Vision? Introduction A technique aimed at inferring dense depth measurements efficiently using two cameras. Wide

More information

Calibration Method for Determining the Physical Location of the Ultrasound Image Plane

Calibration Method for Determining the Physical Location of the Ultrasound Image Plane Calibration Method for Determining the Physical Location of the Ultrasound Image Plane Devin V. Amin, Ph.D. 1, Takeo Kanade, Ph.D 1., Branislav Jaramaz, Ph.D. 2, Anthony M. DiGioia III, MD 2, Constantinos

More information

Measurement Techniques. Digital Particle Image Velocimetry

Measurement Techniques. Digital Particle Image Velocimetry Measurement Techniques Digital Particle Image Velocimetry Heat and Mass Transfer Laboratory (LTCM) Sepideh Khodaparast Marco Milan Navid Borhani 1 Content m Introduction m Particle Image Velocimetry features

More information

Creating a Vision Channel for Observing Deep-Seated Anatomy in Medical Augmented Reality

Creating a Vision Channel for Observing Deep-Seated Anatomy in Medical Augmented Reality Creating a Vision Channel for Observing Deep-Seated Anatomy in Medical Augmented Reality A Cut-Away Technique for In-Situ Visualization Felix Wimmer 1, Christoph Bichlmeier 1, Sandro M. Heining 2, Nassir

More information

Computed Photography - Final Project Endoscope Exploration on Knee Surface

Computed Photography - Final Project Endoscope Exploration on Knee Surface 15-862 Computed Photography - Final Project Endoscope Exploration on Knee Surface Chenyu Wu Robotics Institute, Nov. 2005 Abstract Endoscope is widely used in the minimally invasive surgery. However the

More information

Improved Navigated Spine Surgery Utilizing Augmented Reality Visualization

Improved Navigated Spine Surgery Utilizing Augmented Reality Visualization Improved Navigated Spine Surgery Utilizing Augmented Reality Visualization Zein Salah 1,2, Bernhard Preim 1, Erck Elolf 3, Jörg Franke 4, Georg Rose 2 1Department of Simulation and Graphics, University

More information

Bolus Tracking in Colon MRI

Bolus Tracking in Colon MRI Bolus Tracking in Colon MRI Project Presentation Christian Harrer, Andreas Keil, Dr. Sonja Buhmann (Klinikum Großhadern) 2 August 2007 Chair for Computer Aided Medical Procedures & Augmented Reality Department

More information

Lecture 3 Sections 2.2, 4.4. Mon, Aug 31, 2009

Lecture 3 Sections 2.2, 4.4. Mon, Aug 31, 2009 Model s Lecture 3 Sections 2.2, 4.4 World s Eye s Clip s s s Window s Hampden-Sydney College Mon, Aug 31, 2009 Outline Model s World s Eye s Clip s s s Window s 1 2 3 Model s World s Eye s Clip s s s Window

More information

Enabling Technologies for Robot Assisted Ultrasound Tomography

Enabling Technologies for Robot Assisted Ultrasound Tomography Enabling Technologies for Robot Assisted Ultrasound Tomography Seminar Presentation By: Fereshteh Aalamifar Team Members: Rishabh Khurana, Fereshteh Aalamifar Mentors: Emad Boctor, Iulian Iordachita, Russell

More information

Use of Ultrasound and Computer Vision for 3D Reconstruction

Use of Ultrasound and Computer Vision for 3D Reconstruction Use of Ultrasound and Computer Vision for 3D Reconstruction Ruben Machucho-Cadena 1, Eduardo Moya-Sánchez 1, Sergio de la Cruz-Rodríguez 2, and Eduardo Bayro-Corrochano 1 1 CINVESTAV, Unidad Guadalajara,

More information

Development of Pseudo 3D Visualization System by Superimposing Ultrasound Images

Development of Pseudo 3D Visualization System by Superimposing Ultrasound Images Development of Pseudo 3D Visualization stem b uperimposing Ultrasound Images Yumi Iwashita, hinji Tarumi, Ro Kurazume Graduate chool of Information cience and Electrical Engineering Kushu Universit, Fukuoka,

More information

Integrated System for Planning Peripheral Bronchoscopic Procedures

Integrated System for Planning Peripheral Bronchoscopic Procedures Integrated System for Planning Peripheral Bronchoscopic Procedures Jason D. Gibbs, Michael W. Graham, Kun-Chang Yu, and William E. Higgins Penn State University Dept. of Electrical Engineering University

More information

Ultrasound Specific Similarity Measures for Three-Dimensional Mosaicing

Ultrasound Specific Similarity Measures for Three-Dimensional Mosaicing Ultrasound Specific Similarity Measures for Three-Dimensional Mosaicing Christian Wachinger and Nassir Navab Computer Aided Medical Procedures (CAMP), Technische Universität München, Boltzmannstr. 3, 85748

More information

Stereo Matching! Christian Unger 1,2, Nassir Navab 1!! Computer Aided Medical Procedures (CAMP), Technische Universität München, Germany!!

Stereo Matching! Christian Unger 1,2, Nassir Navab 1!! Computer Aided Medical Procedures (CAMP), Technische Universität München, Germany!! Stereo Matching Christian Unger 12 Nassir Navab 1 1 Computer Aided Medical Procedures CAMP) Technische Universität München German 2 BMW Group München German Hardware Architectures. Microprocessors Pros:

More information

Out-of-plane motion estimation based on a Rician-Inverse Gaussian model of RF ultrasound signals: speckle tracking without fully developed speckle

Out-of-plane motion estimation based on a Rician-Inverse Gaussian model of RF ultrasound signals: speckle tracking without fully developed speckle Cum Laude Poster Award Out-of-plane motion estimation based on a Rician-Inverse Gaussian model of RF ultrasound signals: speckle tracking without fully developed speckle N. Afsham, M. Najafi, P. Abolmaesumi,

More information

Backward-Warping Ultrasound Reconstruction for Improving Diagnostic Value and Registration

Backward-Warping Ultrasound Reconstruction for Improving Diagnostic Value and Registration Backward-Warping Ultrasound Reconstruction for Improving Diagnostic Value and Registration Wolfgang Wein 1, Fabian Pache 1,BarbaraRöper 2, and Nassir Navab 1 1 Chair for Computer Aided Medical Procedures

More information

ULTRASONOGRAPHY is an appealing technology to

ULTRASONOGRAPHY is an appealing technology to IEEE TRANSACTIONS ON MEDICAL IMAGING, VOL. 28, NO. 6, JUNE 2009 951 Magneto-Optical Tracking of Flexible Laparoscopic Ultrasound: Model-Based Online Detection and Correction of Magnetic Tracking Errors

More information

Multi-view Surface Inspection Using a Rotating Table

Multi-view Surface Inspection Using a Rotating Table https://doi.org/10.2352/issn.2470-1173.2018.09.iriacv-278 2018, Society for Imaging Science and Technology Multi-view Surface Inspection Using a Rotating Table Tomoya Kaichi, Shohei Mori, Hideo Saito,

More information

Computer Graphics. Lecture 9 Environment mapping, Mirroring

Computer Graphics. Lecture 9 Environment mapping, Mirroring Computer Graphics Lecture 9 Environment mapping, Mirroring Today Environment Mapping Introduction Cubic mapping Sphere mapping refractive mapping Mirroring Introduction reflection first stencil buffer

More information

ACCURACY OF MAP DIGITIZING BY USING DIGITAL CAMERA

ACCURACY OF MAP DIGITIZING BY USING DIGITAL CAMERA ACCURACY OF MAP DIGITIZING BY USING DIGITAL CAMERA Takashi YAMAMOTO*, Jong-Hyeok JEONG*, Masataka TAKAGI*, Masataka TAKAGI* Kochi University of Technology* ABSTRACT: In the past, a large accurate image

More information

Manifold Learning for Image-Based Breathing Gating with Application to 4D Ultrasound

Manifold Learning for Image-Based Breathing Gating with Application to 4D Ultrasound Manifold Learning for Image-Based Breathing Gating with Application to 4D Ultrasound Christian Wachinger, Mehmet Yigitsoy, Nassir Navab Computer Aided Medical Procedures (CAMP), TUM, Munich, Germany {wachinge,

More information

INTRODUCTION TO MEDICAL IMAGING- 3D LOCALIZATION LAB MANUAL 1. Modifications for P551 Fall 2013 Medical Physics Laboratory

INTRODUCTION TO MEDICAL IMAGING- 3D LOCALIZATION LAB MANUAL 1. Modifications for P551 Fall 2013 Medical Physics Laboratory INTRODUCTION TO MEDICAL IMAGING- 3D LOCALIZATION LAB MANUAL 1 Modifications for P551 Fall 2013 Medical Physics Laboratory Introduction Following the introductory lab 0, this lab exercise the student through

More information

Chapter 11 Application of High Speed Imaging in Particle Dynamics Study with Explosives

Chapter 11 Application of High Speed Imaging in Particle Dynamics Study with Explosives Chapter 11 Application of High Speed Imaging in Particle Dynamics Study with Explosives Elena Jacobs and Vilem Petr Abstract High-speed imaging can provide invaluable information during any explosive testing.

More information

MR-Mirror: A Complex of Real and Virtual Mirrors

MR-Mirror: A Complex of Real and Virtual Mirrors MR-Mirror: A Complex of Real and Virtual Mirrors Hideaki Sato 1, Itaru Kitahara 1, and Yuichi Ohta 1 1 Department of Intelligent Interaction Technologies, Graduate School of Systems and Information Engineering,

More information

Camera Model and Calibration

Camera Model and Calibration Camera Model and Calibration Lecture-10 Camera Calibration Determine extrinsic and intrinsic parameters of camera Extrinsic 3D location and orientation of camera Intrinsic Focal length The size of the

More information

Autonomous Navigation for Flying Robots

Autonomous Navigation for Flying Robots Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 7.2: Visual Odometry Jürgen Sturm Technische Universität München Cascaded Control Robot Trajectory 0.1 Hz Visual

More information

Real-time Tissue Tracking with B-Mode Ultrasound Using Speckle and Visual Servoing

Real-time Tissue Tracking with B-Mode Ultrasound Using Speckle and Visual Servoing Real-time Tissue Tracking with B-Mode Ultrasound Using Speckle and Visual Servoing Alexandre Krupa, Gabor Fichtinger, and Gregory D. Hager IRISA - INRIA Rennes, France, alexandre.krupa@irisa.fr Engineering

More information

Active Echo: A New Paradigm for Ultrasound Calibration

Active Echo: A New Paradigm for Ultrasound Calibration Active Echo: A New Paradigm for Ultrasound Calibration Xiaoyu Guo, Alexis Cheng, Haichong K. Zhang, Hyun-Jae Kang, Ralph Etienne-Cummings, and Emad M. Boctor The Johns Hopkins University, Baltimore, MD

More information

Ray tracing based fast refraction method for an object seen through a cylindrical glass

Ray tracing based fast refraction method for an object seen through a cylindrical glass 20th International Congress on Modelling and Simulation, Adelaide, Australia, 1 6 December 2013 www.mssanz.org.au/modsim2013 Ray tracing based fast refraction method for an object seen through a cylindrical

More information

3-D D Euclidean Space - Vectors

3-D D Euclidean Space - Vectors 3-D D Euclidean Space - Vectors Rigid Body Motion and Image Formation A free vector is defined by a pair of points : Jana Kosecka http://cs.gmu.edu/~kosecka/cs682.html Coordinates of the vector : 3D Rotation

More information

Recovering the Full Pose from a Single Keyframe

Recovering the Full Pose from a Single Keyframe Recovering the Full Pose from a Single Keyframe Pierre Fite Georgel Selim Benhimane Jürgen Sotke Nassir Navab CAMP - TU München METAIO CAMP - TU München CAMP - TU München Abstract Photo-based Augmentation

More information

Autonomous Navigation for Flying Robots

Autonomous Navigation for Flying Robots Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 3.1: 3D Geometry Jürgen Sturm Technische Universität München Points in 3D 3D point Augmented vector Homogeneous

More information

Trans-skull Imaging System by Ultrasonic Array Probe

Trans-skull Imaging System by Ultrasonic Array Probe Proceedings of the 9 IEEE International Conference on Systems, Man, and Cybernetics San Antonio, TX, USA - October 9 Trans-skull Imaging System by Ultrasonic Array Probe Genta Hiramatsu, Yuichiro Ikeda,

More information

Mech. Engineering, Comp. Science, and Rad. Oncology Departments. Schools of Engineering and Medicine, Bio-X Program, Stanford University

Mech. Engineering, Comp. Science, and Rad. Oncology Departments. Schools of Engineering and Medicine, Bio-X Program, Stanford University Mech. Engineering, Comp. Science, and Rad. Oncology Departments Schools of Engineering and Medicine, Bio-X Program, Stanford University 1 Conflict of Interest Nothing to disclose 2 Imaging During Beam

More information

ECE-161C Cameras. Nuno Vasconcelos ECE Department, UCSD

ECE-161C Cameras. Nuno Vasconcelos ECE Department, UCSD ECE-161C Cameras Nuno Vasconcelos ECE Department, UCSD Image formation all image understanding starts with understanding of image formation: projection of a scene from 3D world into image on 2D plane 2

More information

A Robust Meshing and Calibration Approach for Sensorless Freehand 3D Ultrasound

A Robust Meshing and Calibration Approach for Sensorless Freehand 3D Ultrasound A Robust Meshing and Calibration Approach for Sensorless Freehand 3D Ultrasound Hassan Rivaz a,emadboctor a, and Gabor Fichtinger a,b,c Department of a Computer Science, b Mechanical Engineering, c Radiology,

More information

Autonomous Mobile Robot Design

Autonomous Mobile Robot Design Autonomous Mobile Robot Design Topic: EKF-based SLAM Dr. Kostas Alexis (CSE) These slides have partially relied on the course of C. Stachniss, Robot Mapping - WS 2013/14 Autonomous Robot Challenges Where

More information

Rendering. Converting a 3D scene to a 2D image. Camera. Light. Rendering. View Plane

Rendering. Converting a 3D scene to a 2D image. Camera. Light. Rendering. View Plane Rendering Pipeline Rendering Converting a 3D scene to a 2D image Rendering Light Camera 3D Model View Plane Rendering Converting a 3D scene to a 2D image Basic rendering tasks: Modeling: creating the world

More information

Autonomous Navigation for Flying Robots

Autonomous Navigation for Flying Robots Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 7.1: 2D Motion Estimation in Images Jürgen Sturm Technische Universität München 3D to 2D Perspective Projections

More information

University of Cambridge Department of Engineering Trumpington Street Cambridge CB2 1PZ United Kingdom.

University of Cambridge Department of Engineering Trumpington Street Cambridge CB2 1PZ United Kingdom. MULTI-DIRECTIONAL SCATTERING MODELS FOR 3D ULTRASOUND U. Z. Ijaz, R. J. Housden, G. M. Treece R. W. Prager, and A. H. Gee CUED/F-INFENG/TR 661 January 2011 University of Cambridge Department of Engineering

More information

Computed tomography (Item No.: P )

Computed tomography (Item No.: P ) Computed tomography (Item No.: P2550100) Curricular Relevance Area of Expertise: Biology Education Level: University Topic: Modern Imaging Methods Subtopic: X-ray Imaging Experiment: Computed tomography

More information

3-D Ultrasound Probe Calibration for Computer-Guided Diagnosis and Therapy

3-D Ultrasound Probe Calibration for Computer-Guided Diagnosis and Therapy 3-D Ultrasound Probe Calibration for Computer-Guided Diagnosis and Therapy Michael Baumann 1,2, Vincent Daanen 1, Antoine Leroy 2, and Jocelyne Troccaz 1 1 TIMC Laboratory, GMCAO Department, Institut d

More information

Sphere Extraction in MR Images with Application to Whole-Body MRI

Sphere Extraction in MR Images with Application to Whole-Body MRI Sphere Extraction in MR Images with Application to Whole-Body MRI Christian Wachinger a, Simon Baumann a, Jochen Zeltner b, Ben Glocker a, and Nassir Navab a a Computer Aided Medical Procedures (CAMP),

More information

A New and General Method for Blind Shift-Variant Deconvolution of Biomedical Images

A New and General Method for Blind Shift-Variant Deconvolution of Biomedical Images A New and General Method for Blind Shift-Variant Deconvolution of Biomedical Images Moritz Blume 1,Darkoikic 1, Wolfgang Wein 1,2, and Nassir Navab 1 1 Computer Aided Medical Procedures (CAMP), Technische

More information

Automatic Patient Registration for Port Placement in Minimally Invasive Endoscopic Surgery

Automatic Patient Registration for Port Placement in Minimally Invasive Endoscopic Surgery Automatic Patient Registration for Port Placement in Minimally Invasive Endoscopic Surgery Marco Feuerstein 1,2, Stephen M. Wildhirt 2, Robert Bauernschmitt 2, and Nassir Navab 1 1 Computer Aided Medical

More information

New Sony DepthSense TM ToF Technology

New Sony DepthSense TM ToF Technology ADVANCED MATERIAL HANDLING WITH New Sony DepthSense TM ToF Technology Jenson Chang Product Marketing November 7, 2018 1 3D SENSING APPLICATIONS Pick and Place Drones Collision Detection People Counting

More information

Freehand Three-Dimensional Ultrasound Calibration

Freehand Three-Dimensional Ultrasound Calibration Freehand Three-Dimensional Ultrasound Calibration Po-Wei Hsu Department of Engineering Girton College University of Cambridge A thesis submitted for the degree of Doctor of Philosophy December 2007 Acknowledgements

More information

ULTRASOUND (US) has become one of the standard

ULTRASOUND (US) has become one of the standard 538 IEEE TRANSACTIONS ON MEDICAL IMAGING, VOL. 36, NO. 2, FEBRUARY 2017 Towards MRI-Based Autonomous Robotic US Acquisitions: A First Feasibility Study Christoph Hennersperger, Bernhard Fuerst, Salvatore

More information

Intraoperative Ultrasound Probe Calibration in a Sterile Environment

Intraoperative Ultrasound Probe Calibration in a Sterile Environment Intraoperative Ultrasound Probe Calibration in a Sterile Environment Ramtin Shams 1, Raúl San José Estépar 2, Vaibhav Patil 2, and Kirby G. Vosburgh 2,3 1 CECS, The Australian National University, Canberra

More information

Adaptive Branch Tracing and Image Sharpening for Airway Tree Extraction in 3-D Chest CT

Adaptive Branch Tracing and Image Sharpening for Airway Tree Extraction in 3-D Chest CT Adaptive Branch Tracing and Image Sharpening for Airway Tree Extraction in 3-D Chest CT Marco Feuerstein 1, Takayuki Kitasaka 2,3, Kensaku Mori 1,3 1 Graduate School of Information Science, Nagoya University,

More information

Semi-Automatic Segmentation of the Patellar Cartilage in MRI

Semi-Automatic Segmentation of the Patellar Cartilage in MRI Semi-Automatic Segmentation of the Patellar Cartilage in MRI Lorenz König 1, Martin Groher 1, Andreas Keil 1, Christian Glaser 2, Maximilian Reiser 2, Nassir Navab 1 1 Chair for Computer Aided Medical

More information

Intrinsic and Extrinsic Camera Parameter Estimation with Zoomable Camera for Augmented Reality

Intrinsic and Extrinsic Camera Parameter Estimation with Zoomable Camera for Augmented Reality Intrinsic and Extrinsic Camera Parameter Estimation with Zoomable Camera for Augmented Reality Kazuya Okada, Takafumi Taketomi, Goshiro Yamamoto, Jun Miyazaki, Hirokazu Kato Nara Institute of Science and

More information

Optics B/C. Mitchell Gu

Optics B/C. Mitchell Gu Mitchell Gu Disclaimer: This presentation was prepared using draft rules. There may be some changes in the final copy of the rules. Overview A two-part event featuring a written test on geometric and physical

More information

Vision-Based Hand Detection for Registration of Virtual Objects in Augmented Reality

Vision-Based Hand Detection for Registration of Virtual Objects in Augmented Reality International Journal of Future Computer and Communication, Vol. 2, No. 5, October 213 Vision-Based Hand Detection for Registration of Virtual Objects in Augmented Reality Kah Pin Ng, Guat Yew Tan, and

More information

ICRP Symposium on Radiological Protection Dosimetry

ICRP Symposium on Radiological Protection Dosimetry ICRP Symposium on Radiological Protection Dosimetry Tokyo February 18 th, 2016 M. Zankl a, J. Becker a, K.F. Eckerman b, W.E. Bolch c, R. Behrens d a Helmholtz Zentrum München, Neuherberg, Germany b Oak

More information

3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery

3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery 3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery Masahiko Nakamoto 1, Yoshinobu Sato 1, Masaki Miyamoto 1, Yoshikazu Nakamjima

More information

Robot Calibration for Precise Ultrasound Image Acquisition

Robot Calibration for Precise Ultrasound Image Acquisition Abstract Robot Calibration for Precise Ultrasound Image Acquisition Pedro M. B. Torres 1,2, Paulo J. S. Gonçalves 1,2, Jorge M. M. Martins 2 1 Polytechnic Institute of CasteloBranco, School of Technology,

More information

Interaction-Free Calibration for Optical See-Through Head-Mounted Displays based on 3D Eye Localization

Interaction-Free Calibration for Optical See-Through Head-Mounted Displays based on 3D Eye Localization 1/23 Interaction-Free Calibration for Optical See-Through Head-Mounted Displays based on 3D Eye Localization Yuta Itoh and Gudrun Klinker TU München Information 2/23 This work is a part of EDUSAFE project

More information

Trajectory-based Deformation Correction in Ultrasound Images

Trajectory-based Deformation Correction in Ultrasound Images Trajectory-based Deformation Correction in Ultrasound Images The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation As Published

More information

CAMERA CONSTANT IN THE CASE OF TWO MEDIA PHOTOGRAMMETRY

CAMERA CONSTANT IN THE CASE OF TWO MEDIA PHOTOGRAMMETRY CAMERA CONSTANT IN THE CASE OF TWO MEDIA PHOTOGRAMMETRY Panagiotis Agrafiotis and Andreas Georgopoulos Laboratory Of Photogrammetry, School of Rural and Surveying Engineering National Technical University

More information

Miniature faking. In close-up photo, the depth of field is limited.

Miniature faking. In close-up photo, the depth of field is limited. Miniature faking In close-up photo, the depth of field is limited. http://en.wikipedia.org/wiki/file:jodhpur_tilt_shift.jpg Miniature faking Miniature faking http://en.wikipedia.org/wiki/file:oregon_state_beavers_tilt-shift_miniature_greg_keene.jpg

More information

Model-based Visual Tracking:

Model-based Visual Tracking: Technische Universität München Model-based Visual Tracking: the OpenTL framework Giorgio Panin Technische Universität München Institut für Informatik Lehrstuhl für Echtzeitsysteme und Robotik (Prof. Alois

More information

New Sony DepthSense TM ToF Technology

New Sony DepthSense TM ToF Technology ADVANCED MATERIAL HANDLING WITH New Sony DepthSense TM ToF Technology Jenson Chang Product Marketing November 7, 2018 1 3D SENSING APPLICATIONS Pick and Place Drones Collision Detection People Counting

More information