Diamond Software. Modeling of content-based image retrieval tools for dermatopathology applications

Transcription

1 Diamond Software Modeling of content-based image retrieval tools for dermatopathology applications

2 The Team Drazen M. Jukic, UPMC Simon King, Carnegie Mellon University Casey Helfrich, Anu Melville Adil Wali Rahul Sukthankar Mahadev Satyanayaranan

3 What is WSI (whole slide imaging)? Relatively novel technology (depends on whom you ask). Virtual Slide Utilizes robotic scanning of glass microscopic slide (GMS). Creates an image of the entire GMS. Slides can be handled either manually (one by one) or automatically (autoloader).

4

5 Why Virtual Slides? Drazen (Dr. Jukic) is working in informatics, he will make all our work and diagnostics go to India actual quote I have heard similar statements multiple times Answer is simple NO!

6 Now you have a Virtual Slide! One has all of these images how is this better than old-fashioned kodachromes? How do you find images in a jumble on your hard drive? Oooh where is Quincy when you need him?

7 Now you have a Virtual Slide! How do you Google an image? There s no how if images are not annotated. Diamond helps here.

8 Open Diamond Jointly developed by Carnegie Mellon University and Intel Research Labs. In Dermatopathology - Allows for efficient, rapid feature-specific searching of large image set helping to create knowledge out of image features "locked away" in digital imaging archives. Diamond's storage architecture is equipped for "early discard."

9 Early Discard

10 Discard? How many of you read beyond page 2 or 3 of Google results? Goal is to develop an application that will: Enable non-experts to be more effective in diagnosing particular disease. Enable the creation of novel, more efficient diagnostic procedures incorporating vision technology. Two arms Radiology and Pathology.

11 PathFind Demo

12 PathFind Demo

13 Application Design How do you get an ideal application? Interview numerous pathologists. Enlist participants who are informatics savvy and hostile. Who (what) is a Pathologist? Somebody pushing little pieces of glass, incredibly fast, across a black square while observing color variations. The faster your hand and eyes, the better your TAT. Speed is based on the motoric and ocular skill of the individual, as well as ability to maintain concentration. Somebody who wants to be left alone.

14 PathFind - VIEW View Search Compare Diagnose Currently Slow, non-intuitive interfaces taking 5-10 x longer than a microscope. With PathFind Slide rotation to simulate true slide driving. Why is it better? PathFind interaction is closer to native microscope interaction. Lowers learning curve, increasing user adoption. Increases interaction speed, enhancing efficiency.

15 PathFind - SEARCH Currently Trial and error searching through atlases, textbooks, and journals. With OnPath???????? View Search Compare Diagnose Highlight area of image and click search. Why is it better? Digital workflow. Faster results. Larger data set. Multiple similar items for better decision making.

16 PathFind - COMPARE View Search Compare Diagnose Currently Compare static journal or atlas image to the screen via memory. With PathFind Side-by-side virtual slide and synced manipulation with lockin feature. Why is it better? Side-by-side view enables more direct comparison. Image manipulation for more detailed comparison. Direct access to referring experts/pathologists.

17 PathFind - DIAGNOSE View Search Compare Diagnose Currently Diagnosis is made based on features of the image. With PathFind Diagnosis substantiated with references to similar cases. Why is it better? Decision making process is recorded. Higher accuracy because of explicit comparison to all case information. Stronger legal defense, decreasing malpractice costs.

18 View

19

20

21 Search

22

23

24

25

26 Compare

27

28

29

30

31

32 Diagnose

33

34

35 Why Diamond?

36 Virtual Slide Segue Virtual slides promise to deliver a new level of care in digital pathology. Important to outline that today, an application is defined by ease of use and speed of acceptance. If we do not deliver an improvement over the microscope, the technology will not be adopted.

37 Parting Thoughts Digital Pathology has to deliver improvements over the current glass-based pathology; What is a pathologist? Somebody who pushes little pieces of glass incredibly fast across a black square while looking at the color variations; Faster you hand and eyes are, better TAT you have; The speed is based on the motoric and ocular skill of the individual, as well as ability to maintain focused concentration. Somebody who mostly wants to be left alone.

38 Parting Thoughts Our current studies: Revealed that speed of digital glass pushing is very important; Network speed extremely important; Microscopes vs. Robots If additional features are not incorporated, VS has long wait to be implemented; I would invite additional features for incorporation