Working with Large Sets of Images in MATLAB Just Got Easier Avi Nehemiah

Size: px

Start display at page:

Download "Working with Large Sets of Images in MATLAB Just Got Easier Avi Nehemiah"

Clementine Davis
6 years ago
Views:

1 Working with Large Sets of Images in MATLAB Just Got Easier Avi Nehemiah 2015 The MathWorks, Inc. 1

2 Challenges Posed by Large Sets of Images 1. How do I import several thousand images into MATLAB? 2. Can I find patterns or models to represent my image data? 3. How do I test and visualize my algorithm on many images? 4. What if my desktop or laptop doesn t have enough computing power? 5. What if my data is too big to fit into memory? Goal: Show you new functionality in MATLAB to augment existing workflows to solve these challenges 3

3 Problem : How to Recognize/Categorize Cars? Lightning Mater Nigel SpareO 4

4 Challenges Posed by Large Sets of Images 1. How do I import several thousand images into MATLAB? imageset 2. Can I find patterns or models to represent my image data? 3. How do I test and visualize my algorithm on many images? 4. What if my desktop or laptop doesn t have enough computing power? 5. What if my data is too big to fit into memory? 5

5 Challenges Posed by Large Sets of Images 1. How do I import several thousand images into MATLAB? imageset 2. Can I find patterns or models to represent my image data? 3. How do I test and visualize my algorithm on many images? 4. What if my desktop or laptop doesn t have enough computing power? 5. What if my data is too big to fit into memory? 6

Machine Learning A machine learning algorithm takes examples

Learning boats mugs hats If brightness > 0.

6 Machine Learning A machine learning algorithm takes examples of inputs and outputs associated with a task and produces a program that can perform the task. Hand Written Program boats mugs hats Computer Vision Machine Learning boats mugs hats If brightness > 0.5 then hat If edge_density < 4 and major_axis > 5 then boat model = fitcsvm (image_features, label) 7

7 Machine Learning Workflow Using Images Training Data Feature Extraction Learning or Modelling Classifier / Model Lightning Input Image Feature Extraction Classification 8

8 Machine Learning Workflow Using Images Training Data Feature Extraction Learning or Modelling imageset bagoffeatures classificationlearner bagoffeatures Classifier / Model Lightning Input Image Feature Extraction Classification 9

9 Challenges Posed by Large Sets of Images 1. How do I import several thousand images into MATLAB? imageset to manage large collections of images 2. Can I find patterns or models to represent my image data? Computer Vision System Toolbox, Statistics and Machine Learning Toolbox 3. How do I test and visualize my algorithm on many images? 4. What if my desktop or laptop doesn t have enough computing power? 5. What if my data is too big to fit into memory? 10

10 Other Applications of Same Workflow Detection and Location yes no Anomaly Detection/ Verification pass fail 11

11 Challenges Posed by Large Sets of Images 1. How do I import several thousand images into MATLAB? imageset to manage large collections of images 2. Can I find patterns or models to represent my image data? Computer Vision System Toolbox, Statistics and Machine Learning Toolbox 3. How do I test and visualize my algorithm on many images? 4. What if my desktop or laptop doesn t have enough computing power? 5. What if my data is too big to fit into memory? 12

12 Challenges Posed by Large Sets of Images 1. How do I import several thousand images into MATLAB? imageset to manage large collections of images 2. Can I find patterns or models to represent my image data? Computer Vision System Toolbox, Statistics and Machine Learning Toolbox 3. How do I test and visualize my algorithm on many images? Image Batch Processor App 4. What if my desktop or laptop doesn t have enough computing power? 5. Can I acquire large sets of images using MATLAB? 13

13 Challenges Posed by Large Sets of Images 1. How do I import several thousand images into MATLAB? imageset to manage large collections of images 2. Can I find patterns or models to represent my image data? Computer Vision System Toolbox, Statistics and Machine Learning Toolbox 3. How do I test and visualize my algorithm on many images? Image Batch Processor App 4. What if my desktop or laptop doesn t have enough computing power? 5. What if my data is too big to fit into memory? 14

14 Parallel Computing with MATLAB MATLAB Distributed Computing Server MATLAB Parallel Computing Toolbox 15

15 16

16 Challenges Posed by Large Sets of Images 1. How do I import several thousand images into MATLAB? imageset to manage large collections of images 2. Can I find patterns or models to represent my image data? Computer Vision System Toolbox, Statistics and Machine Learning Toolbox 3. How do I test and visualize my algorithm on many images? Image Batch Processor App 4. What if my desktop or laptop doesn t have enough computing power? Parallel Computing Toolbox, MATLAB Distributed Computing Server 5. What if my data is too big to fit into memory? 17

17 Challenges Posed by Large Sets of Images 1. How do I import several thousand images into MATLAB? imageset to manage large collections of images 2. Can I find patterns or models to represent my image data? Computer Vision System Toolbox, Statistics and Machine Learning Toolbox 3. How do I test and visualize my algorithm on many images? Image Batch Processor App 4. What if my desktop or laptop doesn t have enough computing power? Parallel Computing Toolbox, MATLAB Distributed Computing Server 5. What if my data is too big to fit into memory? 18

Big Data Stored on Hadoop Easily migrate programs from workstation to Hadoop On Your Workstation Access, explore, and analyze out-of-memory data Prototype MapReduce based algorithms Access portions

18 Big Data Stored on Hadoop Easily migrate programs from workstation to Hadoop On Your Workstation Access, explore, and analyze out-of-memory data Prototype MapReduce based algorithms Access portions of data sets on HDFS Connected to Hadoop Run algorithms on Hadoop against data in HDFS MATLAB Distributed Computing Server Production Hadoop Create applications or components that execute on Hadoop MATLAB Compiler 19

19 Scaled Analysis Prototype Access Explore Share/Deploy Scale Load, Analyze, Discard datastore, parfor MapReduce Distributed Memory SPMD out-of-memory in-memory Embarrassingly Parallel Complexity Non-Partitionable 20

20 Challenges Posed by Large Sets of Images 1. How do I import several thousand images into MATLAB? imageset to manage large collections of images 2. Can I find patterns or models to represent my image data? Computer Vision System Toolbox, Statistics and Machine Learning Toolbox 3. How do I test and visualize my algorithm on many images? Image Batch Processor App 4. What if my desktop or laptop doesn t have enough computing power? Parallel Computing Toolbox, MATLAB Distributed Computing Server 5. What if my data is too big to fit into memory? MapReduce, distributed arrays, SPMD, Hadoop 21

21 Thank You! 22

Medical Image Processing using MATLAB

Medical Image Processing using MATLAB Brett Shoelson, PhD Bill Wass Adam Rogers Principal Application Engineer Senior Account Manager 2015 The MathWorks, Inc. 1 Session Agenda: Medical Image Processing