Spring semester 2008 June 24 th 2009

Size: px

Start display at page:

Download "Spring semester 2008 June 24 th 2009"

Roy Parks
5 years ago
Views:

1 Spring semester 2008 June 24 th 2009

2 Introduction Suggested Algorithm Outline Implementation Summary Live Demo 2

3 Project Motivation and Domain High quality pedestrian detection and tracking system. Fixed camera, outdoor scenes. Non deterministic environment. Aid in surveillance and security tasks. 3

4 The Challenge Complex scenarios sets several difficulties : Other issues: Illumination changes. Moving elements. 4

5 Project Objectives Establish a detection and tracking system. Moving pedestrians only. Robust Lightning changes. Moving scene elements (waving trees etc.) More Real Time operation. Existing solutions: High computational complexity. Robustness is still an issue. Embedded implementation. 5

6 Proposed Solution Input A novel background modeling algorithm Background Modeling and Subtraction Foreground Frame Motion Segmentation Target Tracking Output 6

7 Simple Background Model Moving Average (Alpha Filter) Frame Averaging over time. Fast adaption 7

8 Simple Background Model Moving Average (Alpha Filter) Frame Averaging over time. Fast adaption Slower adaptation 8

9 Simple Background Model Moving Average (Alpha Filter) Frame Averaging over time. Fast adaption Slower adaptation Intermediate values also problematic. 9

10 Suggested Algorithm 10

11 Step 1 Background Modeling Diff = (Input Frame) (Background Frame) Temporal Variance: Constantly attempts to reach diff. If (Diff > Variance) Variance = Variance + Const If (Diff < Variance) Variance = Variance Const Background Value: Local frame averaging over time. Adaptation only when Variance > Diff 11

12 Step 1 Background Modeling Pixel assigned with temporal Variance Variance Diff time Background Not Changed BG Pixel Diff = Input Background Variance Diff time Background Adaptation Begins BG = α BG 1 + (1 α) INPUT n n n BG Pixel 12

13 Step 2 Background Subtraction Foreground Frame = (Input Frame) (Background Frame) Noisy regions reduces detection rate. Noisy regions characterized by high variance. High variance pixels are eliminated. 13

14 Background Modeling Motivation 14

15 Step 2 Background Subtraction Foreground Frame = (Input Frame) (Background Frame) Noisy regions reduces detection rate. Noisy regions characterized by high variance. High variance pixels are eliminated. 15

16 Background Modeling Motivation 16

17 Digital Signal Processor A DSP is a microprocessor: Non expensive. Small sized. Low power consumption. Widely Used in : Audio and Video Communications Security systems 17

18 Embedded Implementation Embedded development is complicated: Small on chip, fast memory. Fixed Point arithmetic. Complex specific development environment. 18

19 Embedded Implementation Very challenging 19

20 Performance Tuning Algorithm Time Consumption Mapping Enhancements System works in real time 20

21 Performance Comparison Two DSP platforms from Texas Instruments: DM642 very common. C6455 new, much more powerful. System implemented on both platforms. DM642 DSP C6455 DSP 21

22 Pedestrian Tracking System Camera Host PC program User Interface: allows the user to choose and view different algorithm stages. DM642 EVM Display 22

23 Graphical User Interface 23

24 Conclusions Novel background modeling Real time. Robust. Embedded oriented. 24

25 25 Conclusions Prototype system development: Efficient and accurate. Real time on DM642 and on C6455. Works 24/7 in SIPL. Infrastructure for future developments.

Automatic Tracking of Moving Objects in Video for Surveillance Applications

Automatic Tracking of Moving Objects in Video for Surveillance Applications Manjunath Narayana Committee: Dr. Donna Haverkamp (Chair) Dr. Arvin Agah Dr. James Miller Department of Electrical Engineering