MATLAB Based Interactive Music Player using XBOX Kinect
|
|
- Francine Mosley
- 6 years ago
- Views:
Transcription
1 1 MATLAB Based Interactive Music Player using XBOX Kinect EN Final Project MATLAB Based Interactive Music Player using XBOX Kinect Gowtham G. Piyush R. Ashish K. (ggarime1, proutra1, Johns Hopkins University, Baltimore, USA 1. Abstract The launch of XBOX Kinect opened exciting new avenues for 3D perception due to its easy to use, out-of-the-box depth and color video. Applications spectra seem to be widening over a series of software and hardware. We have all come across Music Players in our day to day life. Various methods of accessing these music interfaces exist but again, easier methods to access the same are always desirable. In this project, we create a gesture based 3D user interface for playing audio from a MATLAB based graphic user interface. Multiple object based background is assumed as the environment and hand detection over them activates processing of data. On detecting a gesture over a particular area in the foreground, corresponding functionality in the GUI is activated. As per the gesture of the user, for which the system was already trained, the music player responds promptly. The setup was tested over a set of saved images as well as in real-time from a Kinect Sensor images. The results varied over different operating systems as discussed later, but were satisfying and as desired. 2. Aims of the Project The aims we could see before the start of the project were: 2.1 Choice of environment for camera view. We assumed the camera view to be top down so as to emphasize on capabilities of Kinect sensor over other general cameras that provide us with only 2D image of the objects. However, Kinect has its own limitations and doesn t give desired images within a very close range of its view. To be properly detected, an object has to be present at least 0.5metres away from the camera sensors [1]. 2.2 Identification of marker objects in real world. It was thought to be preferable to have some objects which correspond to buttons in the music player. Having predefined marker objects makes it easier for users other than the programmer to access the music player. Detection of these objects while start of the setup is desirable. 2.3 Background subtraction and filtering of noise. One of the aims of the project is to be able to identify dynamic objects and remove background or static objects. This would allow us to reduce the clutter in the image and focus on the objects of interest such as hand gestures which are dynamic. 2.4 Gesture recognition. Detecting and differentiating between gestures would reduce the need for more marker objects. Also it would be further efficient use of the Kinect sensor. 2.5 Music Player development. We feel a music player which is not as complex as the commercially available ones should be better for testing purpose of our project as it is more inclined towards the computer vision part. However, we desired to develop a music player
2 2 MATLAB Based Interactive Music Player using XBOX Kinect EN Final Project graphic user interface which is comprehensive enough to have primary functionalities of Play, Pause, Stop, Volume control and Scroll track. 3. Approaches to tackle the problems 3.1 Choice of environment From prior research work on operation of Kinect[1][7] and experience of working on Kinect [10] we could find that Kinect sensor does not give desired images for objects placed within 0.5m of it. So we decided to have an operation space of at least 1.5 meters, so as to facilitate free moving of the operator s palm. As discussed earlier, top-down view of Kinect is assumed i.e. Kinect is placed in such a manner that it views a floor or table-top vertically below it. Even though it should not affect the functionality or our code, it is preferred to have a clear background free from stray items except the marker objects. Figure 1. A screen shot of image when hand goes out of bound of Kinect Sensor 3.2 Identification of marker objects Marker objects are portions in the image view which demarcate the various functionalities. Specific objects are associated with separate buttons on the GUI. These marker objects can be pre-placed in the background or may be dynamically introduced into the image frame. First we decided placing marker objects (symbols) in a predefined order and detecting the edges while pre-processing [3]. Then we could use regionprops command in Matlab to find the centroids of the marker objects. However, this wasn t able to achieve scale and rotation invariance while object detection. Another possible major disadvantage of this method would have been doing away with the dynamic detection of the marker objects. Hence we decided to check for SIFT features [2] and match the objects to previously stored images of the object(s). To get more key-points, we designed the markers with roman alphabets in Algerian font. The SIFT matching technique is rotation and scale invariant.
3 3 MATLAB Based Interactive Music Player using XBOX Kinect EN Final Project Hence there weren t many outliers when matching. In almost all cases, we found the program showing us correct corresponding matches. After detection of the markers, template boundaries were calculated so as to demarcate functionalities of the objects.
4 4 MATLAB Based Interactive Music Player using XBOX Kinect EN Final Project Figure 2,3,4,5 show SIFT feature matching of Marker Objects with corresponding images and plotting of respective bounding boxes is shown in Fig Background subtraction and filtering of noise To detect hand in the images we initially processed the color images. For the first trial, we assumed a background image and updated it by taking mean of its previous five frames[3]. Then we subtracted it from the current frame which would give us the position of the hand. While this worked properly when the hand was entering the template frames, considerable delay was present when the hand was to pull out of the frame. Also, changing lighting conditions would affect this method drastically. The Kinect updates its white balance after certain time interval and this also affects the background data. However, the depth image is generally free of the background light changes. Hence it was desirable to use depth image for processing of data. Depth images were found to have considerably less amount of noise. The processing of the depth image was done by differentiating between current frame and a reference frame which was chosen when no hand was over the marker object templates. The noise in the resultant image was reduced further by Gaussian filtering and opening function on the image. The opening function reduces the salt and pepper noise in the image to a great extent. An amusing error was noticed when the noise was present due to reflection of IR rays of
5 5 MATLAB Based Interactive Music Player using XBOX Kinect EN Final Project kinect sensor by the ring worn by one of the users. Also, shadows of hand in the color image affected the results. Such errors were reduced to some extent by the imopen function. 3.4 Gesture Recognition - To accomplish one of the objectives namely, Gesture Recognition there are number of methods reported in the literature. Template matching using expectation maximization [5] Mean-shift or simple connected components Machine learning Machine learning allows for easier gesture recognition and provides a robust classifier at low computational cost. This is particularly useful for real time systems. This project uses a simple logistic regression classifier to recognize the gestures. The classifier currently recognizes three types of gestures as shown below: NO HAND; HAND TYPE 1; HAND TYPE2. These gestures are used in controlling the music player in various interesting ways. The classifier takes in a filtered and cropped region of interest image (ROI) after background subtraction. The image is resized to reduce the number of features used for training. This will avoid the possibility of overfitting the training data. The resized image is rolled into a 1 X 1600 feature vector. Each element of the vector is a pixel of the image Dataset The total dataset of training and test hand images consisted of 573 labeled images which are divided into 473 training and 100 test images randomly. The training set for the classifier consists of labeled images consisting of rotations of hand and scaling of each of the gesture. The classifier after training provides parameter matrix which is a 3x1600 matrix. When applied on an image, this provides the probabilities scaled to the range (-1, 1) of the template belonging to one of the above Hand types described above. The test set is used to verify the generalization of the above parameters. As the features are a lot more than the dataset, the classifier tends to over-fit the current data. But this is tolerable since the results from test data show an acceptable accuracy of 85 %. Fig 7. First row shows some data for training of hand type 0. Second and third rows show some data for training of hand type 1 and final row shows hand type 2.
6 6 MATLAB Based Interactive Music Player using XBOX Kinect EN Final Project Figure 8. Random Test data for which 96% accuracy was noticed in Matlab. The classifier although robust to the noise in the corresponding region of interest (ROI), is sensitive to the size of ROI. The linear classifier does not perform well if the region of interest is picked somewhat different from the true region. Apart from region of interest, the classifier does not have the capability to work 3.5 One of the challenges that we faced during the course of this project was to design a simple yet comprehensive music player in MATLAB. We achieved this using GUI EDITOR of MATLAB Music Player Layout We designed a simple MATLAB player having the below mentioned basic features: Listbox: containing a list of songs. The songs are uploaded from a pre-determined folder in the system. Text Box: This contains the name of the current song which is playing. This box will clear out if we stop a song. Slider: To govern the volume of the player. The maximum and minimum values of the slider are 1 and 0 respectively. 5 pushbuttons: Each of these buttons corresponds to Play, Pause, Stop, Next and Previous buttons on the GUI. Play: To start playing a song. Pause: To stop a song, however if we press play after pausing a song it resumes from the place where it had been stopped initially. Stop: Same as pause, however if we press play after stopping a song it will again start from the beginning. Next: It will highlight the next song, but the song will not start playing until we press the Play button. If the end of the playlist has been reached, nothing will happen.
7 7 MATLAB Based Interactive Music Player using XBOX Kinect EN Final Project Previous: It will highlight the previous song, but as in Next the song will not start playing until the Play button is pressed. If the song, which is highlighted, is the first song of the playlist nothing will happen. Figure 9. Matlab based music player GUI developed by us. 4. Integration of modules. After achieving desired results, modules were integrated to achieve the final aim of the project. The interactive music player is governed by the hand movements/gestures, depending on where the hand is in the Kinect image in the current frame. The Kinect continuously captures images of the marker objects and where the hand is relative to each of these objects. In the main program the function that governs this music player is procctrl.m. This function takes in 3 arguments viz. ctrl, vol and H explained in detail below. CTRL: This is a 1x5 vector which can have the following values: [ ] If hand type 1 is on the Play marker object in the Kinect image then the function ctrlgen.m gives the value of the CTRL vector and using the Play functionality of the Music Player is invoked.
8 8 MATLAB Based Interactive Music Player using XBOX Kinect EN Final Project [ ] If hand type 2 is on the Play marker object in the Kinect image then the function ctrlgen.m gives this value of the CTRL vector and using the Pause functionality of the Music Player is invoked. [ ] If any known hand type is on the Stop marker object in the Kinect image then the function ctrlgen.m gives this value of the CTRL vector and this is used to invoke the Stop functionality of the Music Player. [ ] If any known hand type is on the Volume marker object in the Kinect image then the function ctrlgen.m gives this value of the CTRL vector and this is used to invoke the Volume functionality of the Music Player. Whenever the volume functionality is invoked then the argument vol is also passed which gives the current volume value (between 0 and 1) according to which the volume of the Music Player is set. [ ] - If hand type 2 is on the Scroll marker object in the Kinect image then the function ctrlgen.m gives this value of the CTRL vector and this is used to invoke the Previous functionality of the Music Player. [ ] If hand type 1 is on the Scroll marker object in the Kinect image then the function ctrlgen.m gives this value of the CTRL vector and this is used to invoke the Next functionality of the Music Player. VOL: The current value ( between 0 and 1 ) to which the volume of the Music Player is to be set depending on the depth value of where the hand is on Volume marker object. H: This is the handle of the GUI and is used internally in the program. Figure 10 showing final integration of the project
9 9 MATLAB Based Interactive Music Player using XBOX Kinect EN Final Project Conclusion Through this project, we have implemented an interactive music player which is controlled by hand gestures in the depth images taken from XBOX Kinect. Usage of machine learning algorithm made it possible for detecting hand and gestures even in presence of noise and is invariant to rotation and scale. The code was run on a set of image data taken from XBOX Kinect. The video showing execution of the same can be found on It shows the various functionalities of the music player. This project can be further improved upon by replacing logistic regression algorithm with better and more efficient algorithms so that more gestures can be perfectly detected. Dynamic background implementation can also be introduced in due course of time.
10 10 MATLAB Based Interactive Music Player using XBOX Kinect EN Final Project References [1] M. T. Draelos, "The Kinect Up Close: Modifications for Short-Range Depth Imaging," North Carolina State University, Raleigh, North Carolina, [2]D. G. Lowe, Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision, 2004 [3] Y Ivanov, A Bobick,J Liu, Fast Lighting Independent Background Subtraction, MIT Media Lab., 1999 [4] J. Canny, "A computational approach to edge detection," IEEE Transactions on Pattern Analysis Machine Intelligence, p , [5] Galatsanos, N.P., Wernick, M.N., Impulse restoration-based template-matching using the expectation-maximization algorithm Image Processing, Proceedings., International Conference, 1997 [6] [7] [8] [9] [10] P Routray, G Bhutra, S Rath, S Mohanty "Depth Image Processing and Operator Imitation Using a Custom Made Semi Humanoid.," IOSR Journals, vol. 1, no. 1, pp , 2012.
CS231A Course Project Final Report Sign Language Recognition with Unsupervised Feature Learning
CS231A Course Project Final Report Sign Language Recognition with Unsupervised Feature Learning Justin Chen Stanford University justinkchen@stanford.edu Abstract This paper focuses on experimenting with
More informationEE368 Project Report CD Cover Recognition Using Modified SIFT Algorithm
EE368 Project Report CD Cover Recognition Using Modified SIFT Algorithm Group 1: Mina A. Makar Stanford University mamakar@stanford.edu Abstract In this report, we investigate the application of the Scale-Invariant
More informationThe Kinect Sensor. Luís Carriço FCUL 2014/15
Advanced Interaction Techniques The Kinect Sensor Luís Carriço FCUL 2014/15 Sources: MS Kinect for Xbox 360 John C. Tang. Using Kinect to explore NUI, Ms Research, From Stanford CS247 Shotton et al. Real-Time
More informationMOVING OBJECT DETECTION USING BACKGROUND SUBTRACTION ALGORITHM USING SIMULINK
MOVING OBJECT DETECTION USING BACKGROUND SUBTRACTION ALGORITHM USING SIMULINK Mahamuni P. D 1, R. P. Patil 2, H.S. Thakar 3 1 PG Student, E & TC Department, SKNCOE, Vadgaon Bk, Pune, India 2 Asst. Professor,
More informationUser s Guide. Attainment s. GTN v4.11
Attainment s User s Guide A printable PDF of this user guide is available from the Attainment Company website: https://www.attainmentcompany.com/gotalk-now Contents 1 Getting Started with GoTalk NOW 1
More informationChapter 3 Image Registration. Chapter 3 Image Registration
Chapter 3 Image Registration Distributed Algorithms for Introduction (1) Definition: Image Registration Input: 2 images of the same scene but taken from different perspectives Goal: Identify transformation
More information3D Reconstruction of a Hopkins Landmark
3D Reconstruction of a Hopkins Landmark Ayushi Sinha (461), Hau Sze (461), Diane Duros (361) Abstract - This paper outlines a method for 3D reconstruction from two images. Our procedure is based on known
More informationHCR Using K-Means Clustering Algorithm
HCR Using K-Means Clustering Algorithm Meha Mathur 1, Anil Saroliya 2 Amity School of Engineering & Technology Amity University Rajasthan, India Abstract: Hindi is a national language of India, there are
More informationClassification of objects from Video Data (Group 30)
Classification of objects from Video Data (Group 30) Sheallika Singh 12665 Vibhuti Mahajan 12792 Aahitagni Mukherjee 12001 M Arvind 12385 1 Motivation Video surveillance has been employed for a long time
More informationA Two-stage Scheme for Dynamic Hand Gesture Recognition
A Two-stage Scheme for Dynamic Hand Gesture Recognition James P. Mammen, Subhasis Chaudhuri and Tushar Agrawal (james,sc,tush)@ee.iitb.ac.in Department of Electrical Engg. Indian Institute of Technology,
More informationA method for depth-based hand tracing
A method for depth-based hand tracing Khoa Ha University of Maryland, College Park khoaha@umd.edu Abstract An algorithm for natural human-computer interaction via in-air drawing is detailed. We discuss
More informationReal Time Motion Detection Using Background Subtraction Method and Frame Difference
Real Time Motion Detection Using Background Subtraction Method and Frame Difference Lavanya M P PG Scholar, Department of ECE, Channabasaveshwara Institute of Technology, Gubbi, Tumkur Abstract: In today
More informationImage Processing Pipeline for Facial Expression Recognition under Variable Lighting
Image Processing Pipeline for Facial Expression Recognition under Variable Lighting Ralph Ma, Amr Mohamed ralphma@stanford.edu, amr1@stanford.edu Abstract Much research has been done in the field of automated
More informationOBJECT SORTING IN MANUFACTURING INDUSTRIES USING IMAGE PROCESSING
OBJECT SORTING IN MANUFACTURING INDUSTRIES USING IMAGE PROCESSING Manoj Sabnis 1, Vinita Thakur 2, Rujuta Thorat 2, Gayatri Yeole 2, Chirag Tank 2 1 Assistant Professor, 2 Student, Department of Information
More informationCS 4758: Automated Semantic Mapping of Environment
CS 4758: Automated Semantic Mapping of Environment Dongsu Lee, ECE, M.Eng., dl624@cornell.edu Aperahama Parangi, CS, 2013, alp75@cornell.edu Abstract The purpose of this project is to program an Erratic
More informationShort Survey on Static Hand Gesture Recognition
Short Survey on Static Hand Gesture Recognition Huu-Hung Huynh University of Science and Technology The University of Danang, Vietnam Duc-Hoang Vo University of Science and Technology The University of
More informationDiscovering Visual Hierarchy through Unsupervised Learning Haider Razvi
Discovering Visual Hierarchy through Unsupervised Learning Haider Razvi hrazvi@stanford.edu 1 Introduction: We present a method for discovering visual hierarchy in a set of images. Automatically grouping
More informationSimple Pattern Recognition via Image Moments
Simple Pattern Recognition via Image Moments Matthew Brown mattfbrown@gmail.com Matthew Godman mgodman@nmt.edu 20 April, 2011 Electrical Engineering Department New Mexico Institute of Mining and Technology
More informationTexture Image Segmentation using FCM
Proceedings of 2012 4th International Conference on Machine Learning and Computing IPCSIT vol. 25 (2012) (2012) IACSIT Press, Singapore Texture Image Segmentation using FCM Kanchan S. Deshmukh + M.G.M
More informationCOSC160: Detection and Classification. Jeremy Bolton, PhD Assistant Teaching Professor
COSC160: Detection and Classification Jeremy Bolton, PhD Assistant Teaching Professor Outline I. Problem I. Strategies II. Features for training III. Using spatial information? IV. Reducing dimensionality
More informationFingertips Tracking based on Gradient Vector
Int. J. Advance Soft Compu. Appl, Vol. 7, No. 3, November 2015 ISSN 2074-8523 Fingertips Tracking based on Gradient Vector Ahmad Yahya Dawod 1, Md Jan Nordin 1, and Junaidi Abdullah 2 1 Pattern Recognition
More informationRotation Invariant Finger Vein Recognition *
Rotation Invariant Finger Vein Recognition * Shaohua Pang, Yilong Yin **, Gongping Yang, and Yanan Li School of Computer Science and Technology, Shandong University, Jinan, China pangshaohua11271987@126.com,
More informationImage Processing. Image Features
Image Processing Image Features Preliminaries 2 What are Image Features? Anything. What they are used for? Some statements about image fragments (patches) recognition Search for similar patches matching
More informationPhotoshop tutorial: Final Product in Photoshop:
Disclaimer: There are many, many ways to approach web design. This tutorial is neither the most cutting-edge nor most efficient. Instead, this tutorial is set-up to show you as many functions in Photoshop
More informationGrasping Known Objects with Aldebaran Nao
CS365 Project Report Grasping Known Objects with Aldebaran Nao By: Ashu Gupta( ashug@iitk.ac.in) Mohd. Dawood( mdawood@iitk.ac.in) Department of Computer Science and Engineering IIT Kanpur Mentor: Prof.
More informationCHAPTER 1 COPYRIGHTED MATERIAL. Finding Your Way in the Inventor Interface
CHAPTER 1 Finding Your Way in the Inventor Interface COPYRIGHTED MATERIAL Understanding Inventor s interface behavior Opening existing files Creating new files Modifying the look and feel of Inventor Managing
More informationSUMMARY: DISTINCTIVE IMAGE FEATURES FROM SCALE- INVARIANT KEYPOINTS
SUMMARY: DISTINCTIVE IMAGE FEATURES FROM SCALE- INVARIANT KEYPOINTS Cognitive Robotics Original: David G. Lowe, 004 Summary: Coen van Leeuwen, s1460919 Abstract: This article presents a method to extract
More informationFace Recognition using Eigenfaces SMAI Course Project
Face Recognition using Eigenfaces SMAI Course Project Satarupa Guha IIIT Hyderabad 201307566 satarupa.guha@research.iiit.ac.in Ayushi Dalmia IIIT Hyderabad 201307565 ayushi.dalmia@research.iiit.ac.in Abstract
More informationFace Recognition using SURF Features and SVM Classifier
International Journal of Electronics Engineering Research. ISSN 0975-6450 Volume 8, Number 1 (016) pp. 1-8 Research India Publications http://www.ripublication.com Face Recognition using SURF Features
More informationLOCAL AND GLOBAL DESCRIPTORS FOR PLACE RECOGNITION IN ROBOTICS
8th International DAAAM Baltic Conference "INDUSTRIAL ENGINEERING - 19-21 April 2012, Tallinn, Estonia LOCAL AND GLOBAL DESCRIPTORS FOR PLACE RECOGNITION IN ROBOTICS Shvarts, D. & Tamre, M. Abstract: The
More informationIndoor Object Recognition of 3D Kinect Dataset with RNNs
Indoor Object Recognition of 3D Kinect Dataset with RNNs Thiraphat Charoensripongsa, Yue Chen, Brian Cheng 1. Introduction Recent work at Stanford in the area of scene understanding has involved using
More informationEpithelial rosette detection in microscopic images
Epithelial rosette detection in microscopic images Kun Liu,3, Sandra Ernst 2,3, Virginie Lecaudey 2,3 and Olaf Ronneberger,3 Department of Computer Science 2 Department of Developmental Biology 3 BIOSS
More informationMORPHOLOGICAL BOUNDARY BASED SHAPE REPRESENTATION SCHEMES ON MOMENT INVARIANTS FOR CLASSIFICATION OF TEXTURES
International Journal of Computer Science and Communication Vol. 3, No. 1, January-June 2012, pp. 125-130 MORPHOLOGICAL BOUNDARY BASED SHAPE REPRESENTATION SCHEMES ON MOMENT INVARIANTS FOR CLASSIFICATION
More informationA Kinect Sensor based Windows Control Interface
, pp.113-124 http://dx.doi.org/10.14257/ijca.2014.7.3.12 A Kinect Sensor based Windows Control Interface Sang-Hyuk Lee 1 and Seung-Hyun Oh 2 Department of Computer Science, Dongguk University, Gyeongju,
More informationHow to Use Audacity to Create MP3s
Hello, everyone, and welcome to this short video on how to use Audacity to create MP3 files for your EWC advice templates. Why create digital audio for students? 1. Title screen. David on PIP. 2. White
More informationProduct information. Hi-Tech Electronics Pte Ltd
Product information Introduction TEMA Motion is the world leading software for advanced motion analysis. Starting with digital image sequences the operator uses TEMA Motion to track objects in images,
More informationURBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES
URBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES An Undergraduate Research Scholars Thesis by RUI LIU Submitted to Honors and Undergraduate Research Texas A&M University in partial fulfillment
More informationHandwritten Hindi Numerals Recognition System
CS365 Project Report Handwritten Hindi Numerals Recognition System Submitted by: Akarshan Sarkar Kritika Singh Project Mentor: Prof. Amitabha Mukerjee 1 Abstract In this project, we consider the problem
More informationAccelerometer Gesture Recognition
Accelerometer Gesture Recognition Michael Xie xie@cs.stanford.edu David Pan napdivad@stanford.edu December 12, 2014 Abstract Our goal is to make gesture-based input for smartphones and smartwatches accurate
More informationIndian Currency Recognition Based on ORB
Indian Currency Recognition Based on ORB Sonali P. Bhagat 1, Sarika B. Patil 2 P.G. Student (Digital Systems), Department of ENTC, Sinhagad College of Engineering, Pune, India 1 Assistant Professor, Department
More informationReduced Image Noise on Shape Recognition Using Singular Value Decomposition for Pick and Place Robotic Systems
Reduced Image Noise on Shape Recognition Using Singular Value Decomposition for Pick and Place Robotic Systems Angelo A. Beltran Jr. 1, Christian Deus T. Cayao 2, Jay-K V. Delicana 3, Benjamin B. Agraan
More informationThe Photo Gallery. Adding a Photo Gallery Page. Adding a Photo Gallery App
Adding a Photo Gallery Page The Photo Gallery Above the Summary tab, in the list of Current Pages, click on the New Page button. Choose Photo Gallery from the Available Page Types. Give the page a name.
More informationHUMAN COMPUTER INTERFACE BASED ON HAND TRACKING
Proceedings of MUSME 2011, the International Symposium on Multibody Systems and Mechatronics Valencia, Spain, 25-28 October 2011 HUMAN COMPUTER INTERFACE BASED ON HAND TRACKING Pedro Achanccaray, Cristian
More informationCSE 252B: Computer Vision II
CSE 252B: Computer Vision II Lecturer: Serge Belongie Scribes: Jeremy Pollock and Neil Alldrin LECTURE 14 Robust Feature Matching 14.1. Introduction Last lecture we learned how to find interest points
More informationExploring Curve Fitting for Fingers in Egocentric Images
Exploring Curve Fitting for Fingers in Egocentric Images Akanksha Saran Robotics Institute, Carnegie Mellon University 16-811: Math Fundamentals for Robotics Final Project Report Email: asaran@andrew.cmu.edu
More informationEquation to LaTeX. Abhinav Rastogi, Sevy Harris. I. Introduction. Segmentation.
Equation to LaTeX Abhinav Rastogi, Sevy Harris {arastogi,sharris5}@stanford.edu I. Introduction Copying equations from a pdf file to a LaTeX document can be time consuming because there is no easy way
More informationPose estimation using a variety of techniques
Pose estimation using a variety of techniques Keegan Go Stanford University keegango@stanford.edu Abstract Vision is an integral part robotic systems a component that is needed for robots to interact robustly
More informationA New Approach For 3D Image Reconstruction From Multiple Images
International Journal of Electronics Engineering Research. ISSN 0975-6450 Volume 9, Number 4 (2017) pp. 569-574 Research India Publications http://www.ripublication.com A New Approach For 3D Image Reconstruction
More informationHuman Arm Simulation Using Kinect
Human Arm Simulation Using Kinect Nikunj Agarwal 1, Priya Bajaj 2, Jayesh Pal 3, Piyush Kushwaha 4 1,2,3,4 Student, Computer Science & Engineering Department, IMS Engineering College, Ghaziabad, Uttar
More informationAn Efficient Iris Recognition Using Correlation Method
, pp. 31-40 An Efficient Iris Recognition Using Correlation Method S.S. Kulkarni 1, G.H. Pandey 2, A.S.Pethkar 3, V.K. Soni 4, &P.Rathod 5 Department of Electronics and Telecommunication Engineering, Thakur
More informationDetecting Fingertip Method and Gesture Usability Research for Smart TV. Won-Jong Yoon and Jun-dong Cho
Detecting Fingertip Method and Gesture Usability Research for Smart TV Won-Jong Yoon and Jun-dong Cho Outline Previous work Scenario Finger detection Block diagram Result image Performance Usability test
More informationDesign for an Image Processing Graphical User Interface
2017 2nd International Conference on Information Technology and Industrial Automation (ICITIA 2017) ISBN: 978-1-60595-469-1 Design for an Image Processing Graphical User Interface Dan Tian and Yue Zheng
More informationTracking facial features using low resolution and low fps cameras under variable light conditions
Tracking facial features using low resolution and low fps cameras under variable light conditions Peter Kubíni * Department of Computer Graphics Comenius University Bratislava / Slovakia Abstract We are
More informationObject Detection in Video Streams
Object Detection in Video Streams Sandhya S Deore* *Assistant Professor Dept. of Computer Engg., SRES COE Kopargaon *sandhya.deore@gmail.com ABSTRACT Object Detection is the most challenging area in video
More informationReal-time Object Detection CS 229 Course Project
Real-time Object Detection CS 229 Course Project Zibo Gong 1, Tianchang He 1, and Ziyi Yang 1 1 Department of Electrical Engineering, Stanford University December 17, 2016 Abstract Objection detection
More informationASSISTIVE CONTEXT-AWARE TOOLKIT (ACAT)
ASSISTIVE CONTEXT-AWARE TOOLKIT (ACAT) GETTING STARTED GUIDE VERSION 1.0.0 TABLE OF CONTENTS 1 GETTING STARTED... 3 1.1 ACAT Dashboard... 4 1.1.1 Dashboard Shortcuts... 5 1.2 Vision Tryout... 7 1.2.1 Vision
More informationBus Detection and recognition for visually impaired people
Bus Detection and recognition for visually impaired people Hangrong Pan, Chucai Yi, and Yingli Tian The City College of New York The Graduate Center The City University of New York MAP4VIP Outline Motivation
More informationCS229 Final Project One Click: Object Removal
CS229 Final Project One Click: Object Removal Ming Jiang Nicolas Meunier December 12, 2008 1 Introduction In this project, our goal is to come up with an algorithm that can automatically detect the contour
More informationObject Detection in a Fixed Frame
Object Detection in a Fixed Frame Debjyoti Bagchi 1, Dipaneeta Roy Chowdhury 2 and Satarupa Das 2 1 Assistant Professor, Calcutta Institute Of Engineering And Management Kolkata, India, 2 Calcutta Institute
More informationApplication of Radon Transform for Scaling and Rotation estimation of a digital image
International Journal of Engineering Research and Development eissn : 2278-067X, pissn : 2278-800X, www.ijerd.com Volume 2, Issue 3 (July 2012), PP. 35-39 Application of Radon Transform for Scaling and
More informationInternational Journal of Engineering Trends and Applications (IJETA) Volume 4 Issue 6, Nov-Dec 2017
RESEARCH ARTICLE OPEN ACCESS Robot Navigation Using MATLAB S Bounding Box Algorithm Vishal Thakur [1], Vaibhav Khedkar [2], Ajay Patkar [3], Akshay Chidrawar [4] Department of Electronics Engineering Vivekanand
More informationESOTERIC Sound Stream. User s Manual
ESOTERIC Sound Stream User s Manual Layout Now Playing This is the main screen of the ESOTERIC Sound Stream app. Now Playing: Use to show the current file and control its playback. Playlist: This shows
More informationFace Tracking : An implementation of the Kanade-Lucas-Tomasi Tracking algorithm
Face Tracking : An implementation of the Kanade-Lucas-Tomasi Tracking algorithm Dirk W. Wagener, Ben Herbst Department of Applied Mathematics, University of Stellenbosch, Private Bag X1, Matieland 762,
More informationAn actor-critic reinforcement learning controller for a 2-DOF ball-balancer
An actor-critic reinforcement learning controller for a 2-DOF ball-balancer Andreas Stückl Michael Meyer Sebastian Schelle Projektpraktikum: Computational Neuro Engineering 2 Empty side for praktikums
More informationWindows Me Navigating
LAB PROCEDURE 11 Windows Me Navigating OBJECTIVES 1. Explore the Start menu. 2. Start an application. 3. Multi-task between applications. 4. Moving folders and files around. 5. Use Control Panel settings.
More informationFLIR Tools+ and Report Studio
Creating and Processing Word Templates http://www.infraredtraining.com 09-20-2017 2017, Infrared Training Center. 1 FLIR Report Studio Overview Report Studio is a Microsoft Word Reporting module that is
More informationHuman Motion Detection and Tracking for Video Surveillance
Human Motion Detection and Tracking for Video Surveillance Prithviraj Banerjee and Somnath Sengupta Department of Electronics and Electrical Communication Engineering Indian Institute of Technology, Kharagpur,
More informationAnalysis of Image and Video Using Color, Texture and Shape Features for Object Identification
IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 16, Issue 6, Ver. VI (Nov Dec. 2014), PP 29-33 Analysis of Image and Video Using Color, Texture and Shape Features
More informationMotion illusion, rotating snakes
Motion illusion, rotating snakes Local features: main components 1) Detection: Find a set of distinctive key points. 2) Description: Extract feature descriptor around each interest point as vector. x 1
More informationSection 8. 8 Format Editor
Section 8 8 Format Editor The Format Editor allows the creation and editing of the log presentation or format files. The output of the format editor are files of the type *.prs which are subsequently used
More informationFace Recognition Using Long Haar-like Filters
Face Recognition Using Long Haar-like Filters Y. Higashijima 1, S. Takano 1, and K. Niijima 1 1 Department of Informatics, Kyushu University, Japan. Email: {y-higasi, takano, niijima}@i.kyushu-u.ac.jp
More informationCSC 2515 Introduction to Machine Learning Assignment 2
CSC 2515 Introduction to Machine Learning Assignment 2 Zhongtian Qiu(1002274530) Problem 1 See attached scan files for question 1. 2. Neural Network 2.1 Examine the statistics and plots of training error
More informationCelebrity Identification and Recognition in Videos. An application of semi-supervised learning and multiclass classification
Celebrity Identification and Recognition in Videos An application of semi-supervised learning and multiclass classification Contents Celebrity Identification and Recognition in Videos... 1 Aim... 3 Motivation...
More informationFPGA IMPLEMENTATION FOR REAL TIME SOBEL EDGE DETECTOR BLOCK USING 3-LINE BUFFERS
FPGA IMPLEMENTATION FOR REAL TIME SOBEL EDGE DETECTOR BLOCK USING 3-LINE BUFFERS 1 RONNIE O. SERFA JUAN, 2 CHAN SU PARK, 3 HI SEOK KIM, 4 HYEONG WOO CHA 1,2,3,4 CheongJu University E-maul: 1 engr_serfs@yahoo.com,
More informationEnhanced Iris Recognition System an Integrated Approach to Person Identification
Enhanced Iris Recognition an Integrated Approach to Person Identification Gaganpreet Kaur Research Scholar, GNDEC, Ludhiana. Akshay Girdhar Associate Professor, GNDEC. Ludhiana. Manvjeet Kaur Lecturer,
More informationRobust PDF Table Locator
Robust PDF Table Locator December 17, 2016 1 Introduction Data scientists rely on an abundance of tabular data stored in easy-to-machine-read formats like.csv files. Unfortunately, most government records
More informationReview of feature selection techniques in bioinformatics by Yvan Saeys, Iñaki Inza and Pedro Larrañaga.
Americo Pereira, Jan Otto Review of feature selection techniques in bioinformatics by Yvan Saeys, Iñaki Inza and Pedro Larrañaga. ABSTRACT In this paper we want to explain what feature selection is and
More informationInfrared Vein Detection System For Person Identification
Infrared Vein Detection System For Person Identification Manjiree S. Waikar 1, Dr. S. R. Gengaje 2 1 Electronics Department, WIT, Solapur 2 H. O. D. Electronics Department, WIT, Solapur Abstract Use of
More informationA Keypoint Descriptor Inspired by Retinal Computation
A Keypoint Descriptor Inspired by Retinal Computation Bongsoo Suh, Sungjoon Choi, Han Lee Stanford University {bssuh,sungjoonchoi,hanlee}@stanford.edu Abstract. The main goal of our project is to implement
More informationLIBYAN VEHICLE PLATE RECOGNITION USING REGIONBASED FEATURES AND PROBABILISTIC NEURAL NETWORK
LIBYAN VEHICLE PLATE RECOGNITION USING REGIONBASED FEATURES AND PROBABILISTIC NEURAL NETWORK 1 KHADIJA AHMAD JABAR, 2 MOHAMMAD FAIDZUL NASRUDIN School Of Computer Science, Universiti Kebangsaan Malaysia,
More informationProgramming-By-Example Gesture Recognition Kevin Gabayan, Steven Lansel December 15, 2006
Programming-By-Example Gesture Recognition Kevin Gabayan, Steven Lansel December 15, 6 Abstract Machine learning and hardware improvements to a programming-by-example rapid prototyping system are proposed.
More informationRelay Online How To:
Relay Online How To: ---------------------------------------- Event Announcements Page --------------------------------------- The Event Announcements page is a great way to share upcoming meetings, fundraisers
More informationSession 3 Introduction to SIMULINK
Session 3 Introduction to SIMULINK Brian Daku Department of Electrical Engineering University of Saskatchewan email: daku@engr.usask.ca EE 290 Brian Daku Outline This section covers some basic concepts
More informationPerformance Characterization in Computer Vision
Performance Characterization in Computer Vision Robert M. Haralick University of Washington Seattle WA 98195 Abstract Computer vision algorithms axe composed of different sub-algorithms often applied in
More informationINTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY
INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY A PATH FOR HORIZING YOUR INNOVATIVE WORK REAL TIME HAND TRACKING AND GESTURE RECOGNITION SYSTEM MS. ANAGHA P. DHOTE Dept.
More informationStudioPrompter Tutorials. Prepare before you start the Tutorials. Opening and importing text files. Using the Control Bar. Using Dual Monitors
StudioPrompter Tutorials Prepare before you start the Tutorials Opening and importing text files Using the Control Bar Using Dual Monitors Using Speed Controls Using Alternate Files Using Text Markers
More informationMouse Pointer Tracking with Eyes
Mouse Pointer Tracking with Eyes H. Mhamdi, N. Hamrouni, A. Temimi, and M. Bouhlel Abstract In this article, we expose our research work in Human-machine Interaction. The research consists in manipulating
More informationDESIGNING A REAL TIME SYSTEM FOR CAR NUMBER DETECTION USING DISCRETE HOPFIELD NETWORK
DESIGNING A REAL TIME SYSTEM FOR CAR NUMBER DETECTION USING DISCRETE HOPFIELD NETWORK A.BANERJEE 1, K.BASU 2 and A.KONAR 3 COMPUTER VISION AND ROBOTICS LAB ELECTRONICS AND TELECOMMUNICATION ENGG JADAVPUR
More informationPhotography by Christina Sizemore. Mudbox Hotkeys
Digital Sculpting with Mudbox FIG 2.12 Digital Images Are Composed of a Pixel Grid. Each Pixel Stores Information Like Color and Transparency. Mudbox Uses Digital Images as Stencils and Stamps and Creates
More informationLecture 6. Design (3) CENG 412-Human Factors in Engineering May
Lecture 6. Design (3) CENG 412-Human Factors in Engineering May 28 2009 1 Outline Prototyping techniques: - Paper prototype - Computer prototype - Wizard of Oz Reading: Wickens pp. 50-57 Marc Rettig: Prototyping
More informationDetecting Thoracic Diseases from Chest X-Ray Images Binit Topiwala, Mariam Alawadi, Hari Prasad { topbinit, malawadi, hprasad
CS 229, Fall 2017 1 Detecting Thoracic Diseases from Chest X-Ray Images Binit Topiwala, Mariam Alawadi, Hari Prasad { topbinit, malawadi, hprasad }@stanford.edu Abstract Radiologists have to spend time
More informationAircraft Tracking Based on KLT Feature Tracker and Image Modeling
Aircraft Tracking Based on KLT Feature Tracker and Image Modeling Khawar Ali, Shoab A. Khan, and Usman Akram Computer Engineering Department, College of Electrical & Mechanical Engineering, National University
More informationImproving License Plate Recognition Rate using Hybrid Algorithms
Improving License Plate Recognition Rate using Hybrid Algorithms 1 Anjli Varghese, 2 R Srikantaswamy 1,2 Dept. of Electronics and Communication Engineering, Siddaganga Institute of Technology, Tumakuru,
More informationMouse Simulation Using Two Coloured Tapes
Mouse Simulation Using Two Coloured Tapes Kamran Niyazi 1, Vikram Kumar 2, Swapnil Mahe 3 and Swapnil Vyawahare 4 Department of Computer Engineering, AISSMS COE, University of Pune, India kamran.niyazi@gmail.com
More informationComputer Vision I - Basics of Image Processing Part 1
Computer Vision I - Basics of Image Processing Part 1 Carsten Rother 28/10/2014 Computer Vision I: Basics of Image Processing Link to lectures Computer Vision I: Basics of Image Processing 28/10/2014 2
More informationA Review on Plant Disease Detection using Image Processing
A Review on Plant Disease Detection using Image Processing Tejashri jadhav 1, Neha Chavan 2, Shital jadhav 3, Vishakha Dubhele 4 1,2,3,4BE Student, Dept. of Electronic & Telecommunication Engineering,
More informationA Statistical Approach to Culture Colors Distribution in Video Sensors Angela D Angelo, Jean-Luc Dugelay
A Statistical Approach to Culture Colors Distribution in Video Sensors Angela D Angelo, Jean-Luc Dugelay VPQM 2010, Scottsdale, Arizona, U.S.A, January 13-15 Outline Introduction Proposed approach Colors
More informationv Observations SMS Tutorials Prerequisites Requirements Time Objectives
v. 13.0 SMS 13.0 Tutorial Objectives This tutorial will give an overview of using the observation coverage in SMS. Observation points will be created to measure the numerical analysis with measured field
More informationExtraction and Recognition of Alphanumeric Characters from Vehicle Number Plate
Extraction and Recognition of Alphanumeric Characters from Vehicle Number Plate Surekha.R.Gondkar 1, C.S Mala 2, Alina Susan George 3, Beauty Pandey 4, Megha H.V 5 Associate Professor, Department of Telecommunication
More informationImplementation Of Fuzzy Controller For Image Edge Detection
Implementation Of Fuzzy Controller For Image Edge Detection Anjali Datyal 1 and Satnam Singh 2 1 M.Tech Scholar, ECE Department, SSCET, Badhani, Punjab, India 2 AP, ECE Department, SSCET, Badhani, Punjab,
More information