CREATING 3D WRL OBJECT BY USING 2D DATA

Similar documents
3D Modeling using multiple images Exam January 2008

Shape Descriptor using Polar Plot for Shape Recognition.

Recognition of Non-symmetric Faces Using Principal Component Analysis

calibrated coordinates Linear transformation pixel coordinates

A Sketch Interpreter System with Shading and Cross Section Lines

9. Three Dimensional Object Representations

Isolated Curved Gurmukhi Character Recognition Using Projection of Gradient

Reconstruction of complete 3D object model from multi-view range images.

Computer Vision Projective Geometry and Calibration. Pinhole cameras

3D-2D Laser Range Finder calibration using a conic based geometry shape

New method of 3D reconstruction from mechanical engineering drawings based on engineering semantics understanding

Ray Tracing. Foley & Van Dam, Chapters 15 and 16

Ray Tracing Foley & Van Dam, Chapters 15 and 16

Department of Computer Engineering, Middle East Technical University, Ankara, Turkey, TR-06531

Image-Based Modeling and Rendering. Image-Based Modeling and Rendering. Final projects IBMR. What we have learnt so far. What IBMR is about

L1 - Introduction. Contents. Introduction of CAD/CAM system Components of CAD/CAM systems Basic concepts of graphics programming

CHAPTER 1 Graphics Systems and Models 3

Implicit Surfaces & Solid Representations COS 426

Design Intent of Geometric Models

TA Section 7 Problem Set 3. SIFT (Lowe 2004) Shape Context (Belongie et al. 2002) Voxel Coloring (Seitz and Dyer 1999)

3D Object Model Acquisition from Silhouettes

Lecture 4, 5/27/2017, Rhino Interface an overview

Human Face Detection and Tracking using Skin Color Combined with Optical Flow Based Segmentation

Computer Graphics 1. Chapter 2 (May 19th, 2011, 2-4pm): 3D Modeling. LMU München Medieninformatik Andreas Butz Computergraphik 1 SS2011

Announcements. Recognition I. Optical Flow: Where do pixels move to? dy dt. I + y. I = x. di dt. dx dt. = t

Correspondence. CS 468 Geometry Processing Algorithms. Maks Ovsjanikov

3D Reconstruction from Scene Knowledge

Design Intent of Geometric Models

Partial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems

Performance Level Descriptors. Mathematics

GEOMETRIC TOOLS FOR COMPUTER GRAPHICS

Lecture 8 Object Descriptors

An Efficient Visual Hull Computation Algorithm

Camera Geometry II. COS 429 Princeton University

Recognizing Buildings in Urban Scene of Distant View ABSTRACT

3D Modeling techniques

Surface Reconstruction. Gianpaolo Palma

Multiple View Geometry in Computer Vision Second Edition

Face Recognition At-a-Distance Based on Sparse-Stereo Reconstruction

Homework #2. Hidden Surfaces, Projections, Shading and Texture, Ray Tracing, and Parametric Curves

A User Study Comparing 3D Modeling with Silhouettes and Google SketchUp Alec Rivers, Fredo Durand, and Takeo Igarashi

Occluder Simplification using Planar Sections

3D Models and Matching

Model-based Enhancement of Lighting Conditions in Image Sequences

A simple method for interactive 3D reconstruction and camera calibration from a single view

Constructive Solid Geometry and Procedural Modeling. Stelian Coros

Structure from motion

CS184 : Foundations of Computer Graphics Professor David Forsyth Final Examination

Chapter 3 Image Registration. Chapter 3 Image Registration

3D Modeling I. CG08b Lior Shapira Lecture 8. Based on: Thomas Funkhouser,Princeton University. Thomas Funkhouser 2000

Local patch blind spectral watermarking method for 3D graphics

Digital Image Processing Fundamentals

COSC579: Scene Geometry. Jeremy Bolton, PhD Assistant Teaching Professor

Model-based segmentation and recognition from range data

Triangular Mesh Segmentation Based On Surface Normal

Outline 7/2/201011/6/

DD2429 Computational Photography :00-19:00

COMPARISON OF PHOTOCONSISTENCY MEASURES USED IN VOXEL COLORING

Geometric Modeling. Introduction

Silhouette-based Multiple-View Camera Calibration

CS184 : Foundations of Computer Graphics Professor David Forsyth Final Examination (Total: 100 marks)

CHETTINAD COLLEGE OF ENGINEERING & TECHNOLOGY CS2401 COMPUTER GRAPHICS QUESTION BANK

Fusion of 3D B-spline surface patches reconstructed from image sequences

The University of Calgary

Lecture 17: Solid Modeling.... a cubit on the one side, and a cubit on the other side Exodus 26:13

Algorithm research of 3D point cloud registration based on iterative closest point 1

Automatic Reconstruction of 3D Objects Using a Mobile Monoscopic Camera

Lecture 3 Sections 2.2, 4.4. Mon, Aug 31, 2009

Multi-View Stereo for Static and Dynamic Scenes

AutoCAD for Engineers and Designers, 21st Edition. (3D and Advanced)

Detecting Multiple Symmetries with Extended SIFT

Geometric Modeling and Processing

Simplified Mesh Generation from Renders. Thorvald Natvig

Physically-Based Modeling and Animation. University of Missouri at Columbia

CS231A Midterm Review. Friday 5/6/2016

A Developer s Survey of Polygonal Simplification algorithms. CS 563 Advanced Topics in Computer Graphics Fan Wu Mar. 31, 2005

Panoramic Image Stitching

Ray Tracing I. History

Structure from motion

Multi-view stereo. Many slides adapted from S. Seitz

3 Polygonal Modeling. Getting Started with Maya 103

3D Graphics for Game Programming (J. Han) Chapter II Vertex Processing

Announcements. Recognition I. Gradient Space (p,q) What is the reflectance map?

METRIC PLANE RECTIFICATION USING SYMMETRIC VANISHING POINTS

Consolidation of Grade 6 EQAO Questions Geometry and Spatial Sense

Geometric Modeling. Bing-Yu Chen National Taiwan University The University of Tokyo

Camera model and multiple view geometry

Comments on Consistent Depth Maps Recovery from a Video Sequence

Mathematics High School Geometry An understanding of the attributes and relationships of geometric objects can be applied in diverse contexts

Ray Tracer I: Ray Casting Due date: 12:00pm December 3, 2001

LAB # 2 3D Modeling, Properties Commands & Attributes

CITS 4402 Computer Vision

Introduction to Transformations. In Geometry

Sculpting 3D Models. Glossary

Robotics Programming Laboratory

TD2 : Stereoscopy and Tracking: solutions

Model Based Perspective Inversion

HUMAN TRACKING SYSTEM

Structure from Motion. Introduction to Computer Vision CSE 152 Lecture 10

Modelling imprints of pharmaceutical tablets for imprint quality visual inspection

Transcription:

ISSN : 0973-7391 Vol. 3, No. 1, January-June 2012, pp. 139-142 CREATING 3D WRL OBJECT BY USING 2D DATA Isha 1 and Gianetan Singh Sekhon 2 1 Department of Computer Engineering Yadavindra College of Engineering, Punjabi University Guru Kashi Campus, Talwandi Sabo, Punjab, India E-mail: ishajindal@gmail.com 2 Department of Computer Engineering, Yadavindra College of Engineering, Punjabi University Guru Kashi Campus, Talwandi Sabo, Punjab,India E-mail: gianetan@gmail.com ABSTRACT This paper presents a technique for Creating 3D object by using 2D images by calibration at different angles. The goal of this study is to investigate the construction of 3D graphical models of real objects in a controlled imaging environment and present the work done based on Eigen values and Eigen vectors. Although many parts of the whole system have been well known in the literature and in practice. Based on a multi-images calibration, an algorithm is designed to extract the common features of the images. Furthermore, this can be extended to estimate robustly the initial Eigen values of the object to be modeled. This algorithm has a simpler visibility check. Besides, in order to construct the appearance, we use the application of images based rendering. The reconstruction results are shown both on real world objects. Keywords: 3D object modeling, Image based rendering, Eigen values and Eigen vector 1. INTRODUCTION We present a new approach that facilitates the creation of 3D model directly from 2D images of objects. Our work is motivated by observing the workflow of traditional CAD, where design usually proceeds in many phases. First load data set of an object which is in 2D in MATLAB, often from front, side, except top and bottom view and then uses these images as a reference in constructing a 3D model on a computer. While most of the creative designing occurs in 2D, the process of translating those 2D images into a 3D model is tedious, and often takes some time. The 3D position for every element of the model must be specified, and when referring to images, the user must be constantly translating a desired change in a 2D view to the sequence of 3D operations that will produce that change. The core idea that makes our approach tractable, from both a user interface and implementation perspective, is to focus on 2D object silhouettes. The user specifies a part by drawing its silhouettes in two or more orthogonal views and a 3D shape that matches those silhouettes is automatically generated and displayed. A user can focus on iterating the 2D images, allowing for fast experimentation and modelling[1]. With the help of an algorithmic standpoint, we show that using silhouettes dramatically simplifies the computation of one of the most challenging features in CAD-CAM[1] and MAYA : Eigen values and Eigen vectors, Constructive Solid Geometry (CSG). Building on ideas from the visual hull and silhouette intersection, we introduce simple algorithms that operate entirely in 2D but can generate complex 3D CSG objects. We also enable the creation of smooth shapes that approximate the least variation- of-curvature surfaces that match their input silhouettes[1] with the extraction of common features. After loading the data set there is a task to normalize the images to calculate the mean image.normalization is necessary to reduce the artifacts occurred due to light, after normalization calculate Eigen values if the Eigen value is zero then it can be eliminated because it will plot directly which it find that's why we can ignore it. When all the Eigen values are calculated then it will be sort in ascending order and calculate Eigen vectors which will detect the direction after that calculate the Euclidean distance. After extracting all the values reconstruct the wireframe model. 2. RELATED WORK In this section, we give a brief overview of the previously proposed methods for create a 3D model by using various techniques and methods with the help of Image based Rendering. During 3D reconstruction solutions, the problem can be simplified by using controlled imaging environments around the object, and background surface and lighting are selected to reduce the specularities on the acquired image. A setup consisting of a rotary table with a fixed camera is generally used in order to obtain a controlled camera motion around the object[1].

140 The camera has to be calibrated in such a setup to obtain the internal and external parameters defining the physical properties of the camera and the camera imaging positions with respect to the rotary table turn angles. Due to acquisition setup, the rotation axis and distance from the camera center to this rotation axis remain the same during the turns of the table. Based on this idea a vision-based geometrical calibration algorithm have been developed for the rotary table. One of the advantages of this algorithm is that it is more robust than the single image calibration methods[1]. It can compute very easily the distance between the rotation axis of the table with respect to the camera centre which in fact facilitates the calculation of the bounding box. The initial estimation of the bounding box is not an essential step but leads to more efficient computations in the subsequent steps. Keeping the number of voxels constant, the size of the bounding box affects the resolution of the final model: smaller the box, less the quantization effects. There are many disadvantages of the silhouette-based reconstruction algorithm. In this context, they have implemented an algorithm which removes the dis advantages using photoconsistency[1]. In another approach sketch-based modelling is designed by drawing their 2D silhouettes from different views. Complex models can be constructed by assembling them out of parts defined by their silhouettes, which can be combined using CSG operations. Algorithm is used to compute CSG solids that have special properties of silhouette cylinders to convert the 3D CSG problem into one that can be handled entirely with 2D operations, making implementation simpler and more robust. In this designer first sketches an object in 2D, often from front, side, and top views, and then uses these sketches as a reference in constructing a 3D model on a computer. It takes the most time[2]. The user specifies a part by drawing its silhouettes in two or more orthographic views, and a 3D shape that matches those silhouettes is automatically generated and displayed. silhouettes dramatically simplifies the computation of one of the most challenging features in CAD-CAM: Boolean operations, Constructive Solid Geometry (CSG). Basically target is for modeling of man-made objects, as they typically can be decomposed into axis-aligned subparts. Organic models are not well suited to this approach[2]. In another approach, user consider 3D-shape descriptors generated by using functions on a sphere. The descriptors are engaged for retrieving polygonal mesh models. Model can be Created either by using the Principle Component Analysis (PCA) or defining features in which the invariance exists. firstly, they define a new rotation invariant feature vector based on functions on concentric spheres. secondly, we compare the two approaches for achieving rotation invariance as IJCSC well as options to use a single function or several functions on concentric spheres to generate feature vectors. [3] This algorithms consist of three steps : normalization, feature extraction, and similarity search. During the normalization, a 3D-object is translated, rotated, scaled, and flipped into a canonical position and orientation.[3] 3. PROPOSED METHOD In our approach, a 3D model is created out of parts. Each part is specified by two silhouettes from front, side views. As the user creates and refines the silhouettes of a part, the corresponding 3D model is automatically generated and displayed. For example, if the user sketches a triangle in the front and side views, and a square in the top, a pyramid will appear in the 3D view. The calculation is fast enough to provide immediate feedback [1]. A shape with complex or occluded segments is built up by composing it out of multiple parts. Each part has its silhouettes match separately, and our interface makes associations between parts and silhouettes explicit by only allowing the MATLAB to match silhouettes for the currently selected part. One image is match with another image, extract the common features from both of the images [1]. After extracting the common features calculate the mean image, and from the mean image the need to calculate the Eigen values and the Eigen vectors which gives us the directions and then sort all Eigen values in the ascending order then we need to calculate Euclidean distance to create a 3D model. In this method, we use a man made object that is Teapot having 3 different degree angles : 3º, 5º and 7º around 360º. To construct a 3D model we have many steps: 3.1. Calculate Eigen Values Eigen values depend on the concepts of vectors and linear transformations. The eigen values of A are precisely the solutions λ to the equation a1,1 0 0 0 a2,2 0 A = 0 0 0 0 an, n The solutions to this equation are the eigen values λ i = a i, i (i = 1,..., n). Eigen value equation for a matrix A can be expressed as Ax λix = 0. I is the n n identity matrix. This equation is called the characteristic equation. For example, if A is the following matrix (diagonal matrix).

Creating 3D WRL Object by Using 2D Data 141 3.2. Calculate Eigen Vectors The eigenvectors of a square matrix are the non-zero vectors that, after being multiplied by the matrix, remain parallel to the original vector. Eliminate those values whose Eigen value is zero. Geometric symmetric having less number of features to extract, like sheer & tear and scaling. In Figure 3 the image of an object show the result which is in 5º difference upto 360º. 3.3. Calculate Euclidean Distance It is the ordinary distance between two points. In one dimension the distance between two points on the real line is the absolute value. ()x 2 y = x y In two dimension if p = (p 1, p 2,..., p n ) and q = (q 1, q 2,..., q n ) are two points in Euclidean n-space, then the distance from p to q, or from q to p is given by: d(q, p) = n i= 1 () q i p i 1 Figure 3: In Figure 4 the image of an object show the result which is in 7º difference upto 360º. 4. RESULTS This section presents the image of an object which is in 3º difference upto 360º. Figure 4: These are the results with the different degree images to create a 3D wireframe model. Figure 1: It will create a 3D wireframe model. 4.1. Accuracy Graph We have tried three different angle images to convert 3D model and take different results for transform. 3º and 5º images have good results as compared to 7º images. Figure 2: Graph

142 4.2. Time graph We have tried three different angle images to convert 3D model and take different time for transform. 3º images takes more time because of 120 images, 5º images take less time as compared to 3º because of 72 images but in the case of 7º images take lesser time because of 52 images, less number of common features are extracted. 5. CONCLUSION Graph By discussing the above results we conclude that where the accuracy of 3º & 5º images is greater there the time taken by 3º image is more & 5º images is less as compared to 3º and the accuracy and time taken by 7º images are lesser because of lesser number of images. REFERENCES IJCSC [1] Alec Rivers et al, 3D Modeling with Silhouettes, SIGGRAPH 2010. [2] Adem Yasar Mulayim et al, Silhouette- Based 3D Model Reconstruction from Multiple Images, IEEE 2003. [3] Andrew E. Johnson et al, Using Spin-Images for Efficient Object Recognition in Cluttered 3-D Scenes, IEEE 1998. [4] Stefanos Zafeiriou et al, Blind Robust Watermarking Schemes for Copyright Protection of 3D Mesh Objects, IEEE 2005. [5] Dejan V. Vrani, An Improvement of Rotation Invariant 3D-Shape Descriptor Based on Functions on Concentric Spheres, IEEE 2003. [6] Lior Shapira et al, Consistent Mesh Partitioning and Skeletonisation Using the Shape Diameter Function, IEEE 2008. [7] A.A. Johnson et al, Advanced Mesh Generation and Update Methods for 3D Flow Simulations, IEEE 1998. [8] J.C.Carr et al, Reconstruction and Representation of 3D Objects with Radial BasisFunctions, ACM SIGGRAPH 2001. [9] Matthew A. Turk et al, Face Recognition Using Eigenfaces, IEEE 1998. [10] Alex Pentland et al, View Based and Modular Eigenspaces for Face Recognition, IEEE 1994. [11] Takeo Igarashi et al, Teddy : A Sketching Interface for 3D Freeform Design ACM SIGGRAPH 1999. [12] Yi Huo et al, Motion Vector Based Image Rendering Algorithm CISP 2010.