Facial Animation System Based on Image Warping Algorithm
|
|
- Imogen Thomas
- 6 years ago
- Views:
Transcription
1 Facial Animation System Based on Image Warping Algorithm Lanfang Dong 1, Yatao Wang 2, Kui Ni 3, Kuikui Lu 4 Vision Computing and Visualization Laboratory, School of Computer Science and Technology, University of Science and Technology of China, Hefei, China 1:lfdong@ustc.edu.cn, 2:ytwang@mail.ustc.edu.cn, 3:nk@ustc.edu.cn, 4:lukui@mail.ustc.edu.cn Abstract This paper is about the technologies in facial animation application. The major contents are as follows:1)we summary the classic image warping algorithms, and analyze the advantages and disadvantages of these algorithms when used in facial animation;2)we study the principles of Mesh Warping image warping algorithms, and propose a novel Mesh Warping algorithm based on scan lines. The algorithm meets real-time facial animation system in running time, reduces the constraints of constructing splines in some degree, and cuts down the difficulty of image warping, according to experimental results;3)we introduce MEPG-4 facial animation standard, and implement a speechdriven facial animation system using it. The system makes use of our scan lines Mesh Warping algorithm, which produces a variety of mouth and facial expressions of the speaker, more realistic animation, higher real-time, and better with the speech sync. Keywords-Facial Animation; Image Warping; MPEG-4; Viseme Interpolation I. Introduction The human face and speech are the two most important ways of human communications. Combining the animation and speech processing, speech animation technology generates animation with speech and mouth shape changing synchronously by computer, also known as "Talking Head" or "Mouth Shape-Sync". Speech animation technology is divided mainly into three types: samples-based, 3D model-based and single imagebased. Speech animation based on samples generates new facial animation by reorganizing the given samples. The advantages are very realistic, but it needs a live talk video with hard data acquisition. Besides it only gets the facial animation in the samples. 3D model-based facial animation establishes a 3D face model first, and then drives the face model to generate speech animation in which speech and mouth shape playing synchronously. Talking face can has a variety of expressions. This approach is not better than samples-based animation in reality at the moment, but data acquisition is easy (only a few images of different angles). It can be made conveniently (no or little user interaction), and generate realistic 3D animation. The speech animation we describe here is based on image warping: inputting one human face (or animal face, cartoon face) image, positioning feature point, we save the positions into data files. For the sound files inputted, we perform speech recognition, and generate phoneme timestamps files. Then, we synchronize images and audio files selected, play the speech, and drive face in the image for animation simultaneously. The system can be applied to humancomputer interaction using images which contain human, animal or cartoon faces. Image warping technique is the core in single image-based speech animation. The technologies used in face image warping with better effects are divided into two categories: 1) The warping based on scattered point interpolation: the typical algorithm is the warping algorithm based on radial basis function (RBF) [1, 2, 3]. It is more convenient in positioning feature points, and can produce realistic warped images. But the selected functions of RBF such as Gaussian function are generally very complex. They are slow in warping as a result. In addition, the algorithm is difficult to guarantee the stability border of warped image. 2) The warping based on fragments: typical algorithms are the warping algorithms based on triangulation [4, 5] and the grid distortion algorithms [6, 7]. Triangulation-based image warping algorithms can obtain good results when performing local warping in the face images. But the preprocessing of images divided into triangular pieces is relatively complex, and the reasonableness and effectiveness of block affect directly the final warping results. Therefore, they are in less convenient. The entire warping work must do again especially warping results are not satisfied and need to be adjusted. G.Wolberg proposed the distorted grid warping algorithm which usually uses cubic spline interpolation (Fig. 1). Grid distortion algorithm is mainly used for the shape transitions between two faces (or called warping), we call these two images IS and IT (the source and target images).source image links with grid MS. It specifies the coordinates of control points or landmarks. The second grid MT is specified their corresponding positions in the target image. MS and MT define spatial transformation at the same time, and the transformation will map all points in IS to IT. The mesh topology is limited isomorphism which allows non-folding and discontinuity. Therefore, the nodes in MT can disappear /11/$ IEEE 2648
2 Figure 1. Meshing of image warping based on grid distortion from MS according to requirements, as long as they do not cause self-intersection. Grids are limited to a fixed boundary for simplicity moreover. Lin in National Taiwan University has applied this approach in the facial animation system [8], in which facial features are defined by a mesh mask, using the meshing algorithm for image warping to generate facial animation. Because converging mesh on the face image is too complex and not easy in user interaction, the requirements are high for mesh in addition. The animation process is very random if it is used for speech animation, because the system requirements high precision. Control is not convenient as a result. II. Image warping based on scan lines We propose a novel image warping algorithm based on scan lines after carefully researching the Mesh Warping algorithm. Fig. 2 describes the details of our warping method which includes three stages. 1 Using the feature points in the source image and target image to generate the feature points in the intermediate warped image (Fig. 3). The x coordinates of feature points comes from the target feature points, and y coordinates of feature points come from the source feature points. 2 Performing warping in x direction. a Using source feature points and intermediate feature points to construct the source vertical splines (Fig. 4) and target vertical splines separately, while every spline is generated by linear interpolation. b Horizontal scan lines scan vertical bars progressively. One scan line intersects with two adjacent vertical splines, and the middle points come from the control points (two intersection points) using linear interpolation. Algorithm 1: Image Warping Based on Scan Lines Input: A gray-scale image size rectangular block (M * N) and a number of feature points which distribute in the source image and target image. Output: The new coordinates of each pixel in the warped image. Figure 2. Image warping algorithm Figure 3. Schematic diagram of feature points Figure 4. Schematic diagram of the vertical spline Figure 5. Schematic diagram of horizontal splines 3 Performing warping in y direction. a Using source feature points and intermediate feature points to construct the source horizontal splines (Fig. 5) and target horizontal splines separately, while every spline is generated by linear interpolation. 2649
3 (a) Source image (b) Mouth shape 1 (c) Mouth shape 2 (d) Mouth shape 3 Figure 6. Various Mouth Shape b Vertical scanning lines scan horizontal bands by column. One scan line intersects with two adjacent horizontal splines, and the middle points come from the control points (two intersection points) using linear interpolation. The horizontal and vertical splines as described in the steps above can be constructed independently, and do not form spline grid sharing some feature points any more. This improvement reduces the difficulty of constructing splines and makes it easier for the image warping in speech animation. Parts of the warping effects are shown in Fig. 6. III. 2D facial animation system based on image warping Facial animation in MPEG-4 is only a standard, and does not give a specific solution which gives researchers a vast space. We implement a face speech animation system which is composed by face parameters modeling module, speech recognition module, and animation generating module in this paper based on MPEG-4. The animation generation module composed by the animation parameters calculation module and image warping module. System block diagram is shown in Fig. 7. System inputs are arbitrary facial image files and audio files. We local the coordinates of feature points in face images by face parameters modeling module. Speech streams are recognized into visual phoneme streams by speech recognition module. System definition files define the correspondence between standard face model and the visual phonemes, including the visual phoneme definitions, the displacement factor definitions of feature points, and the expressions FAP (Facial Animation Parameters) definitions. We can obtain a set of FAP values corresponding to currently playing visual phonemes by pre-designed operation. We also can get the displacement of feature points from FAP values and the FDP (Facial Definition Parameters) values (the coordinates of facial feature points) by calculating in the face image. Finally, the image warping algorithm could generate animation. Broadcasting speech and animation simultaneously, speech animation system can be realized. A. Face parameters modeling module We mark facial feature points using face parameters modeling module. Our system selects 45 facial feature points which most distribute around the eyes and the mouth to describe a frontal face image (Fig. 8). These points play a major role in generating animation and are mainly used to achieve a variety of mouth shapes, expressions, random blinking and other effects. Feature points which are used for realization the random shaking of the whole face are lower in cheek area. B. Speech recognition module Speech recognition module is mainly used for extracting the visual phonemes in the audio file streams. Our system adopts speech recognition engine SAPI5.0 as a visual phonemes extraction tool. SAPI 5.0 (MS Speech SDK 5.0 for short) is released in October 2000 by the Microsoft Corporation. Users can easily develop applications such as speech recognition, speech synthesis and related applications using SAPI 5.0. Figure 7. Speech-driven facial animation flow chart Figure 8. Distribution of feature points in face parameters modeling 2650
4 TABLE 1. VISUAL PHONEME AND PHONEME # Phonemes 0 ae ax ah aa ay 1 P b m 2 D t l 3 ey eh uh 4 F v 5 K g h 6 Y iy ih ix 7 sh ch jh zh 8 ao ow aw oy 9 R 10 W uw 11 S z 12 th dh 13 N ng 14 Er 15 silence Visual phonemes (viseme) are the video parameters corresponding to phonemes which represent kinds of mouth shapes of some pronunciation. The visual phonemes used in the system are listed in Table. 1. C. Animation parameters calculation module This system uses high-layer actions, bottom-layer FAP, feature points and spline points to consist the four-layer control structure for facial animation, shown in Fig. 9. High-layer actions include mouth shapes and facial expressions. Low-layer FAP is defined as FAP3-68 in MPEG-4 standard, a total of 68. The implementation of FAP is achieved by moving a set of related feature points whose locations are determined in a neutral state face model according to the definition in MPEG-4. Each animation frame is represented into movement of a number of feature points and related splines which are relative to the neutral state face model at last. For a given intensity of a high-layer action, calculating methods about the displacement of feature points and the splines are: Bottom-layer FAP strength = High-layer actions strength * Bottom-layer FAP weights Feature points displacement = Bottom-layer FAP strength * Feature points weights * FAPU Spline points displacement = Feature points displacement * Spline points weights Four-layer structure can reduce the facial animation dependent on the face mesh, making the replacement of model more convenient. We abstract high-layer actions which make application and expansion more convenient. D. Image warping module Our system adopts Mesh Warping algorithm based on scan lines for image warping with comprehensive consideration of real-time animation, reality and operational flexibility. The constructing of splines is relatively more complicated in this method, but the effects of warping have great influence. As mentioned earlier, Mesh Warping algorithm based on scan lines can make image warping and constructing the splines in X and Y directions independently. After repeated experiments, the system determines eventually the following options. Horizontal splines covering the whole area of images achieve the warping in Y direction, as shown in Fig. 10; Vertical splines covering the mouth and eyes area respectively for reducing the difficulty of constructing splines achieves the warping in X direction, as shown in Fig. 11; Constructing the vertical splines for the whole image separately achieves the effect of shaking head in addition, as shown in Fig. 12. In Fig. 10, Fig. 11, and Fig. 12, black rectangles represent feature points; white rectangle represents the secondary feature points (mainly in order to assist constructing splines and stabilize warped image boundary, these points are computed simply by the feature points); diamonds represent the warping boundary, and control the warping only occurring inside the boundary area; upright triangles represent the pixels adjacent feature points; inverted triangles represent the points separated by a pixel with feature points. These adjacent or close points mainly control the warping of local area. It is worth mentioning that feature points in the chin are not in the vertical splines but in the horizontal splines taking into account the chin can only move up and down almost when talking (shaking head is considered separately). It shows one improvement for the traditional Mesh Warping algorithm, namely: constructing horizontal splines and vertical splines independently; warping in X and Y directions separately. Figure 9. Four-layer control structure Figure 10. Horizontal splines 2651
5 based on scan lines to producing a variety of mouth shape and facial expressions about talker. Nevertheless, facial animation produced by the system can be improved in many aspects. The system does not care the teeth inside the mouth, but put to use smearing method. Mouth opening becomes larger in some frames than the real size in actual. In addition, the animation effect of transitions between various visual phonemes and all kinds of expressions needs to be further improved. Figure 11. Vertical splines for facial warping Figure 12. Vertical splines for shaking head IV. Experimental results The animation process of our system is shown in Fig. 13. Using algorithm in Section 3, we achieve a speech-driven facial animation system. Fig. 14 shows some frames of facial animations produced by our system. The main functions of the speech-driven facial animation system can be describes as follows. Generating 16 self-defined visual phonemes corresponding to the mouth in the system; Providing the expression labels with six kinds of common expressions; Providing random blinking, shaking head and other effects, enhancing reality of the animation; Sharing visual phonemes, synchronization between voice and animation preferable; Animation frame rate is 20 frames/sec. V. Conclusion We analyze the facial animation research situation, and propose a facial animation generation method based on image warping. We use a frontal face image by choosing feature points to construct the face model, and achieve realistic facial animation using Mesh Warping image warping technology Figure 13. System animation flow chart 2652
6 Acknowledgement The author would like to thank the students Jiahui Chen and Meng Li in visual computing and visualization laboratory of University of Science and Technology of China for providing assistance. This work is supported by the Imagebased Speech Animation of Youth Innovation Fund in University of Science and Technology of China ( ) and Intelligent Human-machine Speech Interaction Robot Key Technology of Research Programs in Anhui Province ( ) under Grant No (a) Speech happily (b) Speech angrily References [1] D. Reisfld,N. Arad,N. Dyn and et al, Image warping by radial basis functions: Application to facial expressions, CVGIP: Graphical Models and Image Processing, 1994, 56(2), pp [2] N. Arad, D. Reisfeld. Image warping using few anchor points and radial functions, Computer Graphics Forum,1995,14(1),pp [3] J. Noh, D. Fidaleo, U. Neumann, Animated deformations with radial basis functions, In Proceedings of the ACM Symposium on Virtual Reality Software and Technology,Seoul,2000,pp [4] G. Zhu, B. Zhang,L. Wu,Z.Hu, Research on Metamorphosis Using Delaunay Triangulation, Journal of Image and Graphics,2003,8A(6),pp [5] Y. Zhang, H. Zhao, An Image Deformation Algorithm Based on Triangle Skeleton Coordinate, Journal of Image and Graphics,2001,6A(4),pp [6] S. Lee, G. Wolberg, S.Y.Shin, Scattered data interpolation with multilevel B-splines, IEEE Transactions on Visualization and Computer Graphics, 1997, 3(3), pp [7] D.B. Smythe, A two-pass mesh warping alogrithm for object transformation and image interpolation, Technical Report 1030,ILM Computer Graphics Department, Lucasfilm, San Rafael, Calif, [8] I. Lin, C. Hung, T. Yang, M. Ouhyoung, A Speech Driven Talking Head System Based on a Single Face Image, In Proceedings of the 7th Pacific Conference on Computer Graphics and Applications, Seoul,1999, pp (c)speech surprisedly Figure 14. Speech-driven facial animation 2653
Facial Expression Morphing and Animation with Local Warping Methods
Facial Expression Morphing and Animation with Local Warping Methods Daw-Tung Lin and Han Huang Department of Computer Science and Information Engineering Chung Hua University 30 Tung-shiang, Hsin-chu,
More informationFacial Animation System Design based on Image Processing DU Xueyan1, a
4th International Conference on Machinery, Materials and Computing Technology (ICMMCT 206) Facial Animation System Design based on Image Processing DU Xueyan, a Foreign Language School, Wuhan Polytechnic,
More informationSpeech Driven Synthesis of Talking Head Sequences
3D Image Analysis and Synthesis, pp. 5-56, Erlangen, November 997. Speech Driven Synthesis of Talking Head Sequences Peter Eisert, Subhasis Chaudhuri,andBerndGirod Telecommunications Laboratory, University
More informationFacial Deformations for MPEG-4
Facial Deformations for MPEG-4 Marc Escher, Igor Pandzic, Nadia Magnenat Thalmann MIRALab - CUI University of Geneva 24 rue du Général-Dufour CH1211 Geneva 4, Switzerland {Marc.Escher, Igor.Pandzic, Nadia.Thalmann}@cui.unige.ch
More informationFast Facial Motion Cloning in MPEG-4
Fast Facial Motion Cloning in MPEG-4 Marco Fratarcangeli and Marco Schaerf Department of Computer and Systems Science University of Rome La Sapienza frat,schaerf@dis.uniroma1.it Abstract Facial Motion
More information2D Image Morphing using Pixels based Color Transition Methods
2D Image Morphing using Pixels based Color Transition Methods H.B. Kekre Senior Professor, Computer Engineering,MP STME, SVKM S NMIMS University, Mumbai,India Tanuja K. Sarode Asst.Professor, Thadomal
More informationVISEME SPACE FOR REALISTIC SPEECH ANIMATION
VISEME SPACE FOR REALISTIC SPEECH ANIMATION Sumedha Kshirsagar, Nadia Magnenat-Thalmann MIRALab CUI, University of Geneva {sumedha, thalmann}@miralab.unige.ch http://www.miralab.unige.ch ABSTRACT For realistic
More informationA Multiresolutional Approach for Facial Motion Retargetting Using Subdivision Wavelets
A Multiresolutional Approach for Facial Motion Retargetting Using Subdivision Wavelets Kyungha Min and Moon-Ryul Jung Dept. of Media Technology, Graduate School of Media Communications, Sogang Univ., Seoul,
More informationCS 231. Deformation simulation (and faces)
CS 231 Deformation simulation (and faces) Deformation BODY Simulation Discretization Spring-mass models difficult to model continuum properties Simple & fast to implement and understand Finite Element
More informationVIDEO FACE BEAUTIFICATION
VIDEO FACE BEAUTIFICATION Yajie Zhao 1, Xinyu Huang 2, Jizhou Gao 1, Alade Tokuta 2, Cha Zhang 3, Ruigang Yang 1 University of Kentucky 1 North Carolina Central University 2 Microsoft Research 3 Lexington,
More informationImage-Based Deformation of Objects in Real Scenes
Image-Based Deformation of Objects in Real Scenes Han-Vit Chung and In-Kwon Lee Dept. of Computer Science, Yonsei University sharpguy@cs.yonsei.ac.kr, iklee@yonsei.ac.kr Abstract. We present a new method
More informationVirtual Interaction System Based on Optical Capture
Sensors & Transducers 203 by IFSA http://www.sensorsportal.com Virtual Interaction System Based on Optical Capture Peng CHEN, 2 Xiaoyang ZHOU, 3 Jianguang LI, Peijun WANG School of Mechanical Engineering,
More informationFace Synthesis in the VIDAS project
Face Synthesis in the VIDAS project Marc Escher 1, Igor Pandzic 1, Nadia Magnenat Thalmann 1, Daniel Thalmann 2, Frank Bossen 3 Abstract 1 MIRALab - CUI University of Geneva 24 rue du Général-Dufour CH1211
More informationPOLYMORPH: AN ALGORITHM FOR MORPHING AMONG MULTIPLE IMAGES
POLYMORPH: AN ALGORITHM FOR MORPHING AMONG MULTIPLE IMAGES Seungyong Lee Department of Computer Science and Engineering Pohang University of Science and Technology Pohang, 790-784, S. Korea leesy@postech.ac.kr
More informationTransfer Facial Expressions with Identical Topology
Transfer Facial Expressions with Identical Topology Alice J. Lin Department of Computer Science University of Kentucky Lexington, KY 40506, USA alice.lin@uky.edu Fuhua (Frank) Cheng Department of Computer
More informationJournal of Chemical and Pharmaceutical Research, 2015, 7(3): Research Article
Available online www.jocpr.com Journal of Chemical and Pharmaceutical esearch, 015, 7(3):175-179 esearch Article ISSN : 0975-7384 CODEN(USA) : JCPC5 Thread image processing technology research based on
More informationSample Based Texture extraction for Model based coding
DEPARTMENT OF APPLIED PHYSICS AND ELECTRONICS UMEÅ UNIVERISTY, SWEDEN DIGITAL MEDIA LAB Sample Based Texture extraction for Model based coding Zhengrong Yao 1 Dept. Applied Physics and Electronics Umeå
More informationCS 231. Deformation simulation (and faces)
CS 231 Deformation simulation (and faces) 1 Cloth Simulation deformable surface model Represent cloth model as a triangular or rectangular grid Points of finite mass as vertices Forces or energies of points
More informationA reversible data hiding based on adaptive prediction technique and histogram shifting
A reversible data hiding based on adaptive prediction technique and histogram shifting Rui Liu, Rongrong Ni, Yao Zhao Institute of Information Science Beijing Jiaotong University E-mail: rrni@bjtu.edu.cn
More informationStudy on Delaunay Triangulation with the Islets Constraints
Intelligent Information Management, 2010, 2, 375-379 doi:10.4236/iim.2010.26045 Published Online June 2010 (http://www.scirp.org/journal/iim) Study on Delaunay Triangulation with the Islets Constraints
More informationData-Driven Face Modeling and Animation
1. Research Team Data-Driven Face Modeling and Animation Project Leader: Post Doc(s): Graduate Students: Undergraduate Students: Prof. Ulrich Neumann, IMSC and Computer Science John P. Lewis Zhigang Deng,
More informationnetwork and image warping. In IEEE International Conference on Neural Networks, volume III,
Mary YY Leung, Hung Yen Hui, and Irwin King Facial expression synthesis by radial basis function network and image warping In IEEE International Conference on Neural Networks, volume III, pages 1{15, Washington
More informationA Novel Double Triangulation 3D Camera Design
Proceedings of the 2006 IEEE International Conference on Information Acquisition August 20-23, 2006, Weihai, Shandong, China A Novel Double Triangulation 3D Camera Design WANG Lei,BOMei,GAOJun, OU ChunSheng
More informationModeling Coarticulation in Continuous Speech
ing in Oregon Health & Science University Center for Spoken Language Understanding December 16, 2013 Outline in 1 2 3 4 5 2 / 40 in is the influence of one phoneme on another Figure: of coarticulation
More informationAn Adaptive Threshold LBP Algorithm for Face Recognition
An Adaptive Threshold LBP Algorithm for Face Recognition Xiaoping Jiang 1, Chuyu Guo 1,*, Hua Zhang 1, and Chenghua Li 1 1 College of Electronics and Information Engineering, Hubei Key Laboratory of Intelligent
More informationM I RA Lab. Speech Animation. Where do we stand today? Speech Animation : Hierarchy. What are the technologies?
MIRALab Where Research means Creativity Where do we stand today? M I RA Lab Nadia Magnenat-Thalmann MIRALab, University of Geneva thalmann@miralab.unige.ch Video Input (face) Audio Input (speech) FAP Extraction
More informationThe Vehicle Logo Location System based on saliency model
ISSN 746-7659, England, UK Journal of Information and Computing Science Vol. 0, No. 3, 205, pp. 73-77 The Vehicle Logo Location System based on saliency model Shangbing Gao,2, Liangliang Wang, Hongyang
More informationAccurate 3D Face and Body Modeling from a Single Fixed Kinect
Accurate 3D Face and Body Modeling from a Single Fixed Kinect Ruizhe Wang*, Matthias Hernandez*, Jongmoo Choi, Gérard Medioni Computer Vision Lab, IRIS University of Southern California Abstract In this
More informationD DAVID PUBLISHING. 3D Modelling, Simulation and Prediction of Facial Wrinkles. 1. Introduction
Journal of Communication and Computer 11 (2014) 365-370 doi: 10.17265/1548-7709/2014.04 005 D DAVID PUBLISHING 3D Modelling, Simulation and Prediction of Facial Wrinkles Sokyna Alqatawneh 1, Ali Mehdi
More informationFingerprint Mosaicking by Rolling with Sliding
Fingerprint Mosaicking by Rolling with Sliding Kyoungtaek Choi, Hunjae Park, Hee-seung Choi and Jaihie Kim Department of Electrical and Electronic Engineering,Yonsei University Biometrics Engineering Research
More informationDesign and Application of the Visual Model Pool of Mechanical Parts based on Computer-Aided Technologies
Design and Application of the Visual Model Pool of Mechanical Parts based on Computer-Aided Technologies Xiaoying Dong, Xia Ye, Qinxian Jiang, Xianghua Zhang and Wei Bi School of Mechanical and Automobile
More informationAUTOMATIC 2D VIRTUAL FACE GENERATION BY 3D MODEL TRANSFORMATION TECHNIQUES
AUTOMATIC 2D VIRTUAL FACE GENERATION BY 3D MODEL TRANSFORMATION TECHNIQUES 1 Yi-Fan Chang ( 張依帆 ) and 1,2 Wen-Hsiang Tsai ( 蔡文祥 ) 1 Institute of Multimedia Engineering, National Chiao Tung University,
More informationA Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation
, pp.162-167 http://dx.doi.org/10.14257/astl.2016.138.33 A Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation Liqiang Hu, Chaofeng He Shijiazhuang Tiedao University,
More informationComputer Animation Visualization. Lecture 5. Facial animation
Computer Animation Visualization Lecture 5 Facial animation Taku Komura Facial Animation The face is deformable Need to decide how all the vertices on the surface shall move Manually create them Muscle-based
More informationReconstruction of complete 3D object model from multi-view range images.
Header for SPIE use Reconstruction of complete 3D object model from multi-view range images. Yi-Ping Hung *, Chu-Song Chen, Ing-Bor Hsieh, Chiou-Shann Fuh Institute of Information Science, Academia Sinica,
More informationFace Recognition Technology Based On Image Processing Chen Xin, Yajuan Li, Zhimin Tian
4th International Conference on Machinery, Materials and Computing Technology (ICMMCT 2016) Face Recognition Technology Based On Image Processing Chen Xin, Yajuan Li, Zhimin Tian Hebei Engineering and
More informationGeorgios Tziritas Computer Science Department
New Video Coding standards MPEG-4, HEVC Georgios Tziritas Computer Science Department http://www.csd.uoc.gr/~tziritas 1 MPEG-4 : introduction Motion Picture Expert Group Publication 1998 (Intern. Standardization
More informationImage Morphing: A Literature Study
Image Morphing: A Literature Study Harmandeep Singh Sliet University Sangrur, India Amandeep Kumar Sliet University Sangrur, India Gurpreet Singh Punjabi University Patiala, India Abstract:Image morphing
More informationSynthesizing Realistic Facial Expressions from Photographs
Synthesizing Realistic Facial Expressions from Photographs 1998 F. Pighin, J Hecker, D. Lischinskiy, R. Szeliskiz and D. H. Salesin University of Washington, The Hebrew University Microsoft Research 1
More informationEffects Of Shadow On Canny Edge Detection through a camera
1523 Effects Of Shadow On Canny Edge Detection through a camera Srajit Mehrotra Shadow causes errors in computer vision as it is difficult to detect objects that are under the influence of shadows. Shadow
More informationLearning The Lexicon!
Learning The Lexicon! A Pronunciation Mixture Model! Ian McGraw! (imcgraw@mit.edu)! Ibrahim Badr Jim Glass! Computer Science and Artificial Intelligence Lab! Massachusetts Institute of Technology! Cambridge,
More informationAUDIOVISUAL SYNTHESIS OF EXAGGERATED SPEECH FOR CORRECTIVE FEEDBACK IN COMPUTER-ASSISTED PRONUNCIATION TRAINING.
AUDIOVISUAL SYNTHESIS OF EXAGGERATED SPEECH FOR CORRECTIVE FEEDBACK IN COMPUTER-ASSISTED PRONUNCIATION TRAINING Junhong Zhao 1,2, Hua Yuan 3, Wai-Kim Leung 4, Helen Meng 4, Jia Liu 3 and Shanhong Xia 1
More informationRay tracing based fast refraction method for an object seen through a cylindrical glass
20th International Congress on Modelling and Simulation, Adelaide, Australia, 1 6 December 2013 www.mssanz.org.au/modsim2013 Ray tracing based fast refraction method for an object seen through a cylindrical
More informationFace Detection CUDA Accelerating
Face Detection CUDA Accelerating Jaromír Krpec Department of Computer Science VŠB Technical University Ostrava Ostrava, Czech Republic krpec.jaromir@seznam.cz Martin Němec Department of Computer Science
More informationModeling and Analyzing 3D Shapes using Clues from 2D Images. Minglun Gong Dept. of CS, Memorial Univ.
Modeling and Analyzing 3D Shapes using Clues from 2D Images Minglun Gong Dept. of CS, Memorial Univ. Modeling Flowers from Images Reconstructing 3D flower petal shapes from a single image is difficult
More informationImage warping/morphing
Image warping/morphing Digital Visual Effects Yung-Yu Chuang with slides by Richard Szeliski, Steve Seitz, Tom Funkhouser and Alexei Efros Image warping Image formation B A Sampling and quantization What
More informationEfficient Path Finding Method Based Evaluation Function in Large Scene Online Games and Its Application
Journal of Information Hiding and Multimedia Signal Processing c 2017 ISSN 2073-4212 Ubiquitous International Volume 8, Number 3, May 2017 Efficient Path Finding Method Based Evaluation Function in Large
More informationResearch on QR Code Image Pre-processing Algorithm under Complex Background
Scientific Journal of Information Engineering May 207, Volume 7, Issue, PP.-7 Research on QR Code Image Pre-processing Algorithm under Complex Background Lei Liu, Lin-li Zhou, Huifang Bao. Institute of
More informationMuscle Based facial Modeling. Wei Xu
Muscle Based facial Modeling Wei Xu Facial Modeling Techniques Facial modeling/animation Geometry manipulations Interpolation Parameterizations finite element methods muscle based modeling visual simulation
More informationA Simple Automated Void Defect Detection for Poor Contrast X-ray Images of BGA
Proceedings of the 3rd International Conference on Industrial Application Engineering 2015 A Simple Automated Void Defect Detection for Poor Contrast X-ray Images of BGA Somchai Nuanprasert a,*, Sueki
More informationCVGIP: Graphical Models and Image Processing, Academic Press, 60(5),pp , September 1998.
CVGIP: Graphical Models and Image Processing, Academic Press, 60(5),pp. 331-348, September 1998. Contour-Based Warping Kwai Hung Chan Rynson W.H. Lau Computer Graphics and Media Laboratory Department of
More informationVTalk: A System for generating Text-to-Audio-Visual Speech
VTalk: A System for generating Text-to-Audio-Visual Speech Prem Kalra, Ashish Kapoor and Udit Kumar Goyal Department of Computer Science and Engineering, Indian Institute of Technology, Delhi Contact email:
More informationTexture Segmentation by Windowed Projection
Texture Segmentation by Windowed Projection 1, 2 Fan-Chen Tseng, 2 Ching-Chi Hsu, 2 Chiou-Shann Fuh 1 Department of Electronic Engineering National I-Lan Institute of Technology e-mail : fctseng@ccmail.ilantech.edu.tw
More informationCSE452 Computer Graphics
CSE452 Computer Graphics Lecture 19: From Morphing To Animation Capturing and Animating Skin Deformation in Human Motion, Park and Hodgins, SIGGRAPH 2006 CSE452 Lecture 19: From Morphing to Animation 1
More informationDynamic Obstacle Detection Based on Background Compensation in Robot s Movement Space
MATEC Web of Conferences 95 83 (7) DOI:.5/ matecconf/79583 ICMME 6 Dynamic Obstacle Detection Based on Background Compensation in Robot s Movement Space Tao Ni Qidong Li Le Sun and Lingtao Huang School
More informationAn Algorithm for Seamless Image Stitching and Its Application
An Algorithm for Seamless Image Stitching and Its Application Jing Xing, Zhenjiang Miao, and Jing Chen Institute of Information Science, Beijing JiaoTong University, Beijing 100044, P.R. China Abstract.
More informationA MOUTH FULL OF WORDS: VISUALLY CONSISTENT ACOUSTIC REDUBBING. Disney Research, Pittsburgh, PA University of East Anglia, Norwich, UK
A MOUTH FULL OF WORDS: VISUALLY CONSISTENT ACOUSTIC REDUBBING Sarah Taylor Barry-John Theobald Iain Matthews Disney Research, Pittsburgh, PA University of East Anglia, Norwich, UK ABSTRACT This paper introduces
More informationEnhanced Active Shape Models with Global Texture Constraints for Image Analysis
Enhanced Active Shape Models with Global Texture Constraints for Image Analysis Shiguang Shan, Wen Gao, Wei Wang, Debin Zhao, Baocai Yin Institute of Computing Technology, Chinese Academy of Sciences,
More informationBUILDING DETECTION AND STRUCTURE LINE EXTRACTION FROM AIRBORNE LIDAR DATA
BUILDING DETECTION AND STRUCTURE LINE EXTRACTION FROM AIRBORNE LIDAR DATA C. K. Wang a,, P.H. Hsu a, * a Dept. of Geomatics, National Cheng Kung University, No.1, University Road, Tainan 701, Taiwan. China-
More informationFacial expression recognition using shape and texture information
1 Facial expression recognition using shape and texture information I. Kotsia 1 and I. Pitas 1 Aristotle University of Thessaloniki pitas@aiia.csd.auth.gr Department of Informatics Box 451 54124 Thessaloniki,
More informationFACET SHIFT ALGORITHM BASED ON MINIMAL DISTANCE IN SIMPLIFICATION OF BUILDINGS WITH PARALLEL STRUCTURE
FACET SHIFT ALGORITHM BASED ON MINIMAL DISTANCE IN SIMPLIFICATION OF BUILDINGS WITH PARALLEL STRUCTURE GE Lei, WU Fang, QIAN Haizhong, ZHAI Renjian Institute of Surveying and Mapping Information Engineering
More informationAUTOMATIC CARICATURE GENERATION BY ANALYZING FACIAL FEATURES
Appear in Proceeding of 2004 Asia Conference on Computer Vision (ACCV2004), Korea, 2004 AUTOMATIC CARICATURE GENERATION BY ANALYZING FACIAL FEATURES Pei-Ying Chiang Wen-Hung Liao Tsai-Yen Li National Chengchi
More informationThe Study and Implementation of Text-to-Speech System for Agricultural Information
The Study and Implementation of Text-to-Speech System for Agricultural Information Huoguo Zheng 1,2,*, Haiyan Hu 1,2, Shihong Liu 1,2, and Hong Meng 1,2 1 Agricultural Information Institute, Chinese Academy
More informationView-dependent fast real-time generating algorithm for large-scale terrain
Procedia Earth and Planetary Science 1 (2009) 1147 Procedia Earth and Planetary Science www.elsevier.com/locate/procedia The 6 th International Conference on Mining Science & Technology View-dependent
More informationWarping and Morphing. Ligang Liu Graphics&Geometric Computing Lab USTC
Warping and Morphing Ligang Liu Graphics&Geometric Computing Lab USTC http://staff.ustc.edu.cn/~lgliu Metamorphosis "transformation of a shape and its visual attributes" Intrinsic in our environment Deformations
More informationMesh Morphing. Ligang Liu Graphics&Geometric Computing Lab USTC
Mesh Morphing Ligang Liu Graphics&Geometric Computing Lab USTC http://staff.ustc.edu.cn/~lgliu Morphing Given two objects produce sequence of intermediate objects that gradually evolve from one object
More informationA Retrieval Method for Human Mocap Data Based on Biomimetic Pattern Recognition
UDC 004.65, DOI: 10.98/CSIS1001099W A Retrieval Method for Human Mocap Data Based on Biomimetic Pattern Recognition Xiaopeng Wei 1, Boxiang Xiao 1, and Qiang Zhang 1 1 Key Laboratory of Advanced Design
More information3D Face Deformation Using Control Points and Vector Muscles
IJCSNS International Journal of Computer Science and Network Security, VOL.7 No.4, April 2007 149 3D Face Deformation Using Control Points and Vector Muscles Hyun-Cheol Lee and Gi-Taek Hur, University
More informationJournal of Applied Research and Technology ISSN: Centro de Ciencias Aplicadas y Desarrollo Tecnológico.
Journal of Applied Research and Technology ISSN: 1665-6423 jart@aleph.cinstrum.unam.mx Centro de Ciencias Aplicadas y Desarrollo Tecnológico México Singla, S. K.; Yadav, R. K. Optical Character Recognition
More informationFACIAL ANIMATION WITH MOTION CAPTURE BASED ON SURFACE BLENDING
FACIAL ANIMATION WITH MOTION CAPTURE BASED ON SURFACE BLENDING Lijia Zhu and Won-Sook Lee School of Information Technology and Engineering, University of Ottawa 800 King Edward Ave., Ottawa, Ontario, Canada,
More informationStudy on Gear Chamfering Method based on Vision Measurement
International Conference on Informatization in Education, Management and Business (IEMB 2015) Study on Gear Chamfering Method based on Vision Measurement Jun Sun College of Civil Engineering and Architecture,
More informationPose Space Deformation A unified Approach to Shape Interpolation and Skeleton-Driven Deformation
Pose Space Deformation A unified Approach to Shape Interpolation and Skeleton-Driven Deformation J.P. Lewis Matt Cordner Nickson Fong Presented by 1 Talk Outline Character Animation Overview Problem Statement
More informationOptical Character Recognition Based Speech Synthesis System Using LabVIEW
Optical Character Recognition Based Speech Synthesis System Using LabVIEW S. K. Singla* 1 and R.K.Yadav 2 1 Electrical and Instrumentation Engineering Department Thapar University, Patiala,Punjab *sunilksingla2001@gmail.com
More informationMatching. Compare region of image to region of image. Today, simplest kind of matching. Intensities similar.
Matching Compare region of image to region of image. We talked about this for stereo. Important for motion. Epipolar constraint unknown. But motion small. Recognition Find object in image. Recognize object.
More informationAdaptive Zoom Distance Measuring System of Camera Based on the Ranging of Binocular Vision
Adaptive Zoom Distance Measuring System of Camera Based on the Ranging of Binocular Vision Zhiyan Zhang 1, Wei Qian 1, Lei Pan 1 & Yanjun Li 1 1 University of Shanghai for Science and Technology, China
More information2 Proposed Methodology
3rd International Conference on Multimedia Technology(ICMT 2013) Object Detection in Image with Complex Background Dong Li, Yali Li, Fei He, Shengjin Wang 1 State Key Laboratory of Intelligent Technology
More information3-D Morphing by Direct Mapping between Mesh Models Using Self-organizing Deformable Model
3-D Morphing by Direct Mapping between Mesh Models Using Self-organizing Deformable Model Shun Matsui Ken ichi Morooka Hiroshi Nagahashi Tokyo Institute of Technology Kyushu University Tokyo Institute
More informationHuman body animation. Computer Animation. Human Body Animation. Skeletal Animation
Computer Animation Aitor Rovira March 2010 Human body animation Based on slides by Marco Gillies Human Body Animation Skeletal Animation Skeletal Animation (FK, IK) Motion Capture Motion Editing (retargeting,
More informationFusion of 3D B-spline surface patches reconstructed from image sequences
Fusion of 3D B-spline surface patches reconstructed from image sequences Roger Mohr ChangSheng Zhao Gautier Koscielny LFA-NR A 46 Avenue FBlix Viallet 38031 Grenoble cedex France Abstract This paper considers
More informationRestricted Nearest Feature Line with Ellipse for Face Recognition
Journal of Information Hiding and Multimedia Signal Processing c 2012 ISSN 2073-4212 Ubiquitous International Volume 3, Number 3, July 2012 Restricted Nearest Feature Line with Ellipse for Face Recognition
More informationComputers and Mathematics with Applications. An embedded system for real-time facial expression recognition based on the extension theory
Computers and Mathematics with Applications 61 (2011) 2101 2106 Contents lists available at ScienceDirect Computers and Mathematics with Applications journal homepage: www.elsevier.com/locate/camwa An
More informationTracking facial features using low resolution and low fps cameras under variable light conditions
Tracking facial features using low resolution and low fps cameras under variable light conditions Peter Kubíni * Department of Computer Graphics Comenius University Bratislava / Slovakia Abstract We are
More informationA Visualization Tool to Improve the Performance of a Classifier Based on Hidden Markov Models
A Visualization Tool to Improve the Performance of a Classifier Based on Hidden Markov Models Gleidson Pegoretti da Silva, Masaki Nakagawa Department of Computer and Information Sciences Tokyo University
More informationAnalysis of fluid-solid coupling vibration characteristics of probe based on ANSYS Workbench
Analysis of fluid-solid coupling vibration characteristics of probe based on ANSYS Workbench He Wang 1, a, Changzheng Zhao 1, b and Hongzhi Chen 1, c 1 Shandong University of Science and Technology, Qingdao
More informationImage Morphing. Application: Movie Special Effects. Application: Registration /Alignment. Image Cross-Dissolve
Image Morphing Application: Movie Special Effects Morphing is turning one image into another (through a seamless transition) First movies with morphing Willow, 1988 Indiana Jones and the Last Crusade,
More informationResearch on Evaluation Method of Video Stabilization
International Conference on Advanced Material Science and Environmental Engineering (AMSEE 216) Research on Evaluation Method of Video Stabilization Bin Chen, Jianjun Zhao and i Wang Weapon Science and
More informationAN WIRELESS COLLECTION AND MONITORING SYSTEM DESIGN BASED ON ARDUINO. Lu Shaokun 1,e*
Advanced Materials Research Online: 2014-06-25 ISSN: 1662-8985, Vols. 971-973, pp 1076-1080 doi:10.4028/www.scientific.net/amr.971-973.1076 2014 Trans Tech Publications, Switzerland AN WIRELESS COLLECTION
More informationStereo Vision Image Processing Strategy for Moving Object Detecting
Stereo Vision Image Processing Strategy for Moving Object Detecting SHIUH-JER HUANG, FU-REN YING Department of Mechanical Engineering National Taiwan University of Science and Technology No. 43, Keelung
More informationAn algorithm of lips secondary positioning and feature extraction based on YCbCr color space SHEN Xian-geng 1, WU Wei 2
International Conference on Advances in Mechanical Engineering and Industrial Informatics (AMEII 015) An algorithm of lips secondary positioning and feature extraction based on YCbCr color space SHEN Xian-geng
More informationHuman Body Shape Deformation from. Front and Side Images
Human Body Shape Deformation from Front and Side Images Yueh-Ling Lin 1 and Mao-Jiun J. Wang 2 Department of Industrial Engineering and Engineering Management, National Tsing Hua University, Hsinchu, Taiwan
More informationHole repair algorithm in hybrid sensor networks
Advances in Engineering Research (AER), volume 116 International Conference on Communication and Electronic Information Engineering (CEIE 2016) Hole repair algorithm in hybrid sensor networks Jian Liu1,
More informationA face recognition system based on local feature analysis
A face recognition system based on local feature analysis Stefano Arca, Paola Campadelli, Raffaella Lanzarotti Dipartimento di Scienze dell Informazione Università degli Studi di Milano Via Comelico, 39/41
More informationMotion Synthesis and Editing. Yisheng Chen
Motion Synthesis and Editing Yisheng Chen Overview Data driven motion synthesis automatically generate motion from a motion capture database, offline or interactive User inputs Large, high-dimensional
More informationTime Stamp Detection and Recognition in Video Frames
Time Stamp Detection and Recognition in Video Frames Nongluk Covavisaruch and Chetsada Saengpanit Department of Computer Engineering, Chulalongkorn University, Bangkok 10330, Thailand E-mail: nongluk.c@chula.ac.th
More informationImage Edge Detection
K. Vikram 1, Niraj Upashyaya 2, Kavuri Roshan 3 & A. Govardhan 4 1 CSE Department, Medak College of Engineering & Technology, Siddipet Medak (D), 2&3 JBIET, Mpoinabad, Hyderabad, Indi & 4 CSE Dept., JNTUH,
More informationLip Tracking for MPEG-4 Facial Animation
Lip Tracking for MPEG-4 Facial Animation Zhilin Wu, Petar S. Aleksic, and Aggelos. atsaggelos Department of Electrical and Computer Engineering Northwestern University 45 North Sheridan Road, Evanston,
More informationSkeleton-based Template Retrieval for Virtual Maize Modeling
Journal of Computational Information Systems6:5(2010) 1577-1582 Available at http://www.jofcis.com Skeleton-based Template Retrieval for Virtual Maize Modeling Boxiang XIAO 1,2, Chunjiang ZHAO 1,2,, Xinyu
More informationTowards Audiovisual TTS
Towards Audiovisual TTS in Estonian Einar MEISTER a, SaschaFAGEL b and RainerMETSVAHI a a Institute of Cybernetics at Tallinn University of Technology, Estonia b zoobemessageentertainmentgmbh, Berlin,
More informationAn Automatic 3D Face Model Segmentation for Acquiring Weight Motion Area
An Automatic 3D Face Model Segmentation for Acquiring Weight Motion Area Rio Caesar Suyoto Samuel Gandang Gunanto Magister Informatics Engineering Atma Jaya Yogyakarta University Sleman, Indonesia Magister
More informationStereo pairs from linear morphing
Proc. of SPIE Vol. 3295, Stereoscopic Displays and Virtual Reality Systems V, ed. M T Bolas, S S Fisher, J O Merritt (Apr 1998) Copyright SPIE Stereo pairs from linear morphing David F. McAllister Multimedia
More information