M.S. in Information and Communications (Feb. 2003) Gwangju Institute of Science and Technology (GIST) in Korea, Advisor: Prof.

Transcription

1 Dept. of Electrical Engineering and Computer Science, The University of Tennessee at Knoxville 327 Ferris Hall, Knoxville, Tennessee, USA, Mobile: , Office: , Fax: , Homepage: Sung-Yeol Kim Research Interests Depth image-based rendering and modeling Image enhancement using multi-modal image processing such as joint bilateral filtering Computer graphic data processing including representation, compression, and rendering 3D video contents generation with audio, video-plus-depth, and computer graphic data Education Ph. D. in Information and Communications (Aug. 2008) Gwangju Institute of Science and Technology (GIST) in Korea, Advisor: Prof. Yo-Sung Ho M.S. in Information and Communications (Feb. 2003) Gwangju Institute of Science and Technology (GIST) in Korea, Advisor: Prof. Yo-Sung Ho B.S. in Information and Telecommunications (Feb. 2001) Kangwon National University (KNU) in Korea, Advisor: Prof. Manbae Kim Employment History ~ Present Research Associate II Imaging, Robotics, and Intelligent Systems (IRIS) Lab. University of Tennessee at Knoxville in USA, Advisor: Prof. Mongi A. Abidi ~ Postdoctoral Fellow Supported by Brain Korea 21(BK21) Project Gwangju Institute of Science and Technology (GIST) in Korea ~ Invited Researcher In Realistic Broadcasting System Research Team Electronics and Telecommunication Research Institute (ETRI) in Korea ~ Research Assistant In Visual Communication Lab. Dept. of Information and Communications Gwangju Institute of Science and Technology (GIST) in Korea Project Experience Grant Preparation Experiences Research on Robotic Vision and Sensing, ~ present (US Air Force, USA) Research on Multiview Image Generation and Processing, ~ (NRF of Korea) Research on Realistic Digital Broadcasting Technology, ~ , (MIC of Korea) Project on Layered Depth Image Coding, ~ , (ETRI) Project on Multiview Video Coding, ~ , (ETRI) Project on MPEG-4 SNHC Body Animation, ~ , (ETRI) Implementation of AVI Coder and Decoder for Stereo Movies, ~ , (Soft4D Co. Ltd.) As Principal Investigator (PI) Research on Multiview Image Generation and Processing based on Wide-baseline Multiview Camera for 3D Broadcasting, National Research Foundation (NRF), Korea, 23,000,000, (2009.7~2010.6) As Co-Principal Investigator (Co-PI) Research on Multimodal Image Processing (MMIP), National Science Foundation (NSF), USA, PI: Dr. Andreas Koschan, the other co-pi: Dr. Mongi Abidi, 2011 (under review) Automated of Childhood Food Intake Using 3D Hybrid Cameras, National Institute of Health (NIH), USA, PI: Dr. Naima Moustaid-Moussa, 2011 (under revision)

2 Professional Activities Membership IEEE Member (2007~2009) Referee for the following journals IEEE Transactions on Image Processing IEEE Transactions on Circuits and Systems for Video Technology IEEE Transactions on Intelligent Transportation Systems IEEE Signal Processing Letters ELSEVIER Signal Processing Image Communication Referee for the following international conferences IEEE International Conference on Image Processing (ICIP) 2009 IEEE International Conference on Industrial Technology (ICIT) 2010 IEEE International Conference on Image Processing (ICIP) 2010 IEEE International Conference on Image Processing (ICIP) 2011 Honors and Awards Skills Patents International postdoctoral research program from the NRF of Korea (1 year, 2009~2010) Full Tuition Scholarship from Korea government for M.S. and Ph. D. courses (7 years, 2001~2007) Scholarship from BK (Brain Korea) 21 project (5 years, 2003~2007) Two best paper awards at IEEK domestic conference of Korea in 2004 and Summa cum laude graduate in collage of engineering at Kangwon National University on Feb Experience in Programming with C/C++, Visual C++, and Java Knowledge on MPEG-1, MPEG-2, MPEG-4, JM/JMVM Reference Software for Video Coding Knowledge on Operating Window/Linux Experience in Operating Time-of-flight Depth Camera, Kinect and Zcam International Patents 1. Yo-Sung Ho, Eun-Kyung Lee, Sung-Yeol Kim, Method and Apparatus for Processing a Multi-view Image, Application no. PCT/KR2010/001631, Publication no. WO/2010/107235, Yo-Sung Ho, Seung-Uk Yoon, Sung-Yeol Kim, Kukjin Yun, Sukhee Cho, Chunghyun Ahn, Sooin Lee, Method and System for Encoding/Decoding Multi-view Video Based on Layered Depth Image, Application no. PCT/KR2005/003418, Publication no. WO/2006/041261, Korean Patents 1. Yo-Sung Ho, Sung-Yeol Kim, Eun-Kyung Lee, Method and Apparatus for Processing Multi-viewpoint Image, Application no , Registration no , Yo-Sung Ho, Sung-Yeol Kim, Method and apparatus for generating depth information supplemented using depth-range camera, and recording medium storing program for performing the method thereof, Application no , Registration no , Sung-Yeol Kim, Yo-Sung Ho, Generating Method for Three-dimensional Video Formation Using Hierarchical Decomposition of Depth Image, and Device for The Same, and System and Storage Medium Therefor, Application no , Registration no , Yo-Sung Ho, Seung-Uk Yoon, Sung-Yeol Kim, A Temporal Prediction Apparatus and Method for Coding Multi-view Video based on Layer-Depth Image, Application no , Registration no , Activity for Standards MPEG Standardization 1. Yo-Sung Ho, Seung-Uk Yoon, Sung-Yeol Kim, Eun-Kyung Lee, "Complete Coding Result of

3 Layered Depth Image Frames," ISO/IEC JTC1/SC29/WG11, M13582, Yo-Sung Ho, Seung-Uk Yoon, Sung-Yeol Kim, Eun-Kyung Lee, Kugjin Yun, Daehee Kim, Namho Hur, Soo-In Lee, "Prediction Structures for the Constructed Layered Depth Image Frames," ISO/IEC JTC1/SC29/WG11, M13165, Yo-Sung Ho, Seung-Uk Yoon, Sung-Yeol Kim, Eun-Kyung Lee, Kugjin Yun, Daehee Kim, Namho Hur, Soo-In Lee, "Reconstruction of Multi-view Images from Layered Depth Images," ISO/IEC JTC1/SC29/WG11, M12849, Yo-Sung Ho, Seung-Uk Yoon, Sung-Yeol Kim, Eun-Kyung Lee, Kugjin Yun, Daehee Kim, Namho Hur, Soo-In Lee, "Generation and Coding of Layered Depth Images for Multi-view Video," ISO/IEC JTC1/SC29/WG11, M12485, Yo-Sung Ho, Seung-Uk Yoon, Sung-Yeol Kim, Eun-Kyung Lee, Seung-Hwan Kim, Kugjin Yun, Daehee Kim, Namho Hur, Soo-In Lee, "Intermediate Result on Multi-view Video Coding using Layered Depth Images," ISO/IEC JTC1/SC29/WG11, M12278, Yo-Sung Ho, Seung-Uk Yoon, Sung-Yeol Kim, Eun-Kyung Lee, "Preliminary Results for Multi-view Video Coding Using Layered Depth Image," ISO/IEC JTC1/SC29/WG11, M11916, Yo-Sung. Ho, Seung-Uk Yoon, Sung-Yeol Kim, "A Framework for Multi-view Video Coding using Layered Depth Image," ISO/IEC JTC1/SC29/WG11, M11582, Yo-Sung. Ho, Seung-Uk Yoon, Sung-Yeol Kim, Daehee Kim, Sukhee Cho, Kugjin Yun, Chunghyun Ahn, Sooin Lee, "Coding of Layered Depth Image using Coherency between Point Samples," ISO/IEC JTC1/SC29/WG11, M11279, Yo-Sung. Ho, Seung-Uk Yoon, Sung-Yeol Kim, Daehee Kim, Sukhee Cho, Kugjin Yun, Chunghyun Ahn, Sooin Lee, Multi-view Video Coding using Layered Depth Image," ISO/IEC JTC1/SC29/WG11, M11278, Publication List Dissertations Ph.D.: M.S.: Sung-Yeol Kim, Depth Map Creation and Mesh-based Hierarchical 3-D Scene Representation in Hybrid Camera System, Dept. of Information and Mechatronics, Gwangju Institute of Science and Technology (GIST), p. Advisor: Prof. Yo-Sung Ho. Sung-Yeol Kim, A Study on View-Dependent Representation of 3-D Mesh Models Using Hierarchical Partitioning, Dept. of Information and Communications. Gwangju Institute of Science and Technology (GIST), p. Advisor: Prof. Yo-Sung Ho. Book & Book Chapters 1. Yo-Sung Ho and Sung-Yeol Kim, 3DTV: 3D Image Information Processing, Doyangsa, Korea, ISBN , (Korean book) 2. Sung-Yeol Kim, Andreas Koschan, Mongi A. Abidi, and Yo-Sung Ho, Three-dimensional Video Contents Exploitation in Depth Camera-based Hybrid Camera System, as chapter 15 in High-quality visual experience: creation, processing and interactivity of high-resolution and high-dimensional video signals, M. Mrak, M. Grgic, and M. Kunt (eds.), Springer, New York, pp , International Journal Papers 1. Sung-Yeol Kim, Ji-ho Cho, Andreas Koschan, and Mongi A. Abidi, 3D Video Generation and Service based on a TOF Depth Sensor in MPEG-4 Multimedia Framework, IEEE Trans. on Consumer Electronics, vol. 56, no. 3, pp , Myung-Han Hyun, Sung-Yeol Kim, Yun-Suk Kang, and Yo-Sung Ho, Multi-view Video Matting and Compositing Using Trimap Sharing for Natural 3-D Scene Generation, International Journal of Imaging Systems and Technology, vol. 20, no. 3, pp , Sung-Yeol Kim, Eun-Kyung Lee, and Yo-Sung Ho, Generation of ROI enhanced depth maps using stereoscopic cameras and a depth camera, IEEE Trans. on Broadcasting, vol. 54, no. 4, pp , Ji-Ho Cho, Sung-Yeol Kim, Yo-Sung Ho, and Kwan H. Lee, "Dynamic 3D human actor generation method using a time-of-flight depth camera," IEEE Trans. on Consumer Electronics, vol. 54, no. 4, pp , 2008.

4 5. Sung-Yeol Kim and Yo-Sung Ho, Hierarchical decomposition of depth map sequences for representation of three-dimensional dynamic scenes, IEICE Trans. on Information and Systems, vol. E-90-D, no. 11, pp , Seung-Uk Yoon, Eun-Kyung Lee, Sung-Yeol Kim, and Yo-Sung Ho, A framework for representation and processing of multi-view video using the concept of layered depth image, Journal of VLSI Signal Processing Systems for Signal Image and Video Technology, vol. 44, no. 4, pp. 1-15, Sung-Yeol Kim, Sang-Beom Lee, and Yo-Sung Ho, Three-dimensional natural video system based on layered representation of depth maps, IEEE Trans. on Consumer Electronics, vol. 52, no. 3, pp , Jongeun Cha, Sung-Yeol Kim, Yo-Sung Ho, and Jeha Ryu, 3D video player system with haptic interaction based on depth image-based representation, IEEE Trans. on Consumer Electronics, vol. 52, no. 2, pp , International Conference Papers 1. Sung-Yeol Kim, Woon Cho, Andreas Koschan, Mongi Abidi, 'Depth Data Calibration and Enhancement of Time-of-flight Video-plus-Depth Camera, accepted for Future of Instrumentation International Workshop (FIIW), Oak Ridge, Tennessee, Sung-Yeol Kim, Woon Cho, Andreas Koschan, Mongi Abidi, Depth map enhancement using adaptive steering kernel regression based on distance transform, International Symposium and Visual Computing (ISVC), Lecture Notes in Computer Science, vol. 6938, pp , Ji-Ho Cho, Sung-Yeol Kim, and Kwan H. Lee, "MPEG-4-Based 3D Video Contents Creation Method using Time-of-Flight Sensor for 3DTV," IEEE International Symposium on Electronics in Marine (ELMAR), pp , Sung-Yeol Kim, Ji-Ho Cho, Andreas Koschan, and Mongi Abidi, Spatial and temporal enhancement of depth images captured by a time-of-flight depth sensor, IEEE International Conference on Pattern Recognition (ICPR), pp , Yo-Sung Ho, Sung-Yeol Kim, and Eun-Kyung Lee, Three-dimensional video generation for realistic broadcasting services, International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC), pp.tr1-tr4, Eun-Kyung Lee, Sung-Yeol Kim, and Yo-Sung Ho, Generation of high-resolution depth maps using stereo matching based on depth information of a depth camera, 3DTV conference (3DTV), pp , Myung-Han Hyun, Sung-Yeol Kim, and Yo-Sung Ho, Multi-view image matting and compositing using trimap sharing for natural 3-D scene generation, 3DTV conference (3DTV), pp , Yo-Sung Ho, Sung-Yeol Kim, and Eun-Kyung Lee, Hybrid camera system for 3-D realistic broadcasting services, International Conference on Embedded Systems and Intelligent Technology (ICESIT), pp , Sang-Beom Lee, Sung-Yeol Kim, and Yo-Sung Ho, Multi-view image generation from depth maps and texture images using adaptive smoothing filter, International Conference on Embedded Systems and Intelligent Technology (ICESIT), pp , Sung-Yeol Kim and Yo-Sung Ho, Mesh-based depth coding for 3D video using hierarchical decomposition of depth maps, IEEE International Conference on Image Processing (ICIP), pp , Sung-Yeol Kim, Jongeun Cha, Seung-Hyun Lee, Jeha Ryu, and Yo-Sung Ho, A 3DTV system using new depth image-based videos in the MPEG-4 multimedia framework, 3DTV conference (3DTV), paper no. 36, Yoo-Kyung Kim, Sung-Yeol Kim, and Yo-Sung Ho, Stereo matching using global and local segmentation, International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC), pp , 2007.

5 13. Young-Suk Yoon, Sung-Yeol Kim, and Yo-Sung Ho, Color data coding for three-dimensional mesh models considering connectivity and geometry information, IEEE International Conference on Multimedia & Expo (ICME), pp , Seung-Uk Yoon, Eun-Kyung Lee, Sung-Yeol Kim, Yo-Sung Ho, Kukjun Yun, Sukhee Cho, and Namho Hur, Coding of layered depth images representing multiple viewpoint video, Picture Coding Symposium (PCS), pp. 1-6, Seung-Uk Yoon, Eun-Kyung Lee, Sung-Yeol Kim, Yo-Sung Ho, Kukjun Yun, Sukhee Cho, and Namho Hur, Inter-camera coding of multi-view video using layered depth image representation, Pacific-Rim Symposium on Image and Video Technology (PSVIT), Lecture Notes in Computer Science, vol. 4261, pp , Young-Suk Yoon, Sung-Yeol Kim, and Yo-Sung Ho, Predictive coding of photometry information of three-dimensional meshes using geometry and connectivity information, International Workshop on Advanced Image Technology (IWAIT), pp. 7-12, Sung-Yeol Kim, Seung-Uk Yoon, and Yo-Sung Ho, Realistic broadcasting using multi-modal immersive media, Pacific-Rim Conference on Multimedia (PCM), Lecture Notes in Computer Science, vol. 3768, pp , Young-Suk Yoon, Sung-Yeol Kim, and Yo-Sung Ho, Photometry data coding for 3-D mesh models using connectivity and geometry information, Pacific-Rim Conference on Multimedia (PCM), Lecture Notes in Computer Science, vol. 3768, pp , Sung-Yeol Kim, Young-Suk Yoon, Seung-Man Kim, Kwan Heng Lee, and Yo-Sung Ho, Texture coordinate compression for 3-D mesh models using texture image rearrangement, Pacific-Rim Conference on Multimedia (PCM), Lecture Notes in Computer Science, vol. 3767, pp , Jongeun Cha, Seung-Man Kim, Sung-Yeol Kim, Sehwan Kim, Seung-Uk Yoon, Ian Oakley, Jeha Ryu, Kwan Heng Lee, Woontack Woo, and Yo-Sung Ho, The client system for realistic broadcasting: a first prototype, Pacific-Rim Conference on Multimedia (PCM), Lecture Notes in Computer Science, vol. 3768, pp , Seung-Uk Yoon, Eun-Kyung Lee, Sung-Yeol Kim, and Yo-Sung Ho, A framework for multi-view video coding using layered depth images, Pacific-Rim Conference on Multimedia (PCM), Lecture Notes in Computer Science, vol. 3767, pp , Sung-Yeol Kim, Seung-Uk Yoon, and Yo-Sung Ho, Spectral coding of 3-D mesh geometry information using dual graph, Pacific-Rim Conference on Multimedia (PCM), Lecture Notes in Computer Science, vol. 3331, pp , Seung-Uk Yoon, Sung-Yeol Kim, and Yo-Sung Ho, Preprocessing of depth and color information for layered depth image coding, Pacific-Rim Conference on Multimedia (PCM), Lecture Notes in Computer Science, vol. 3333, pp , Sung-Yeol Kim, Jeung-Hwan Ahn, and Yo-Sung Ho, View-dependent transmission of 3-D mesh models using hierarchical partitioning, SPIE Visual Communications and Image Processing (VCIP), pp , Seung-Uk Yoon, Sung-Yeol Kim, and Yo-Sung Ho, BAP generation for head movement based on MPEG-4 SNHC, Pacific-Rim Conference on Multimedia (PCM), pp. 1-5, Korean Journals and Magazines 1. Yo-Sung Ho and Sung-Yeol Kim 3-D TV and realistic broadcasting, Broadcasting and Technology, vol. 148, pp , Yo-Sung Ho and Sung-Yeol Kim Realistic broadcasting technology for user-friendly interaction services Magazine of The Korean Society of Broadcasting Engineers, vol. 13, no. 2, pp , Yo-Sung Ho and Sung-Yeol Kim Multimodal immersive media technology for user interaction services Magazine of Korean Information and Communication Society, vol. 24, no. 6, pp , 2007.

6 4. Sung-Yeol Kim and Yo-Sung Ho, Representation of 3-D photorealistic videos using a depth camera system Magazine of Korean Multimedia Society, vol. 10, no. 2, pp , Sang-Beom Lee, Sung-Yeol Kim and Yo-Sung Ho, Generation method of a multiview image from a depth image Magazine of The Institute of Electronics Engineers of Korea, vol. 33, no. 9, pp , Sung-Yeol Kim and Yo-Sung Ho, Three-dimensional texture coordinate coding using texture image rearrangement Journal of The Institute of Electronics Engineers of Korea, vol. 43, no. SP-6, pp , Sung-Yeol Kim, Sang-Beom Lee, Yoo-Kyung Kim and Yo-Sung Ho, Generation of multi-view images using depth map decomposition and edge smoothing Journal of The Korean Society of Broadcasting Engineers, vol. 41, no. 4, pp , Yo-Sung Ho, Seung-Uk Yoon, and Sung-Yeol Kim, Realistic broadcasting and the next-generation immersive media TTA Journal, vol. 100, pp , Yo-Sung Ho, Seung-Uk Yoon, Eun-Kyung Lee and Sung-Yeol Kim, Representation and coding technology of multiview images using layered depth image Magazine of The Institute of Electronics Engineers of Korea, vol. 32, no. 9, pp , Yo-Sung Ho, Seung-Uk Yoon, and Sung-Yeol Kim, Realistic broadcasting technology using multimodal immersive media Magazine of The Korean Information Display Society, vol. 6, no. 6, pp , Seung-Uk Yoon, Sung-Yeol Kim, and Yo-Sung Ho, Preprocessing of depth information for layered depth image coding Journal of The Korean Society of Broadcasting Engineers, vol. 9, no. 3, pp , Sung-Yeol Kim, and Yo-Sung Ho, Preprocessing of depth information for layered depth image coding Journal of The Korean Society of Broadcasting Engineers, vol. 9, no. 3, pp , Yo-Sung Ho and Sung-Yeol Kim Understanding on multimodal immersive media and realistic broadcasting technology, Broadcasting and Technology, vol. 108, pp , Sung-Yeol Kim, and Yo-Sung Ho, Representation of three-dimensional polygonal mesh models using hierarchical partitioning and view-dependent progressive transmission Journal of The Institute of Electronics Engineers of Korea, vol. 40, no. SP-6, pp , 2003.