Course overview. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/19

Transcription

1 Course overview Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/19

2 Logistics Meeting time: 10:20pm-1:10pm, Tuesday (17 weeks, no holiday this semester, :<) Classroom: CSIE Room 104 Instructor: Yung-Yu Chuang Teaching assistants: TBD Textbook: Readings from books, journals and proceedings. Webpage: (user name/password) Mailing list: subscribe via

3 This course is NOT about

4 It isn t about photography

5 It isn t about 3D animations

6 It isn t about watching movies

7 It isn t about physical effects

8 It s not about industrial tricks You will learn more about Taylor and Poisson than Lucas and Spielberg in this course. If you hear Lucas in the class, it is more likely to refer to Bruce Lucas, not George Lucas. computer vision computer graphics image processing

9 Prerequisites It is a must that you have programming experiences. It is a must that you have basic knowledge on linear algebra and probability. It is a plus if you have background knowledge on computer vision, image processing and computer graphics. It is a plus if you have access to digital cameras and camcorders.

10 This course is about

11 Digital Visual Effects?

12 Reality?

13 Retouching

14 Iraq War, LA Times, April 2003 Digital photomontage

15 Bush campaign s TV AD, 2004

16 Texture synthesis and inpainting

17 Domestic example The Liberty Times

18 Special effects

19 Stop action The execution of Mary, 1895

20 Glass shot

21 Rear projection stop motion King Kong, 1933

22 Special effects (make-up)

23 Special effects (physical effects)

24 Special effects (miniature)

25 Special effects (matte painting)

26 Lord of the Rings

27 Illusion - forced perspective

28 Computer-generated model

29 Production pipeline

30 Production pipeline Preproduction Production Effects Storyboard Artwork Reference Stills Plates Post-production VFX Editing Music Sound Film

31 Preproduction Storyboard

32 Preproduction Artwork

33 Preproduction Reference & Research

34 Production Shooting

35 Post-production

36 Visual effects production Preproduction Production Effects Storyboard Artwork Reference Stills Plates Post-production Scanning Matchmove and Matchmodel Model Geometry Skeleton Textures Skinning Materials Effects Animation Lighting and Rendering Character Animation Assets Compositing Film Recording Shots

37 Visual effects post-production

38 A case study

39 405: The Movie This movie were created solely by two visual effects artists in the year of It was a process that took over three months of nights, weekends and any spare moments that they could find.

40 Making of 405 Step 0: script and shooting plan

41 Making of 405 Step 1: shooting two days with a Canon Optura DV camera with progressive mode. a 70-minute raw footage initial editing pickup shots

42 Making of 405 Step 2: building CG world total 62 shots, 42 enhanced with digital VFX. 19 shots are entirely digital creations. plane, two cars, freeway background are digital photo-based 3D environment

43 Making of 405 Real cars were used for close-up and interior shots A low-resolution mesh scanned by a cyberscanner. Mapped with photographs.

44 Making of 405 DC-10 plane took a month to model in details for the needs of close-up shots. 59 objects, 142,439 polygons reference modeling material painting

45 Making of 405 Step 3: traffic clearing clean plate close-up shots inpainting

46 Making of 405 Step 4: compositing shot with the vehicle standing still in a backyard

47 Making of 405

48 Making of 405 Step 5: fine touchup 3D hat compositing and inpainting

49 Making of 405 Step 6: music and delivery

50 Bloody Omaha

51 Topics we plan to cover

52 Camera Canon 10D

53 High dynamic range imaging/display

54 Image warping/morphing someone not that famous someone very famous video

55 Image warping/morphing

56 Tracking Feature tracking

57 Image stitching

58 MatchMove Move matching using scene planes

59 Matchmove Move matching using scene planes

60 Matchmove Move matching using scene planes

61 Photo tourism

62 Video matching Matrix MOCO (Motion control camera)

63 Video matching Video matching

64 Matting and compositing Titanic

65 Matting

66 Object selection LazySnapping

67 Image manipulation GraphCut Texture

68 Image manipulation Poisson blending

69 Image-based modeling photogrammetric modeling and projective texture-mapping

70 Image-based modeling photogrammetric modeling and projective texture-mapping

71 Image-based modeling photogrammetric modeling and projective texture-mapping

72 Image-based modeling Tour into a picture

73 Image-based modeling Tour into a picture

74 3D photography (active) Cyberware whole body scanner

75 3D photography (active) Photometric stereo

76 3D photography (passive) left right Stereo depth

77 Image-based rendering Surface lightfield

78 View interpolation Bullet time video

79 View interpolation High-Quality Video View Interpolation

80 Making face Gollum Spacetime face

81 Video rewrite Trainable videorealistic speech animation

82 Inpainting (wire removal) Inpainting

83 Texture synthesis/replacement Texture replacement

84 Semi-automatic matting painting Image analogies

85 Video editing Flow-based video editing

86 Grading 3 programming assignments (50%) HDR Imaging AutoStitch MatchMove Class scribe (8%) Class participation (6%) Final project (36%) Research System Film

87 High dynamic range imaging

88 From last semester ( 鄭逸廷陳柏叡 )

89 From last semester ( 吳侑親, 張書瑋 )

90 From last semester ( 王瑋馥, 余雁雲 )

91 AutoStitch

92 From last semester 鄭逸廷陳柏叡 李佳燕黃政基

93 MathMove 梁家愷鐘志遠 姜任遠林立峯 楊宗碩林柏劭 翁憲政洪韶憶

94 Final projects from a similar course in Georgia Tech.

95 Life in Paints Life in Paints, GaTech DVFX 2003

96 Tour into pictures Making of Life in Paints

97 In Your Face In Your Face, GaTech DVFX 2002

98 Stop action Making of In Your Face

99 Tennis Tennis, GaTech DVFX 2007

100 MatchMove/CGI Making of Tennis

101 Final projects from the past.

102 YoYo Flight

103 Making of YoYo Flight

104 That s it for today! Don t forget to subscribe the mailing list. Check out the course website.