4.562/4.502 Spring 2015 Architecture in Motion Graphics Prepared by: Takehiko Nagakura Last revised:

Size: px

Start display at page:

Download "4.562/4.502 Spring 2015 Architecture in Motion Graphics Prepared by: Takehiko Nagakura Last revised:"

Hillary Cross
6 years ago
Views:

1 4.562/4.502 Spring 2015 Architecture in Motion Graphics Prepared by: Takehiko Nagakura Last revised: Lab Session Note for Blue Background Shooting Session: Camcorder Work Flow * The blue paragraphs are the portions describing the process of using our high-end CANON camcorders. 0. Introduction (key assumptions and recommendations) 1. The final composite film will be 640x480 pixels, square pixel, 30 fps and progressive scan. 2. We will use AVCHD camcorders. Their media uses a format different from our final composite film. Therefore, pixel size, pixel aspect ratio, and frame rate need conversion, and interlaced footages need de-interlaced to progressive scan format. Alternatively, you may use HDV or DV camcorder but they come with lower quality. 3. It is recommended to capture and process a short live video segment at a time. A segment shorter than 60 seconds per video clip is recommended. A segment less than 20 seconds is ideal. Longer segments will be difficult to handle with the setup we have. If you like to make a long sequence, think about breaking it down to shorter segments that later assemble to a longer composition in Premiere. 4. Current 64-bit version of 3DS Max 2012 does not directly read or write QuickTime movie format. (32-bit version is OK.) Use of 3DS Max 64-bit 2013 or later is recommended. If you have a camcorder, digital camera, cell phone or any other video recording device that you want to use, check the video formats it can produce. If they include one of the formats listed below, follow the downloading/conversion instructions in this handout. Otherwise, you need to figure out appropriate settings for your device. The formats this handout describes follow. A. AVCHD 1080i30 (60i) and AVCHD 1080p x1080 (max) 16:9 image aspect ratio fps interlaced: 1080i30 (60i), or progressive: 1080pf30 codec: MPEG-4 AVC/H.264 common media and interface: built-in flash memory, SDHC card, USB cables CRON has two Canon VIXIA HF S21 camcorders for your checkout. It has 64-GB built-in flash memory, but I suggest you to buy an 8 Gb SDHC card of Class 4, 6, or 10 (which costs about $10). SDHC card of up to 32 Gb uses FAT32 file system and is limited to maximum file size of 4 Gb. (64Gb card is not recommended.) An 8 GB card records 40 min. at the maximum quality. Use of progressive format (1080p30) instead of interlaced format (1080i30) is recommended for this assignment. Many AVCHD camcorders today do only 1080i30 (60i) format which is fine for this assignment, too. B. HDV 1080i30 (60i) 1440x1080 pixels (max) 16:9 image aspect ratio fps interlaced codec: MPEG-2 common media and interface: mini-dv tape, Firewire cable (T. Nagakura) camcorder-workflow-1 MIT

2 CRON has one Sony HDR HC7 camcorder for your checkout, but it may be under repair now. You need to get a mini-dv tape to use it. Many camcorders two to five years old use this format. C. DV (a.k.a. SDV) 720x480 pixels (max) 4:3 image aspect ratio fps interlaced codec: DV (25Mbits per second) common media and interface: mini-dv tape, FireWire cable. The department has one Sony TRV950 camcorder. Many old camcorders use this format. I recommend use of them only if you have no other options, for its image resolution is low. Basic Work Flow Live Video: fps A. AVCHD 1080i (1920 x 1080, 16:9, interlaced) AVCHD 1080p (1920 x 1080, 16:9, wrapped progressive) B. HDV 1080i (1440 x 1080, 16:9, interlaced) C. DV (720x480, 4:3, interlaced) 1 <video capture/download> Premiere CS5 2 <format conversion> 3 <format conversion> AB. QuickTime H.264: de-interlaced (1280 x 720, 16:9 in 1280 x 960 4:3 letter box) C. QuickTime H.264: de-interlaced (640x480, 4:3) A. JPEG: de-interlaced (1920 x 1080, 16:9) B. JPEG: de-interlaced (1440 x 1080, 16:9) C. JPEG: de-interlaced (720x480, 4:3) 4 Without Motion Tracking <template background> SynthEyes: motion tracking 5 MAX Script: camera path data 6 3DS (32-bit version): rendering 7 QuickTime H.264/PNG: 640 x 480 (4:3) <compositing source> 8 <compositing source> With Motion Tracking Premiere CS5: video compositing 12 QuickTime H.264/PNG: 640 x 480 (4:3) <final movie> (T. Nagakura) camcorder-workflow-2 MIT

1. Live Shooting By default, the camera uses auto-focus and auto-exposure which I recommend to disable for blue screen session. We adjust exposure manually to keep the background blue steady.

3 1. Live Shooting By default, the camera uses auto-focus and auto-exposure which I recommend to disable for blue screen session. We adjust exposure manually to keep the background blue steady. Manual focusing allows easier focusing on non-center location of the figure/prop that you use for video compositing. [Canon VIXIA HF S21 with AVCHD 1080i30 (60i) or 1080p30 format] 1a-S21. Turn on S21 and reset menus If you have your own SDHC card, install it while power is off. Press the power button to start. This camera uses a touch screen interface. First, make sure to reset all what someone set up last time. (LCD) > FUNC. > (System Setup) > Reset All > Yes Power Button You can record into camera s built-in flash memory or a removable SDHC card. Select a media you want Default is built-in flash memory. (LCD) > FUNC. > (Recording & Connections Setup) > Rec Media for Movies: Btuilt-in Mem. or Mem. Card A/B If the memory in the media is full of previous video files, you can clear them all as below. This operation is undoable. (LCD) > FUNC. > (System Setup) > Initialize > Btuilt-in Mem. or Mem. Card A/B SDHC card 1b-S21. Setting Recording Format and Quality (LCD) > FUNC. > (Recording & Connections Setup) > Recording Mode > MXP: , 24 Mbps. You should use this highest quality. Other available options are FXP ( , 17 Mbps) XP+ ( , 12 Mbps) SP ( , 7 Mbps) LP ( , 5 Mbps) 1c-S21. Setting Frame Rate The default frame rate is 60i, which is interlaced 30 fps. This works fine for us and is compatible with many other devices. This camera also can do a special progressive 30 fps video encoded in interlaced file format. This format is recommended for this assignment, but the captured video may not be compatible for other purposes. (LCD) > FUNC. > (Recording & Connections Setup) > Frame Rate: set to PF30 (default is 60i) 1d-S21. Setting Manual Exposure and Manual Focus To manually adjust exposure and focus in menus, do below. (LCD) > FUNC. > Exposure > M > Scroll Up/Down (T. Nagakura) camcorder-workflow-3 MIT

When turned on, turning the dial changes exposure/focus. After assignment, pressing CUSTOM button turns the manual mode 1d-S21.

4 (LCD) > FUNC. > Focus > MF > Touch and hold You can also use the CUSTOM dial button. By default, this dial button is assigned to change focus. To assign exposure to the button, press and hold CUSTOM button for 2 seconds, turn the dial to select exposure from the list of icons, and press CUSTOM button again. (exposure/focus) on and off. When turned on, turning the dial changes exposure/focus. After assignment, pressing CUSTOM button turns the manual mode 1d-S21. Disabling Stabilizer If you are motion-tracking with SynthEyes, it may be better to turn off the camera s antihandshaking function (stabilizer). We have not tested this much, so see the page 65 of the camera s manual. (LCD) > FUNC. > Image Stabilizer: Set this off (Default is Dynamic. You may also try Standard.) Also, make sure to turn off Powered IS mode if it is on. This turns on when you press the Powered IS button located to the left of LCD panel with yellow indicator icon in the LCD panel. (See page 65 of the manual). 1e-S21. Attach wide angle lens CRON has 0.45 wide angle lens that you can check out. If needed, slide the lens clockwise to attach it to the body of camera. [Sony HDR HC7 with HDV 1080i30 (60i) format] 1a-HC7. Turn on HC7 In the following, I assume you have the camera s LCD panel open and the camera s power is switched on to the CAMERA function by sliding the power switch clock-wise repeatedly and turning on the CAMERA-TAPE display on the screen. Screen menus operate by your touching on them. 1b-HC7. Rest menus (1) Press and hold the MANUAL button for several seconds. The DIAL SET menu appears on the LCD screen. (2) Rotate the CAM CTRL dial and select RESET CAM CTRL Dial MANUAL button 1c-HC7. Switch to HDV recording LCD screen > P-MENU > MENU > STANDARD SET > REC FORMAT > HDV1080i 1c-HC7. Manual exposure, manual focus, and assigning the dial to manual exposure (1) Manual Exposure (two methods) LCD screen > P-MENU > MENU > CAMERA SET > EXPOSURE > MANUAL (T. Nagakura) workflow-camcorder-4 MIT

> use [+] and [-] to adjust exposure Press the MANUAL button > Rotate the CAM CTRL dial to EXPOSURE > use [+] and [-] to adjust exposure (2) Manual Focus (two methods) LCD screen > Touch P-MENU >

Use wide angle lens attachment (if needed) available from class TA [Sony DCR-TRV950 with DV format] 1a-TRV950.

5 > use [+] and [-] to adjust exposure Press the MANUAL button > Rotate the CAM CTRL dial to EXPOSURE > use [+] and [-] to adjust exposure (2) Manual Focus (two methods) LCD screen > Touch P-MENU > MENU > CAMERA SET > FOCUS > touch [ ] or [ ] to sharpen the focus Press the MANUAL button > Rotate the CAM CTRL dial to FOCUS > touch [ ] or [ ] to sharpen the focus 1d-HC7. Use wide angle lens attachment (if needed) available from class TA [Sony DCR-TRV950 with DV format] 1a-TRV950. Turn on TRV950 In the following, I assume you have the camera s LCD panel open and the camera s power switch is set to the CAMERA position. 1b-TRV950. Manual exposure Slide the AUTO LOCK selector to the center position. Press EXPOSURE button. Turn the DIAL CONTROL to set to manually adjust the exposure. To hold the EXPOSURE manually set, slide the AUTO LOCK selector to HOLD. To cancel the EXPOSURE manually set, slide the AUTO LOCK selector to AUTO LOCK. You can use the ZEBRA pattern that indicates the overexposed area. To show the ZEBRA pattern, slide the ZEBRA indicator to 70. The ZEBRA pattern will not be recorded. 1c-TRV950. Manual Focus Slide the FOCUS selector to MAN and turn the focus ring to sharpen focus. 1d-TRV950. Use wide angle Llens attachment (if needed) available from class TA. 2. Capturing Video / Connecting Camcorder to PC (T. Nagakura) workflow-camcorder-5 MIT

6 [Canon VIXIA HF S21 with AVCHD 1080i30 (60i) or 1080p30 format] 2a-S21. Method 1: Download from CanonS21 via USB Connect the camera and a computer with a USB-Mini cable, and turn on the camera Press Camera/Play button > Computer/Printer In you computer, you will find the camera s built-in flash memory attached just like an external hard drive. In the finder, check the following directory for the video files. If the camera also has SDHC card installed, your computer will show that under another drive letter. My Computer > CANON (L: or another drive letter) > AVCHD > BDMV > STREAM > ****.MTS You can directly copy these files to your computer's local hard disk drive. The AVCHD video files get.mts suffix (an MPEG-4 variant). 2b-S21. Method 2: Download from CanonS21 via SDHC card If your laptop has an SD/SDHC card reader and you used SDHC card for video recording, you can remove the SDHC card from the camera and insert it into your computer to download vide files. [Sony HDR HC7 with HDV 1080i format] 2a-HC7. Connect HC7 and a PC in the PC classroom White FireWire cable (FW800 to FW400 mini connection) is available from the class TA. Do NOT lose this cable! 2b-HC7. Make sure to turn off the option, ilink Conv. in the screen menu. [IMPORTANT!] If this option is on, the camera will output low resolution SDV format. On LCD screen > P-MENU > MENU > STANDARD SET > VCR HDV/DV > i.link CONV > OFF [Sony DCR-TRV950 with DV format] 2a-TRV950. Connect TRV950 to a PC. You can use any PC/laptop that has a FireWire interface. Use a FireWire cable (not a USB cable) to connect the camera (the DV socket in the right front panel) and a PC. 1b-TRV950. Set the camera to VCR function Just turn the camera s power switch to VCR position. 2b-TRV950. Downloading Most likely, the PC will detect the camcorder connection and asks you what you want to do. But a recommended method is to choose Take no action at this time, proceed to the sections below, and use Premiere (T. Nagakura) workflow-camcorder-6 MIT

7 3. Capturing Video / Downloading Digital Video File in Premiere CS5 Start Premiere and set up your project as below. General tab>capture Format: HDV [Canon S21 with AVCHD] HDV [Sony HC7 with HDV format] DV [Sony TRV950 with DV format] Scratch Disks tab: Captured Video: C:\scratch or tmp Captured Audio: C:\scratch or tmp Video Previews: C:\scratch or tmp Audio Previews: C:\scratch or tmp Location: make your directory as in C:\scratch or tmp\[yourname] and set the location to the directory. Name: any name you want for the project file. After clicking OK, new dialog comes up. [Canon S21 with AVCHD] Sequence Presets tab: AVCHD>1080p>AVCHD 1080p30 or 1080i>AVCHD 1080i30 (60i) (Use 1080i30 if video was shot without PF30 option, or use 1080p30 if shot with PF30 option) General tab: It should look like this. (Just double-check.) Editing Mode: AVCHD 1080i Square Pixel or AVCHD 1080p Square Pixel Timebase: Frame Size: 1920 (horizontal), 1080 (vertical) Pixel Aspect Ratio: Square Pixel (1.0) [Sony HC7 with HDV format] Sequence Presets tab: HDV>HDV 1080i30 (60i) General tab: It should look like this. (Just double-check.) Editing Mode: HDV 1080i Timebase: Frame Size: 1440 (horizontal), 1080 (vertical) Pixel Aspect Ratio: HD Anamorphic 1080 (1.333) [Sony TRV950 with DV format] Sequence Presets tab: DV-NTSC Standard 48Khz General tab: It should look like this. (Just double-check.) Editing Mode: DV NTSC Timebase: Frame Size: 720 (horizontal), 480 (vertical) Pixel Aspect Ratio: D1/DVNTSC (0.9091) If your camera (Sony HC7 with HDV, or Sony TRV950 with DV) uses a mini-dv tape, you need to go the capture menu now. Skip this process for Canon S21 with AVCHD, and you use the digital file copied directly from the camera as the previous section described in detail. (Premiere)>File>Capture Settings tab> (T. Nagakura) workflow-camcorder-7 MIT

8 Capture Settings: This should show HDV [Sony HC7 with HDV] DV [Sony TRV950 with DV] Device Control>Options: Device Brand: set to Canon [Canon S21 with AVCHD] Sony [Sony HC7 with HDV] Sony [Sony TRV950 with DV] Device Type: set to Standard Camera is now controlled by the computer. Use the controller buttons (usual arrow marks underneath the preview window) to find the starting position of the portion you want to record. Use the red recording button to capture. Capturing a segment shorter than 30 seconds at a time is recommended for this assignment. When you stop recording, provide a filename and it shows up in your project window. Go to the desktop and check that the captured video file is in your directory. At this point, the downloaded video files should have one of the following suffixes..mts [Canon S21 with AVCHD].mpeg [Sony HC7 with HDV].avi [Sony TRV950 with DV] 4. Converting to progressive/low resolution QuickTime File in Premiere For video compositing operations in Premiere, we will make a de-interlaced (progressive) video with square pixels and 30 fps, and save in QuickTime H.264 format. Also, we will use a resolution low enough for your archive and high enough for video Composite operation. This file is also useful for putting in the 3DS viewport background as template. [TN note only] Place the.mpeg file from the Project window into the timeline. Right-click the placed clip in the timeline and go to Field Options: turn on Always De-interlace. [TN note only] File>Import: find and select the first frame (frame 0000) of the JPEG images you created. And make sure to turn on Numbered Stills option just above the File Name display. [Continuing from the previous capturing session in Premiere] If you used Capture window for downloading from a mini-dv tape, close it. In the Project window, the live video you just captured has an entry. If you used Canon S21 with AVCHD, drag your video file (that you copied into the local hard disk) into Project window. The video file entry in Project window should show as frame rate. (You may need to enlarge the Project window to see this.) To convert it to 30 fps, Right-click the video entry>modify>interpret Footage>Assume This Frame Rate: set to 30 fps After OK ing this, 30 fps should appear as the frame rate of this video clip in the Project window. Keep the video entry selected in the Project window and go to, (T. Nagakura) workflow-camcorder-8 MIT

$File>Export>Media Export Setting>Format: QuickTime Output Name: click the default name and make sure to specify a filename as in C:\Scratch or tmp\[yourname]\[filename you want] Video> Video Code: H.$

9 File>Export>Media Export Setting>Format: QuickTime Output Name: click the default name and make sure to specify a filename as in C:\Scratch or tmp\[yourname]\[filename you want] Video> Video Code: H.264 Quality: Set to 100. This makes a large best-quality file. If you want to save your disk space, you can reduce this value down to 60 or so, but compositing would be easier with best quality. (You need to unlock the lock icon to type in both Width and Height values as below.) Width: 1280, Height: 960 [Canon S21 with AVCHD] Width: 1280, Height: 960 [Sony HC7 with HDV] Width: 640, Height: 480 [Sony TRV950 with DV] Field Type: progressive (this will de-interlace the video) Maximum Render Quality: turning this on takes long computation time but recommended to get a high quality de-interlacing. Frame Rate: 30 fps (not 29.97!) Aspect Ratio: Square Pixels (1.0) (make sure to choose this one!) Bit Rate Settings: Make sure to turn off Limit Data Rate To option. Click Export button when all parameters are set as above. Go to the desktop and check the QuickTime H.264 movie file created. For Canon S21 and Sony HC7, this setting produces a video clip of size 1280 x 960 (4:3) that has black margins on top and bottom. The area excluding those margins is sized to 1280 x 720 (16:9) pixels. For Sony TRV950, this setting produces a video clip of size 640 x 480 (4:3). In all cases, the video now uses square pixels and no anamorphic encoding. Make sure to keep this QuickTime H.264 movie clip for your later operations in Premiere and/or 3DS Max (T. Nagakura) workflow-camcorder-9 MIT

Introduction to Using the Canon VIXIA HFM31

Introduction to Using the Canon VIXIA HFM31 Video Formats and Approximate Record Times Memory è Recording Mode ê MXP (High- quality) 24 Mbps 1920 x 1080 resolution; 30 fps FXP (High- quality) 17 Mbps 1920