Tracker Manual Documentation Version: 1.3.58.m08 2007 GestureTek Inc. 317 Adelaide Street West, Toronto, Ontario, M5V 1P9 Canada Web: http://www.gesturetek.com Email: support@gesturetek.com Phone: 416.340.9290 Fax: 416.348.9809
Table of Contents 1 Introduction 1 1.1 Copyright... and Legal Matters 2 1.2 Before You Start... 3 1.3 Opening the Tracker Console... 4 1.4 GroundFX... Editions 5 1.5 Starting/Stopping the Tracker... 6 2 Setup 8 2.1 Full Setup... 9 2.2 Select Camera... 10 CMU Camera Properties 2.2.1...11 Custom Camera Properties 2.2.2...12 DirectShow Camera Properties 2.2.3...13 Lumenera Camera Properties 2.2.4...14 PGR Dragonfly Camera 2.2.5...15 Camera Count 2.2.6...16 Multiple Cameras 2.2.7...17 Stitch 2.2.8...19 2.3 Tracking... Mode 21 2.4 Select Alignment Procedure... 22 Understanding Alignment 2.4.1...23 Manual 2.4.2...24 and Dimensions 2.4.2.1 Orientation...25 Using Manual Alignment 2.4.2.1.1...25 Accessing Options 2.4.2.1.2...25 Screen Borders 2.4.3...30 Orientation 2.4.3.1 Image...31 Border 2.4.3.2 Screen...32 Target Placement 2.4.4...34 Targets 2.4.4.1 Setting...35 Options 2.4.4.2 Advanced...40 Camera Controls 2.4.4.2.1...40 Background Model 2.4.4.2.2...40 Mask 2.4.4.2.3...40 Fill Gaps 2.4.4.2.4...40 Target Detector 2.4.4.2.5...40 Verify Camera 2.4.5...48 Camera 2.4.5.1 Adjust...49 Camera Controls 2.4.6...50 2.5 Output... 51 2.5.1...52 Unblocking when using a firewall
2.6 Finished... 53 3 Advanced Options 54 3.1 Background Model Tracking Mode... 55 3.1.1...56 Camera Controls 3.1.2...57 Background Model 3.1.3...58 Mask 3.1.4...59 Fill Gaps 3.1.5...60 Outline 3.1.6...61 Stitched 3.2 Motion Tracking Mode... 62 Camera Controls 3.2.1...63 Control 3.2.2...64 Mask 3.2.3...65 Outline 3.2.4...67 Stitched 3.2.5...68 4 Network Setup 69 4.1 Enabling... Network Communications 70 4.2 Running... Network Tracker 71 4.3 Network... Tracker Setup 72 5 Revision History Index 73 74 II
1 1 Introduction The is the motion detection component that along with the Dazzler player makes up GroundFX. This manual will help you in setting up and using the Tracker. It is organized by topic. Road Map To help you work through setup procedures, suggested follow-up topics are provided where appropriate. Look for "Continue" followed by the topic name and page number. References to other pages are denoted with special page number graphics like this:.
2 1.1 Copyright and Legal Matters GroundFX is a trademark of GestureTekTM Inc. All rights reserved. The contents of this documentation are the property of GestureTek Inc. and are for the exclusive use of registered users of GroundFX. Microsoft and Windows are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries.
3 1.2 Before You Start 1. Before attempting to run the for the first time, make sure that any cameras are connected and working properly. If not, then any attempt to run the Tracker will result in an error or it will simply stop. 2. It is essential that you set up the Tracker in an environment (placement, lighting, etc.) as close as possible to that of your intended presentation. 3. It is strongly recommended that when setting up the Tracker for the first time or if you have made significant changes to your environment or equipment, that you run Full Setup 9.
4 1.3 Opening the Tracker Console To open the console, click the Windows Start button, point to Programs or All Programs, point to GestureTek, point to GroundFX, click on. The console will appear: Note: If this is the first time you are running the, you will need to run Full Setup 9. Otherwise you may either press the "start" button or wait for the Tracker to start automatically.
5 1.4 GroundFX Editions There are three GroundFX editions currently available. Classic Provides one-camera tracking for a single projector display. Includes only Classic Play Items. Platinum Provides one-camera tracking for a single projector display. Includes all Play Items. Platinum MP Provides multi-camera tracking 17 for multiple projector displays. Includes all Play Items. To confirm your GroundFX edition, from the console 4, click the GroundFX logo. The About box will appear displaying information about your installation. If you are interested in upgrading your installation, contact your GroundFX reseller. For more information about GroundFX Play Items, see your Dazzler documentation.
6 1.5 Starting/Stopping the Tracker Starting the Tracker If the is not open, open it now. See Opening the If you have not run Full Setup yet, do so now. See Full Setup 9 4.. Start the Tracker by clicking the "start" button on the console (alternatively you can wait for the Tracker to autostart): Once the Tracker is running, the "Advanced" button will become active and the tracking rate will display. Wait until the tracking rate is displayed. If you are satisfied with the Tracker settings, you can either leave it as is on your screen or you may minimize it to your Windows System Tray. When the Tracker is minimized to the Windows System Tray, you can access its features (including Start and Stop), by right clicking its icon. Stopping the Tracker To stop the Tracker, but leave the Tracker open onscreen, from the Tracker Console, click the Stop button.
7 To close the Tracker Console either click the "X" symbol in the upper right corner of the Console, or if the Tracker Console has been minimized to the System Tray, right click it's icon and click "Close" from the menu. Note: Closing the Tracker Console stops the Tracker.
8 2 Setup From the console, you have the choice of running Full Setup 9 (necessary when setting up the Tracker for the first time) or accessing one of three setup categories. Important! If this is the first time you are setting up the Tracker, you must do Full Setup 9. To activate the Setup menu, open the Console button. 4, and click the "setup" The Setup menu includes the following selections: Full Setup 9 Provides access to all setup options. You should select this option when setting up the Tracker for the first time or if you have made significant changes to your environment or equipment. Tracking Mode 21 Provides access to Tracking Mode setup only. Alignment 22 Provides access to Alignment setup only. Output 51 Provides access to Output setup only.
9 2.1 Full Setup To start Full Setup, from the console, click the "setup" button. A shortcut menu will appear: Select "Full Setup". To use the manual to guide you through Full Setup, follow the "Continue" topic below. Continue: Select Camera 10
10 2.2 Select Camera The Select Camera screen is available via the Console > setup > Full Setup Select your camera type and click, "Next". Note: Your camera may look different from the photos displayed. To list only cameras currently connected to your system, check the "Only show corrected camera" checkbox. (Note: this checkbox does not work in all cases.) Multiple cameras When using more than one camera, all cameras must be of the same type and resolution. Continue: DirectShow Compatible Camera 13 Continue: Custom Camera 12 Continue: Lumenera Camera 14 Continue: PGR Dragonfly Camera 15
11 2.2.1 CMU Camera Properties This screen is available from the console > setup > Full Setup > Select Camera > CMU Camera. 1. Select your desired resolution 2. Click "Next". If using a single camera only: Tracking Mode 21 If using multiple cameras: Camera Count 16
12 2.2.2 Custom Camera Properties This screen is available from the console > setup > Full Setup > Select Camera > Other. To set up a custom camera, enter the appropriate information into the various fields. Device Name: Enter the name of your camera. This is for information only. Device Index: Enter the index for this particular device. Resolution: Enter the camera's resolution (width and height). Refer to your camera's documentation for more information. Use Colour Images: If you need to use colour images, check this box (not recommended). Multi-channel: If your camera uses multi-channel, check this box. If using a single camera only: Tracking Mode 21 If using multiple cameras: Camera Count 16
13 2.2.3 DirectShow Camera Properties This screen is available from the console > setup > Full Setup > Select Camera > DirectShow Compatible Camera. 1. Select your desired DirectShow camera from the dropdown list. 2. Resolution: Select desired resolution ("Medium" is recommended). 3. Video Mode: Select Black & White. 4. Click "Next". If using a single camera only: Tracking Mode 21 If using multiple cameras: Camera Count 16
14 2.2.4 Lumenera Camera Properties This screen is available from the console > setup > Full Setup > Select Camera > Lumenera Camera. 1. Select desired resolution ("High" is recommended). 2. Click "Next". If using a single camera only: Tracking Mode 21 If using multiple cameras: Camera Count 16
15 2.2.5 PGR Dragonfly Camera This screen is available from the console > setup > Full Setup > Select Camera > Dragonfly Camera. 1. Select your desired resolution. "High Resolution Black & White (default)" is recommended. 2. Click "Next". If using a single camera only: Tracking Mode 21 If using multiple cameras: Camera Count 16
16 2.2.6 Camera Count Only available with the Platinum MP edition. This screen is available from the console > setup > Full Setup > Select Camera > Camera Properties > Next Enter the number of connected cameras, and click "Next". If using a single camera only: Tracking Mode 21 If using multiple cameras: Multiple Cameras 17
17 2.2.7 Multiple Cameras Only available with the Platinum MP edition. The (Platinum MP edition only) allows you to use up to four cameras. Multiple cameras allow for a much bigger projection area by either using multiple projectors, one for each camera (Figure 1), or with a single projector in order to increase tracking resolution (Figure 2). Figure 1: Two Projector/Two Camera setup Figure 2: One Projector/Two Camera setup Multiple projectors can be set up side by side in sequence or in a grid. Each camera should be aligned to view its associated projected area as closely as possible. Fine alignment changes can be made in the Tracker setup. There is also a special, rarely-used, configuration available whereby a single tracking computer can be used to simultaneously track two separate projection areas. One of these projection areas must have two or three aligned cameras, while the other projection area must only have a single camera. Working through the Setup and Advanced Options screens for multiple cameras is very similar to that of using only one camera. You will choose one camera type 10, one Tracking Mode 21, and one Alignment Procedure 22 for all cameras.
18 Differences from single camera setup are as follows: A special screen for setting up the order of the cameras. Multiple displays or tabs for each camera where appropriate. Where a particular screen relates to only one camera, you will be presented with either a message stating which camera will be affected or a choice of camera to affect. Continue: Stitch 19
19 2.2.8 Stitch Only available with the Platinum MP edition. This screen is available from the console > setup > Full Setup > Select Camera > Camera Properties > Camera Count > Next Use this screen to arrange the order of your cameras. The Stitch screen using two cameras. Assign each camera to its relative position based on the projected area associated with it. Each position may only be associated with one camera. Note: Cameras are numbered beginning with "0", not "1". Only the following position combinations are valid: Left, Right Left, Middle, Right Top, Bottom Top, Middle, Bottom Top-Left, Top-Right, Bottom-Left, Bottom-Right Special Configuration An exception to the above combinations is the case where one camera provides tracking independent of the others. In this case two or three cameras would be combined according the valid combinations above, and one (and only one) camera would be set to "Independent". Target Resolution The Tracker needs to know the resolution of the projected display. When using only one projector, or whenever your desktop resolution matches the Dazzler resolution, select "Desktop" If your desktop resolution does not match the Dazzler resolution, or when using more than one projector, select "Custom" and specify the total combined display resolution. For example three projectors, each with a display of 800 X 600 aligned in sequence from left to right would have a
20 Target Resolution of 2400 X 600. The same projectors aligned top to bottom would have a Target Resolution of 800 X 1800. Four projectors, each with a display of 1024 X 768 set up in a grid, would have a Target Resolution of 2048 X 1536. Adjust Cameras Click this button to make adjustments to one or more cameras. For more information, see Camera Controls 50. Continue: Tracking Mode 21
21 2.3 Tracking Mode Tracking Mode is available via Full Setup console. 9 or by selecting setup > Tracking Mode from the It is necessary to select how the Tracker will interact with user interaction. In most cases, Motion is preferred. Background Model This system maintains a model of the background, updated over time. This method detects complete silhouette of the user. It is best where ambient infra-red light is controlled and there is not constant foot traffic. Motion This system detects motion. This method is works best in most situations, especially in locations where the ambient light changes, or there is constant foot-traffic over the presentation area. To set Tracking Mode: Select your desired Tracking Mode and click "Next". If you had selected setup > Tracking Mode from the Tracker Console, you will see a "Finished" message. Click the "Finished" button to return to the Tracker console. If you had selected setup > Full Setup from the Tracker Console, you will be taken to Alignment. Continue: Alignment 22
22 2.4 Select Alignment Procedure Select Alignment Procedure is available via Full Setup from the console. 9 or by selecting setup > Alignment Note: Before proceeding, it is recommended that you read Understanding Alignment 23. Your choice of alignment procedure depends on your environment and personal preferences. Screen Borders is the easiest to use, but has the strictest requirements. The three alignment procedure options are: Manual This option allows you to manually set the exact dimensions of the presentation area (screen). This is especially good for non-standard dimensions and to fine tune an existing alignment. Screen Borders This is the most automated option and should only be used for very distinct presentation areas (screens), where the presentation area is surrounded by a dark, rectangular border that is well contrasted to the presentation area. Target Placement This option sets the screen alignment by placing targets at specified points of the presentation area (screen). It is preferred for most standard dimensions that do not have a well-defined border. Select an alignment procedure and click "Next". Continue: Manual 24 Continue: Screen Borders 30 Continue: Target Placement 34
23 2.4.1 Understanding Alignment It is necessary to make sure that the camera is aligned exactly according to your screen dimensions as projected on your presentation area. When running GroundFX, the camera does not actually see what is projected. It only sees the reflection of infrared light within the presentation area. Aligning the dimensions of what the camera sees with what is projected on the presentation area is fundamentally dependant upon correct placement of the camera's and the projector's physical relationship to the presentation area. Before adjusting screen orientation and alignment, it is essential that sufficient time and effort is spent making sure that the camera, projector, and presentation area are aligned as much as possible. Only then should alignment be adjusted within Tracker setup. The first step you encounter after selecting an Alignment Procedure is Verify Camera 48, which displays your presentation area as seen by the camera. The Verify Camera display should look similar to the following, if your camera, projector, and presentation area are set up correctly. If it is not, adjust accordingly. Note: At this point don't be concerned about the brightness of the screen, just the outline. Continue: Select Alignment Procedure 22
24 2.4.2 Manual This alignment option allows you to manually set the exact dimensions of the presentation area (screen). This is especially good for non-standard dimensions and to fine tune an existing alignment. Note: if you have never used the Manual procedure before, it is highly recommended that you read Understanding Alignment 23 before proceeding. The steps to set up the Manual Alignment Procedure are: Verify Camera 48 Orientation and Dimensions 25 Continue: Verify Camera 48
25 2.4.2.1 Orientation and Dimensions After clicking "Next" in Verify Camera, you will see a full screen display of what your camera sees. Accessing Manual Alignment Options 28 An overview of the various Manual alignment options and controls. Using Manual Alignment 26 How to align the, using Manual Alignment Continue: Output 51
26 2.4.2.1.1 Using Manual Alignment Screen Orientation Move your hand over the screen area to see if the camera is oriented as expected. If it is not, then right click anywhere on screen, and select Flip Horizontal and/or Flip Vertical as required. For more information on accessing the Manual alignment menu and controls, go to Accessing Manual Alignment Options 28. Screen Dimensions The displayed arrow indicates the current region available for adjustment. To change the current active region, right click anywhere on the screen. Select "Align". Then select the desired screen region. For more information on accessing the Manual alignment menu and controls, go to Accessing Manual Alignment Options 28. To adjust the alignment of the current active region, place an object on the presentation screen, so that it touches the tip of the projected arrow. Look for the projected image of your object. If you have difficulty seeing the projected version of your object, you may find it easier to locate by moving it around or lifting it off the screen surface. Once you locate the object, place it at the tip of the arrow. If the projected version of your object is not also touching the arrow, then with your mouse click and drag the projected version of your object so that it does. Repeat this procedure with each available region by right clicking anywhere on the screen. Select "Corner". Then select desired screen region. It is recommended that you align all available screen regions. Setting alignment using a secondary monitor If your GroundFX system includes a secondary monitor, you may find it easier to make your alignment adjustments using that monitor. Place an object at the tip of the current arrow on your presentation screen, and then using your secondary monitor, drag the image of the object to the tip of the arrow. Freehand mode Freehand mode (right click on screen and select Align > Freehand Mode) allows you to adjust any point of the screen instead an isolated region specified by the projected arrow. It is recommended that you only use Freehand Mode when you need to make very fine adjustments to specific areas of the screen. Saving Alignment Settings When you are satisfied with the screen orientation and dimensions, right click anywhere on screen. Click "Accept" from the shortcut menu. Once you are satisfied with the alignment, right click the screen and select "Accept" You will get the following message:
27 Click "Next". You will automatically be taken to the Local Network 51 screen. Continue: Output Continue: Accessing Manual Alignment Options 51 28
28 2.4.2.1.2 Accessing Options To access menu options, right click anywhere on the screen. A short cut menu will appear as displayed here: Accept Saves alignment according to screen adjustments. Automatically takes you to the next screen. Cancel Cancels the Manual alignment screen. Provides options to go back to previous settings or cancel setup altogether. Revert If you make alignment changes, selecting "Revert" resets the alignment to its previously saved state prior to these latest changes. Defaults Resets the alignment to its default state. Cancels all changes from current or any previous sessions. Align Lists choices of screen regions to align. Notes 1. When "Middle-Center" is selected, an "X" instead of an arrow will appear in the very center of the screen to indicate the active adjustment area. 2. Instead of using the menu to access the various screen regions, you may use your numeric keypad with number 1-9 representing each of the 9 regions (e.g. 1 is the bottom-left corner, 5 is the middle-center, 9 is the top-right corner). Flip Horizontal Flips the screen image horizontally (left to right). Flip Vertical Flips the image vertically (up and down).
29 Display Window Allows you to work with the alignment screen in a window rather than full screen. You have several choices as to window placement. Note that the only way to move the alignment screen to a new position is to use this option. You cannot drag the window around your screen, since dragging with the mouse adjusts the alignment. Advanced Opens the Camera Controls screen. For more information, see Camera Controls 50. Additional onscreen element Grid The small "Grid" box shows how the screen is affected by your adjustments. Continue: Output 51
30 2.4.3 Screen Borders This alignment option should only be used for very distinct presentation areas (screens), where the presentation area is surrounded by a dark, rectangular border that is well contrasted to the presentation area. The steps to set up the Screen Borders Alignment Procedure are: Verify Camera 48 Image Orientation Screen Border 31 32 Continue: Verify Camera 48
31 2.4.3.1 Image Orientation Test the screen area by moving your hand into the area from edges and corners to confirm that the orientation is correct. You may adjust the horizontal and/or vertical orientation of the screen by selecting the appropriate check box(es). Note: While the effects of selecting Flip Horizontal and/or Flip Vertical are immediately visible in this screen, any changes in orientation will not be visible in subsequent screens even though these settings will be retained. Once you are satisfied with the screen orientation, click "Next". Continue: Screen Border 32
32 2.4.3.2 Screen Border Make sure there are no objects in the screen area and click "Sample Now". The Tracker will attempt to set the borders of your screen by placing a green outline around it. If the green outline does not appear or if does not seem to be correct, then verify the following and adjust accordingly. 1. The border of the screen area (not just the edge of the screen) must be visible within the camera image. 2. Make sure there is sufficient IR light projected over all parts of the screen, including the corners. 3. There must be good contrast between the screen and the border.
33 After making any needed adjustments, click "Sample Now" again. If the green outline is correct, click "Next". Otherwise Continue: address these issues. It may be necessary to manually adjust your camera settings by clicking "Adjust Camera 50 ". If after several attempts the green outline does not appear correctly, it may be necessary to use one of the other alignment procedures. When you are satisfied with the alignment of the outline, click "Next". You will automatically be taken to the Local Network 51 screen. Continue: Output 51
34 2.4.4 Target Placement This alignment option sets the screen alignment by placing targets at specified points of the presentation area (screen). It is preferred for most standard dimensions that do not have a welldefined border. Verify Camera 48 Setting Targets 35 Continue: Verify Camera 48
35 2.4.4.1 Setting Targets After clicking "Next" in Verify Camera, you will see the following: In order to prepare for target placement, you need to remove any targets or other obstructions from the screen area. Press "Next". You will then be presented with a series of 20 target placement screens. Place a dark round object (a lens cap works best in most situations) in the center of the black crosshair with the red background. Look in the Camera View area of the screen. The Tracker will attempt to find your object. If it does, you will see a red crosshair over your object as seen here:
36 Note: You do not need to be concerned about horizontal or vertical screen orientation when using Target Placement. This is accomplished by setting your targets. If the red crosshair is correctly positioned, click "Next." You need to repeat this procedure for the remaining 19 placement screens. Important! If the red crosshair in the Camera View area does not appear or does not settle on your target, you may need to make certain adjustments. For more information on settings that might affect target placement, see Target Placement - Advanced Options 40. When working with the subsequent target placement screen, your previously accepted targets will be represented by blue crosshairs, while the new target crosshair to set will be red.
37
38 After completing all 20 placement screens, your screen should look like this: If the target placement is to your satisfaction, click "Next". The following confirmation message will appear. To continue, click "Next".
39 Overview of Setting Target Screen Buttons Back Takes you back to previous target setting screen. Restart Cancels all target settings and allows you to start over. Next Takes you to the next target setting screen (only active when the red crosshair settles on a target). Note: Make sure that the red crosshair has settles on the expected target before pressing "Next". OK Accepts all the target settings (Only active after the last target is set). Advanced Provides access to advanced settings 40. Cancel Cancels target settings. Continue: Output 51
40 2.4.4.2 Advanced Options Before using Advanced Options There may be one or more reasons why the red crosshairs are not locating your target. Before working with these Advanced options, make sure that your physical environment is set up properly, including sufficient infrared light and no obstructions. After making any such changes, try Setting Targets 35 again. If you have confirmed that your environment has been satisfactorily optimized, and the Tracker is still having difficulty locating your target, use these advanced options. If after working with these options, the Tracker is still not locating your target, try using the Manual 24 alignment procedure instead. Multiple Cameras When using Multiple Cameras, certain Advanced Options will include separate tabs for each camera. Accessing Advanced Options To access the Target Placement Advanced Options, click "Advanced" from any one of the Target Placement screens.
41 2.4.4.2.1 Camera Controls Note: Please read Before Using Advanced Options 40 prior to making any adjustments. This tab helps adjust brightness settings, which may make a difference in the Tracker being able to distinguish between the target and the background. Important! If you do not suspect that camera brightness is causing your target detection problem, do not make any camera control adjustments. Method Software Controlled (default setting) In most cases, the Tracker will effectively control the camera settings. This method is also very useful in environments where lighting changes. Manual It is recommended that this method only be used in controlled environments that are not susceptible to lighting changes. Great care should be taken when adjusting the controls using this method. Show All Controls Checking this box allows for the listing of all possible controls. Note: Not all listed controls are applicable to all cameras. Once you have adjusted camera brightness, go to the Target Detector 47 tab to see if the Tracker is correctly detecting your target. If so, click "OK". If not, continue working with Advanced Options or try a different alignment procedure 22.
42 2.4.4.2.2 Background Model Note: Please read Before Using Advanced Options 40 prior to making any adjustments. The Tracker attempts to distinguish between the background and the target. It is possible that what has been detected as the background is not correct. It is also possible that, at some point, while you have been working through the target setting screens, your target has incorrectly been made part of the background as shown here: If this should occur, remove the target, and click the "Resample" button. The Background Model tab should look like this: Note: In most cases, the sliders should be left in their default positions.
43 When done, go to the Target Detector 47 tab to see if the Tracker is correctly detecting your target. If so, click "OK". If not, continue working with Advanced Options or try a different alignment procedure 22.
44 2.4.4.2.3 Mask Note: Please read Before Using Advanced Options 40 prior to making any adjustments. The Mask tab allows you to view and control the Tracker's detection sensitivity. With your target in place, if in the Mask pane, you see "noise" (white objects in addition to your target), click and drag the Threshold slider to the right to remove. Try to set the Threshold in such a way that you can see the target sufficiently without the presence of any noise. Mask with noise, requiring lowering of threshold. If after removing all noise, your target is too small or too large or is not visible at all (as in following screen shot), adjust the Filter and Expand sliders. The Filter slider causes the mask to close over the target (the higher the setting, the less the target will be displayed). The Expand slider causes more of the target to be seen (the higher the setting, the more the target will be displayed).
45 Mask incorrectly showing no tracking. Mask correctly showing target. Once you are satisfied with your new settings, go to the Target Detector 47 tab to see if the Tracker is correctly detecting your target. If so, click "OK". If not, continue working with Advanced Options or try a different alignment procedure 22.
46 2.4.4.2.4 Fill Gaps Note: Please read Before Using Advanced Options 40 prior to making any adjustments. If the Tracker does not appear to be fully representing your target, you can use this advanced option allows you to close any gaps. Once you are satisfied with your new settings, go to the Target Detector 47 tab to see if the Tracker is correctly detecting your target. If so, click "OK". If not, continue working with Advanced Options or try a different alignment procedure 22.
47 2.4.4.2.5 Target Detector Note: Please read Before Using Advanced Options 40 prior to making any adjustments. This advanced option allows you to see and control how the Tracker is detecting targets. This will help you determine which settings you should adjust. Once you have determined that all other settings are correct, but the Tracker is still not detecting your target, try adjusting the Target Detector sliders. You will know that the Tracker is detecting your target correctly if the red crosshair appears in the area where your target is as shown here. If you can see your target properly (the white representation of your target in the Mask pane approximately matches the shape and size of the actual target as seen in the Image pane), but the crosshair is not settling on the target, try adjusting the "Maximum Diameter" slider. The Maximum Diameter slider controls the maximum diameter allowed for a target to be detected. If the Tracker is correctly detecting your target, click "OK". If not, continue working with Advanced Options or try a different alignment procedure 22.
48 2.4.5 Verify Camera The Verify Camera screen is the first screen that appears after selecting an Alignment Procedure 22. Your camera's brightness will automatically be adjusted. Once this adjustment has settled, the "Next" button will become available. Before clicking "Next" verify your camera's brightness and general alignment. Note: The Tracker's camera is specially designed to only "see" infrared light. Therefore you will not see what your projector is displaying in your presentation area, but only what is reflecting infrared light. Make sure your camera is aimed correctly at your desired presentation target area. If necessary correct the camera's position, focus, and aperture. If the screen is too dark, it may be an indication that your IR emitters are not functioning or positioned properly. Adjust accordingly, making sure that all areas of the screen are getting sufficient light including the corners. If after making sure that the camera and IR emitters are functioning correctly, the screen is still too dark, click Adjust Camera 49. Note: When using Multiple Cameras, Adjust Camera provides displays of all cameras, not just the one you are currently verifying. Once you are satisfied with the camera display, click "Next". Continue: Manual (Orientation and Dimensions) 25 Continue: Screen Borders (Image Orientation) 31 Continue: Target Placement (Setting Targets) 35
49 2.4.5.1 Adjust Camera Camera Controls Tab Method Software Controlled (default setting) In most cases, the Tracker will effectively control the camera settings. This method is also very useful in environments where lighting changes. Manual It is recommended that this method only be used in controlled environments that are not susceptible to lighting changes. Great care should be taken when adjusting the controls using this method. Show All Controls Checking this box allows for the listing of all possible controls. Note: Not all listed controls are applicable to all cameras. Control Tab Provides access to advanced camera controls. When you are finished with your adjustments, click "OK". Multiple Cameras When using Multiple Cameras, Adjust Camera provides displays of all cameras, not just the one you are currently verifying.
50 2.4.6 Camera Controls The following Camera Controls screen is available from either Manual Image Orientation screens. 24 or Screen Borders 30 Method Software Controlled (default setting) In most cases, the Tracker will effectively control the camera settings. This method is also very useful in environments where lighting changes. Manual It is recommended that this method only be used in controlled environments that are not susceptible to lighting changes. Great care should be taken when adjusting the controls using this method. Show All Controls Checking this box allows for the listing of all possible controls. Note: Not all listed controls are applicable to all cameras. Multiple Cameras When using more than one camera, multiple tabs will appear, one for each camera. When you are finished with your adjustments, click "OK".
51 2.5 Output The Local Network screen is available via Full Setup console. 9 or by selecting setup > Output from the If no computer is connecting to the over a network, press "Next". If other computers on a local network are to access the Tracker, check the "Enable local network communications" check box and enter the appropriate Port number. Note: If you are running a firewall, you may need to unblock the Tracker. See Unblocking when using a firewall 52. Click "Next" when done. You will receive a Finished message. In order to use the Tracker over a network you will also need to run the GroundFX Network Tracker 69. Continue: Finished 53
52 2.5.1 Unblocking when using a firewall To unblock the Tracker when using Windows Firewall 1. Control Panel > Security Center. 2. Under "Manage security settings for", select "Window Firewall. 3. Click the Exceptions tag. 4. Click the Add Program button. 5. Find "GroundFXTracker" in the Programs list and select it. 6. Click OK. 7. Click OK. 8. Close the Security Center. To unblock the Tracker when using a firewall other than Windows Firewall See your firewall program's documentation for information on how to unblock a program.
53 2.6 Finished The Finished message will appear when you have completed Full Setup or one of the other Setup options. To accept your settings, click "Finish". You will be returned to the console. To confirm that the Tracker is working properly as well as to access Advanced settings, you need to run the Tracker, and click on the "'advanced" button. Continue: Advanced Options 54
54 3 Advanced Options The Advanced Options allow you to make sure that the Tracker is tracking motion as expected. To access Advanced Options: 1. If you haven't already done so, open the Console tracker by clicking the "start" button or waiting for autostart. 4, and start the 2 Once the "advanced" button becomes active, click it. The Advanced Options screen you will use depends on your current Tracking Mode 21. Continue: Background Model - Advanced Options 55 Continue: Motion - Advanced Options 62
55 3.1 Background Model Tracking Mode Background Model Tracking Advanced Options help to confirm and adjust motion detection when using the Background Model Tracking Mode. Notes 1. Before working with Advanced Options, you need to choose a Tracking Mode 21 2. If during Setup 8 you flipped your camera's orientation, the display will appear unflipped. See the Outline 60 tab for orientation confirmation.,
56 3.1.1 Camera Controls Provides access to several camera settings. Method Software Controlled (default setting): In most cases, the Tracker will effectively control the camera settings. This method is also very useful in environments where lighting changes. Manual: It is recommended that this method only be used in controlled environments that are not susceptible to lighting changes. Great care should be taken when adjusting the controls using this method. Show All Controls Checking this box allows for the listing of all possible controls. Note: Not all listed controls are applicable to all cameras. When you are satisfied with the Camera Control settings, click another tab to view or adjust, or click "OK" to close Advanced Options.
57 3.1.2 Background Model Confirms and sets the background image used by the Tracker against which user presence is contrasted. The Live Image pane displays what the camera currently sees. The Background Model image provides the background image used by the Tracker. For the Tracker to work properly, the Background Model must not include anything that is not part of the unobstructed background. Incorrect Background Model Correct Background Model To manually update the background image, make sure there are no obstructions in the current presentation area, and click "Resample." When satisfied with the Background Model, click another tab to view or adjust, or click "OK" to close Advanced Options.
58 3.1.3 Mask Enables you to see the see the silhouette created by user presence. If in the Mask view you see "noise" (white objects other than intended user presence), click and drag the Threshold slider to the right to remove. Try to set the Threshold in such a way that you can see the silhouette of user presence sufficiently without the presence of any noise. Mask with noise Mask without noise Use the Filter and Expand sliders to control the size of the silhouette. When you are satisfied with the silhouette, click another tab to view or adjust, or click "OK" to close Advanced Options.
59 3.1.4 Fill Gaps The Fill Gaps tab allows you to close any gaps in the displayed silhouette of the user. To fill any gaps in the silhouette, adjust the Distance sliders. When satisfied, click another tab to view or adjust, or click "OK" to close Advanced Options.
60 3.1.5 Outline Provides tracking outlines based on current settings. The green outline is based on current user presence. The red outline is the transformed outline of user presence incorporating current settings, including image orientation and alignment. It is this outline that Dazzler will use. Notes 1. The outlines may be difficult to see on a projected screen. 2. When viewing an un-flipped image, the two outlines may overlap. Outline using flipped camera orientation Outline without flipped orientation Click another tab to view or adjust, or click "OK" to close Advanced Options.
61 3.1.6 Stitched Multiple Cameras only Provides combined tracking outlines from all cameras. Note: This feature is currently unavailable.
62 3.2 Motion Tracking Mode Motion Tracking Advanced Options help to confirm and adjust motion detection when using the Motion Tracking Mode. Notes 1. Before working with Advanced Options, you need to choose a Tracking Mode 21, 2. If during Setup 8 you flipped your camera's orientation, the display will appear unflipped. See the Outline 60 tab for orientation confirmation.
63 3.2.1 Camera Controls Provides access to several camera settings. Method Software Controlled (default setting): In most cases, the Tracker will effectively control the camera settings. This method is also very useful in environments where lighting changes. Manual: It is recommended that this method only be used in controlled environments that are not susceptible to lighting changes. Great care should be taken when adjusting the controls using this method. Show All Controls Checking this box allows for the listing of all possible controls. Note: Not all listed controls are applicable to all cameras. When you are satisfied with the Camera Control settings, click another tab to view or adjust, or click "OK" to close Advanced Options.
64 3.2.2 Control Provides additional controls affecting camera brightness and sensitivity. Note the message in the Status pane. If it states that the image is too dark, adjust the sliders until the message reads, "Everything okay". When you are satisfied with these settings, click another tab to view or adjust, or click "OK" to close Advanced Options.
65 3.2.3 Mask Enables you to see the silhouette created by motion. If you see "noise" (white objects in addition to the effects of user motion), click and drag the Threshold slider to the right to remove. Try to set the Threshold in such a way that you can see the target sufficiently without the presence of any noise. Note: The user needs to be moving for the motion silhouette to appear. Mask with noise Mask without noise If the silhouette created by user motion is not reasonably formed, use the Smoothing slider to adjust.
66 The Duration slider controls how long the Tracker will retain the effects of motion. A high setting results in more of a sweep effect. In the Motion History pane in the above screen example, the gray shadow surrounding part of the silhouette represents the amount of immediate previous motion still being tracked. When you are satisfied with these settings, click another tab to view or adjust, or click "OK" to close Advanced Options.
67 3.2.4 Outline Provides tracking outlines based on current settings. The green outline is based on current motion. The red outline is the transformed outline of user motion incorporating current settings, including image orientation and alignment. It is this outline that Dazzler will use. Notes 1. The outlines may be difficult to see on a projected screen. 2. When viewing an un-flipped image, the two outlines may overlap. Outline using flipped camera orientation Outline without flipped orientation Click another tab to view or adjust, or click "OK" to close Advanced Options.
68 3.2.5 Stitched Multiple Cameras only Provides combined tracking outlines from all cameras. Note: This feature is currently unavailable.
69 4 Network Setup You can run the Tracker over a network. This enables you to have a camera connected to one computer while Dazzler is running on one or more other computers. In order to use the Tracker over the Network, you need to enable network communications in the Tracker settings on the computer that is attached to the camera. Then you need to run the special Network Tracker on the computer(s) running Dazzler. Note: Running GroundFX over a network as described here is currently deemed as beta functionality. It is being developed with a view to be fully implemented as part of the 1.4 series of GroundFX. Be aware that certain unusual behavior may occur when using this functionality, including occasional halting of the Tracker and/or communication with Dazzler. In some cases Dazzler itself may shut down. We recommend therefore that the GestLauncher tool (located in your GroundFX\Tools folder) be used to ensure that Dazzler will automatically restart.
70 4.1 Enabling Network Communications To use the Tracker over a network, you need to enable network communications by going to the Local Network screen in the Tracker setup on the computer that is connected to the camera. The Local Network screen is available via Full Setup console. 9 or by selecting setup > Output from the To enable network communications: 1. From the Local Network screen, place a check sin the "Enable local network communications" check box. 2. Enter a port number in the Port field. The default port number is "4000". You will need to enter this same port number in the Network Tracker Setup 72. Note: If you are running a firewall, you may need to unblock the Tracker. See Unblocking when using a firewall 52. Click "Next" when done. You will receive a Finished message.
71 4.2 Running Network Tracker On the computer(s) that will run Dazzler, you need to open the GroundFX Network Tracker Console, by running GroundFXNetworkClient.exe (usually found in your folder). If you have never setup the Network Tracker before, click "setup". See Network Tracker Setup 69. Start the Network Tracker by clicking the "connect" button on the GroundFX Network Tracker Console (alternatively you can wait for the Tracker to autostart): Note: The "Command" button is not active at this time.
72 4.3 Network Tracker Setup When you click the "setup" button from the GroundFX Network Tracker, the following screen will appear: Server: Enter the Computer Name or IP address of the computer that is connected to the camera and is running the. Note: If you specify a computer name, do not include the initial "\\". Port: Enter the same port number specified in the Local Network screen Tracker settings of the computer that is connected to the camera. 70 of the GroundFX Camera/Data Channel: This is normally set to "0" except in the particular case of multiple cameras, where one camera is tracking independently of the others. In that case if the display computer is getting its tracking information from the independent camera over a network, the Network Tracker's Camera/Data channel for that computer must be set to "1". Retry Time: Specifies the amount of time, in seconds, the Network Tracker will wait before trying to reconnect if, for some reason, it is disconnected. Popup on disconnect: If checked, the Network Tracker Console will appear on screen if the network connection is lost. When you are satisfied with your settings, click "OK". Clicking "Default" restores the Network Tracker's default settings.
73 5 Revision History Version 1.3.58.m08 - March 8, 2007 - Removed reference to unused feature, "Active Region". Version 1.3.57.m07 - September 21, 2006 - Added a special note regarding using the Tracker over a network. Version 1.3.56.m06 - August 15, 2006 - Updated version number. Version 1.3.53.m05 - May 29, 2006 - Fixed Road Map section of Camera Count page. Version 1.3.53.m04 - May 24, 2006 - Added Network Setup section. - Added pages for Multiple Camera setup. - Updated pages relevant to Multiple Camera setup - Made some minor content changes to the other parts of the manual - Changed format of manual version numbers to better reflect current version. Version 1.03 - May 9, 2006 - Updated several screen shots and some content to reflect version 1.03.0051 Version 1.02 - May 4, 2006 - Redesigned layout and updated content. - Updated index. Version 1.01 - March 17, 2006 - Added Index - Updated Console screen shots to reflect latest version number.
Index Index D DirectShow Camera Properties 13 Dragonfly (PGR) Camera Properties A About 5 Adjust Camera 49 Advanced Options 54 Background Model 55 Motion Tracking Mode 62 Advanced Options, Background Model Background Model 57 Camera Controls 56 Fill Gaps 59 Mask 58 Outline 60 Stitched 61 Advanced Options, Motion Tracking Mode Camera Controls 63 Control 64 Mask 65 Outline 67 Stitched 68 Alignment Understanding 23 Alignment Procedure Select 22 B Background Model Tracking Mode Before You Start 3 C Camera Adjust Camera 49 Verify 48 Camera Count 16 Camera Properties CMU 11 Custom 12 DirectShow 13 Dragonfly (PGR) 15 Lumenera 14 PGR Dragonfly 15 Camera, Select 10 Closing the Tracker 6 CMU Camera Properties 11 Copyright and Legal Matters 2 Custom Camera Properties 12 21 15 E Editions, GroundFX Classic 5 Platinum 5 Platinum MP 5 Enabling Network Communications F Finished 53 Firewall 52 Full Setup 9 G GroundFX Editions About 5 5 I Image Orientation Introduction 1 50 L Local Network screen 72 Lumenera Camera Properties 14 M Manual Alignment 24 Accessing Options 28 Image Orientation 50 Orientation and Dimensions 25 Saving Alignment Settings 26 Screen Dimensions 26 Screen Orientation 26 Manual Alignment Procedure 22 Motion Tracking Mode 21 Mulitple Cameras Stitch 19 Multiple Cameras 17 N Network Enabling 70 Network Setup 69 Network Tracker Running 71 Network Tracker Setup 70 74
75 Starting 6 Stopping 6 Tracker Console, Opening Tracking Mode 21 Network Tracker Setup Camera/Data Channel 72 Popup on disconnect 72 Port 72 Retry Time 72 Server 72 V Verify Camera O Opening the Tracker Output 51 4 P PGR Dragonfly Camera Properties Platinum MP edition 16, 17, 19 15 R Revision History 73 Road Map 1 Running Network Tracker 71 S Screen Borders 30 Image Orientation 31, 50 Screen Border 32 Screen Borders Alignment Procedure Setup 8 Finished 53 Full Setup 9 Multiple Cameras 17 Network 51, 69 Network Tracker 72 Output 51 Tracking Mode 21 Starting the Tracker 6 Stitch (Multiple Cameras) 19 Stopping the Tracker 6 22 T Target Placement 34 Advanced Options 40 Background Model 42 Camera Controls 41 Fill Gaps 46 Mask 44 Setting Targets 35 Target Detector 47 Target Screen Buttons 35 Target Placement Alignment Procedure Tracker Closing 6 22 48 4