GroundFX Tracker Manual

Transcription

1 Manual Documentation Version: 1.4.m02 The latest version of this manual is available at GestureTek Inc. 317 Adelaide Street West, Toronto, Ontario, M5V 1P9 Canada Web: Phone: Fax:

2 Table of Contents 1 Introduction Copyright and Legal Matters Before You Start Opening... the Tracker Console GroundFX Editions Starting/Stopping the Tracker Starting... Dazzler 8 2 Setup Full Setup Select Camera CMU Camera Properties...13 Custom Camera Properties...14 DirectShow Camera Properties...15 Lumenera Camera Properties...16 PGR Dragonfly Camera...17 Camera Count...18 Multiple Cameras...20 Stitch 2.3 Tracking Mode Select Alignment Procedure Alignment Understanding Manual and Dimensions Orientation...26 Manual Alignment Using...26 Options Accessing Borders Screen Orientation Image...31 Border Screen Placement Target Targets Setting...35 Options Advanced...40 Controls Camera...40 Model Background Mask...40 Gaps Fill...40 Detector Target Camera Verify Camera Adjust Controls Camera 2.5 Output... 53

3 ...54 when using a firewall Unblocking 2.6 Finished Advanced Options Background Model Tracking Mode Camera Controls...59 Background Model...61 Mask Fill...63 Gaps...64 Outline...65 Stitched 3.2 Motion... Tracking Mode Camera Controls...68 Control...70 Mask...72 Outline...73 Stitched 4 Network Setup Enabling Network Communications Running Network Tracker Network Tracker Setup Index 78 II

4 1 1 Introduction GroundFX is part of GestureTek's GestureFX family of interactive systems. The GroundFX Tracker allows users to interact with the GestureTek Dazzler player. This manual will help you in setting up and using the. It is organized by topic. For information on how to use the Dazzler player, see the Dazzler Manual. Road Map To help you work through setup procedures, suggested follow-up topics are provided where appropriate. Look for "Continue" followed by the topic name and page number. References to other pages are denoted with special page number graphics like this:.

5 2 1.1 Copyright and Legal Matters GestureTek and GroundFX are registered trademarks of GestureTek Inc. All rights reserved. GestureFX is a trademark of GestureTek Inc. The contents of this documentation are the property of GestureTek Inc. and are for the exclusive use of registered users. Microsoft and Windows are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries.

6 3 1.2 Before You Start 1. Before attempting to run the for the first time, make sure that any cameras are connected and working properly. If not, then any attempt to run the Tracker will result in an error or it will simply stop. 2. It is essential that you set up the Tracker in an environment (placement, lighting, etc.) as close as possible to that of your intended presentation. 3. It is strongly recommended that when setting up the Tracker for the first time or if you have made significant changes to your environment or equipment, that you run Full Setup 10.

7 4 1.3 Opening the Tracker Console To open the console, click the Windows Start button, point to Programs or All Programs, point to GestureTek, point to GroundFX, click on. The console will appear: Note: If this is the first time you are running the, you will need to run Full Setup 10. Otherwise you may either press the "start" button or wait for the Tracker to start automatically.

8 5 1.4 GroundFX Editions There are three GroundFX editions currently available. Classic Provides one-camera tracking for a single projector display. Includes only Classic Play Items. Platinum Provides one-camera tracking for a single projector display. Includes all Play Items. Platinum MP Provides multi-camera tracking 18 for multiple projector displays. Includes all Play Items. To confirm your GroundFX edition, from the console 4, click the GroundFX logo. The About box will appear displaying information about your installation. If you are interested in upgrading your installation, contact your GroundFX reseller. For more information about GroundFX Play Items, see your Dazzler documentation.

9 6 1.5 Starting/Stopping the Tracker License Verification When attempting to start the Tracker, the program will first verify your GroundFX license by checking the USB security key (dongle). If the key is not installed or the license does not match the Tracker edition you are trying to run, an error box will appear and you will not be able to run the Tracker. Note: Do not remove the security key when the Tracker is reading it as this may damage the key. For more information about editions, see editions 5. For more information about issues relating to licenses, contact your GestureTek reseller. Starting the Tracker If the is not open, open it now. See Opening the If you have not run Full Setup yet, do so now. See Full Setup Start the Tracker by clicking the "START TRACKER" button on the console (alternatively you can wait for the Tracker to autostart): Once the Tracker is running, the "ADVANCED" button will become active and the tracking rate will display. Wait until the tracking rate is displayed. If you are satisfied with the Tracker settings, you can either leave it as is on your screen or you may minimize it to your Windows System Tray. When the Tracker is minimized to the Windows System Tray, you can access its features (including Start and Stop), by right clicking its icon.

10 7 Stopping the Tracker To stop the Tracker, but leave the Tracker open onscreen, from the Tracker console, click the "STOP TRACKER" button. To close the Tracker console either click the "X" symbol in the upper right corner of the console, or if the Tracker console has been minimized to the System Tray, right click it's icon and click "Close" from the menu. Note: Closing the Tracker console stops the Tracker. Command Line Options See the Dazzler manual.

11 8 1.6 Starting Dazzler To start Dazzler, first make sure that the is running and the "START DAZZLER" button is active. Wait until the tracking rate display in the bottom right of the console is displayed. From the console, press "START DAZZLER" Autostart When opening the console, autostart will run unless one of the active buttons is pressed. When the autostart countdown is complete, the will attempt to run. For more information see Starting/Stopping the Tracker 6 Note: For more information about Dazzler, see the Dazzler Manual. Command Line Options See the Dazzler manual.

12 9 2 Setup From the console, you have the choice of running Full Setup 10 (necessary when setting up the Tracker for the first time) or accessing one of three setup categories. Important! If this is the first time you are setting up the Tracker, you must do Full Setup 10. To activate the Setup menu, open the Console button. The setup menu will appear. 4, and click the "SETUP" The Setup menu includes the following selections: Full Setup 10 Provides access to all setup options. You should select this option when setting up the Tracker for the first time or if you have made significant changes to your environment or equipment. Tracking Mode 22 Provides access to Tracking Mode setup only. Alignment 23 Provides access to Alignment setup only. Output 53 Provides access to Output setup only.

13 Full Setup To start Full Setup, from the console, click the "SETUP" button. A shortcut menu will appear: Select "Full Setup". To use the manual to guide you through Full Setup, follow the "Continue" topic below. Continue: Select Camera 11

14 Select Camera The Select Camera screen is available via the Console > SETUP > Full Setup Select your camera type and click, "Next". Note: Your camera may look different from the photos displayed. To list only cameras currently connected to your system, check the "Only show corrected camera" checkbox. (Note: this checkbox does not work in all cases.) Multiple cameras When using more than one camera, all cameras must be of the same type and resolution. Continue: DirectShow Compatible Camera 14 Continue: Custom Camera 13 Continue: Lumenera Camera 15 Continue: PGR Dragonfly Camera 16

15 CMU Camera Properties This screen is available from the console > SETUP > Full Setup > Select Camera > CMU Camera. 1. Select your desired resolution 2. Click "Next". If using a single camera only: Tracking Mode 22 If using multiple cameras: Camera Count 17

16 Custom Camera Properties This screen is available from the console > SETUP > Full Setup > Select Camera > Other. To set up a custom camera, enter the appropriate information into the various fields. Device Name: Enter the name of your camera. This is for information only. Device Index: Enter the index for this particular device. Resolution: Enter the camera's resolution (width and height). Refer to your camera's documentation for more information. Use Colour Images: If you need to use colour images, check this box (not recommended). Multi-channel: If your camera uses multi-channel, check this box. If using a single camera only: Tracking Mode 22 If using multiple cameras: Camera Count 17

17 DirectShow Camera Properties This screen is available from the console > SETUP > Full Setup > Select Camera > DirectShow Compatible Camera. Note: DirectShow compatible cameras are suitable for content development only. They are not recommended for normal installations. 1. Select your desired DirectShow camera from the dropdown list. 2. Resolution: Select desired resolution ("Medium" is recommended). 3. Video Mode: Select Black & White. 4. Click "Next". If using a single camera only: Tracking Mode 22 If using multiple cameras: Camera Count 17

18 Lumenera Camera Properties This screen is available from the console > SETUP > Full Setup > Select Camera > Lumenera Camera. 1. Select desired resolution ("High" is recommended). 2. Click "Next". If using a single camera only: Tracking Mode 22 If using multiple cameras: Camera Count 17

19 PGR Dragonfly Camera This screen is available from the console > SETUP > Full Setup > Select Camera > Dragonfly Camera. 1. Select your desired resolution. "High Resolution Black & White (default)" is recommended. 2. Click "Next". If using a single camera only: Tracking Mode 22 If using multiple cameras: Camera Count 17

20 Camera Count Only available with the Platinum MP edition. This screen is available from the console > SETUP > Full Setup > Select Camera > Camera Properties > Next Enter the number of connected cameras, and click "Next". If using a single camera only: Tracking Mode 22 If using multiple cameras: Multiple Cameras 18

21 Multiple Cameras Only available with the Platinum MP edition. The (Platinum MP edition only) allows you to use up to four cameras. Multiple cameras allow for a much bigger projection area by either using multiple projectors, one for each camera (Figure 1), or with a single projector in order to increase tracking resolution (Figure 2). Figure 1: Two Projector/Two Camera setup Figure 2: One Projector/Two Camera setup Multiple projectors can be set up side by side in sequence or in a grid. Each camera should be aligned to view its associated projected area as closely as possible. Fine alignment changes can be made in the Tracker setup. There is also a special, rarely-used, configuration available whereby a single tracking computer can be used to simultaneously track two separate projection areas. One of these projection areas must have two or three aligned cameras, while the other projection area must only have a single camera. Working through the Setup and Advanced Options screens for multiple cameras is very similar to that of using only one camera. You will choose one camera type 11, one Tracking Mode 22, and one Alignment Procedure 23 for all cameras.

22 19 Differences from single camera setup are as follows: A special screen for setting up the order of the cameras. Multiple displays or tabs for each camera where appropriate. Where a particular screen relates to only one camera, you will be presented with either a message stating which camera will be affected or a choice of camera to affect. Continue: Stitch 20

23 Stitch Only available with the Platinum MP edition. This screen is available from the console > SETUP > Full Setup > Select Camera > Camera Properties > Camera Count > Next Use this screen to arrange the order of your cameras. The Stitch screen using two cameras. Assign each camera to its relative position based on the projected area associated with it. Each position may only be associated with one camera. Note: Cameras are numbered beginning with "0", not "1". Only the following position combinations are valid: Left, Right Left, Middle, Right Top, Bottom Top, Middle, Bottom Top-Left, Top-Right, Bottom-Left, Bottom-Right Special Configuration An exception to the above combinations is the case where one camera provides tracking independent of the others. In this case two or three cameras would be combined according the valid combinations above, and one (and only one) camera would be set to "Independent". Target Resolution The Tracker needs to know the resolution of the projected display. When using only one projector, or whenever your desktop resolution matches the Dazzler resolution, select "Desktop" If your desktop resolution does not match the Dazzler resolution, or when using more than one projector, select "Custom" and specify the total combined display resolution. For example three

24 21 projectors, each with a display of 800 X 600 aligned in sequence from left to right would have a Target Resolution of 2400 X 600. The same projectors aligned top to bottom would have a Target Resolution of 800 X Four projectors, each with a display of 1024 X 768 set up in a grid, would have a Target Resolution of 2048 X Adjust Cameras Click this button to make adjustments to one or more cameras. For more information, see Camera Controls 52. Continue: Tracking Mode 22

25 Tracking Mode Tracking Mode is available via Full Setup console. 10 or by selecting SETUP > Tracking Mode from the It is necessary to select how the Tracker will interact with user interaction. In most cases, Motion is preferred. Background Model This system maintains a model of the background, updated over time. This method detects complete silhouette of the user. It is best where ambient infra-red light is controlled and there is not constant foot traffic. Motion This system detects motion. This method is works best in most situations, especially in locations where the ambient light changes, or there is constant foot-traffic over the presentation area. To set Tracking Mode: Select your desired Tracking Mode and click "Next". If you had selected setup > Tracking Mode from the Tracker console, you will see a "Finished" message. Click the "Finished" button to return to the Tracker console. If you had selected setup > Full Setup from the Tracker console, you will be taken to Alignment. Continue: Alignment 23

26 Select Alignment Procedure Select Alignment Procedure is available via Full Setup from the console. 10 or by selecting SETUP > Alignment Note: Before proceeding, it is recommended that you read Understanding Alignment 24. Your choice of alignment procedure depends on your environment and personal preferences. Screen Borders is the easiest to use, but has the strictest requirements. The three alignment procedure options are: Manual This option allows you to manually set the exact dimensions of the presentation area (screen). This is especially good for non-standard dimensions and to fine tune an existing alignment. Screen Borders This is the most automated option and should only be used for very distinct presentation areas (screens), where the presentation area is surrounded by a dark, rectangular border that is well contrasted to the presentation area. Target Placement This option sets the screen alignment by placing targets at specified points of the presentation area (screen). It is preferred for most standard dimensions that do not have a well-defined border. Select an alignment procedure and click "Next". Continue: Manual 25 Continue: Screen Borders 30 Continue: Target Placement 34

27 Understanding Alignment It is necessary to make sure that the camera is aligned exactly according to your screen dimensions as projected on your presentation area. When running GroundFX, the camera does not actually see what is projected. It only sees the reflection of infrared light within the presentation area. Aligning the dimensions of what the camera sees with what is projected on the presentation area is fundamentally dependant upon correct placement of the camera's and the projector's physical relationship to the presentation area. Before adjusting screen orientation and alignment, it is essential that sufficient time and effort is spent making sure that the camera, projector, and presentation area are aligned as much as possible. Only then should alignment be adjusted within Tracker setup. The first step you encounter after selecting an Alignment Procedure is Verify Camera 48, which displays your presentation area as seen by the camera. The Verify Camera display should look similar to the following, if your camera, projector, and presentation area are set up correctly. If it is not, adjust accordingly. Note: At this point don't be concerned about the brightness of the screen, just the outline. Continue: Select Alignment Procedure 23

28 Manual This alignment option allows you to manually set the exact dimensions of the presentation area (screen). This is especially good for non-standard dimensions and to fine tune an existing alignment. Note: if you have never used the Manual procedure before, it is highly recommended that you read Understanding Alignment 24 before proceeding. The steps to set up the Manual Alignment Procedure are: Verify Camera 48 Orientation and Dimensions 26 Continue: Verify Camera 48

29 Orientation and Dimensions After clicking "Next" in Verify Camera, you will see a full screen display of what your camera sees. Using Manual Alignment 27 How to align the, using Manual Alignment Accessing Manual Alignment Options 28 An overview of the various Manual alignment options and controls. Continue: Output 53

30 Using Manual Alignment Screen Orientation Move your hand over the screen area to see if the camera is oriented as expected. If it is not, then right click anywhere on screen, and select Flip Horizontal and/or Flip Vertical as required. For more information on accessing the Manual alignment menu and controls, go to Accessing Manual Alignment Options 28. Screen Dimensions The displayed arrow indicates the current region available for adjustment. To change the current active region, right click anywhere on the screen. Select "Align". Then select the desired screen region. For more information on accessing the Manual alignment menu and controls, go to Accessing Manual Alignment Options 28. To adjust the alignment of the current active region, place an object on the presentation screen, so that it touches the tip of the projected arrow. Look for the projected image of your object. If you have difficulty seeing the projected version of your object, you may find it easier to locate by moving it around or lifting it off the screen surface. Once you locate the object, place it at the tip of the arrow. If the projected version of your object is not also touching the arrow, then with your mouse click and drag the projected version of your object so that it does. Repeat this procedure with each available region by right clicking anywhere on the screen. Select "Corner". Then select desired screen region. It is recommended that you align all available screen regions. Setting alignment using a secondary monitor If your GroundFX system includes a secondary monitor, you may find it easier to make your alignment adjustments using that monitor. Place an object at the tip of the current arrow on your presentation screen, and then using your secondary monitor, drag the image of the object to the tip of the arrow. Freehand mode Freehand mode (right click on screen and select Align > Freehand Mode) allows you to adjust any point of the screen instead an isolated region specified by the projected arrow. It is recommended that you only use Freehand Mode when you need to make very fine adjustments to specific areas of the screen. Saving Alignment Settings When you are satisfied with the screen orientation and dimensions, right click anywhere on screen. Click "Accept" from the shortcut menu. Once you are satisfied with the alignment, right click the screen and select "Accept". You will automatically be taken to the Local Network 53 screen. Continue: Output Continue: Accessing Manual Alignment Options 53 28

31 Accessing Options To access menu options, right click anywhere on the screen. A short cut menu will appear as displayed here: Multiple camera users! Before setting alignment, you need to first select the area of the display that corresponds to the current camera by choosing "Display Window" and the appropriate display area from the menu. Accept Saves alignment according to screen adjustments. Automatically takes you to the next screen. Cancel Cancels the Manual alignment screen. Provides options to go back to previous settings or cancel setup altogether. Revert If you make alignment changes, selecting "Revert" resets the alignment to its previously saved state prior to these latest changes. Defaults Resets the alignment to its default state. Cancels all changes from current or any previous sessions. Align Lists choices of screen regions to align. Notes 1. When "Middle-Center" is selected, an "X" instead of an arrow will appear in the very center of the screen to indicate the active adjustment area. 2. Instead of using the menu to access the various screen regions, you may use your numeric keypad with number 1-9 representing each of the 9 regions (e.g. 1 is the bottom-left corner, 5 is the middle-center, 9 is the top-right corner). Flip Horizontal Flips the screen image horizontally (left to right).

32 29 Flip Vertical Flips the image vertically (up and down). Display Window (multiple cameras only) When using multiple cameras, select the portion of the overall display that corresponds to the current camera. Advanced Opens the Camera Controls screen. For more information, see Camera Controls 52. Additional onscreen element Grid The small "Grid" box shows how the screen is affected by your adjustments. Continue: Output 53

33 Screen Borders This alignment option should only be used for very distinct presentation areas (screens), where the presentation area is surrounded by a dark, rectangular border that is well contrasted to the presentation area. The steps to set up the Screen Borders Alignment Procedure are: Verify Camera 48 Image Orientation Screen Border Continue: Verify Camera 48

34 Image Orientation Test the screen area by moving your hand into the area from edges and corners to confirm that the orientation is correct. You may adjust the horizontal and/or vertical orientation of the screen by selecting the appropriate check box(es). Note: While the effects of selecting Flip Horizontal and/or Flip Vertical are immediately visible in this screen, any changes in orientation will not be visible in subsequent screens even though these settings will be retained. Once you are satisfied with the screen orientation, click "Next". Continue: Screen Border 32

35 Screen Border Make sure there are no objects in the screen area and click "Sample Now". The Tracker will attempt to set the borders of your screen by placing a green outline around it. If the green outline does not appear or if does not seem to be correct, then verify the following and adjust accordingly. 1. The border of the screen area (not just the edge of the screen) must be visible within the camera image. 2. Make sure there is sufficient IR light projected over all parts of the screen, including the corners. 3. There must be good contrast between the screen and the border.

36 33 After making any needed adjustments, click "Sample Now" again. If the green outline is correct, click "Next". Otherwise Continue: address these issues. It may be necessary to manually adjust your camera settings by clicking "Adjust Camera 52 ". If after several attempts the green outline does not appear correctly, it may be necessary to use one of the other alignment procedures. When you are satisfied with the alignment of the outline, click "Next". You will automatically be taken to the Local Network 53 screen. Continue: Output 53

37 Target Placement This alignment option sets the screen alignment by placing targets at specified points of the presentation area (screen). It is preferred for most standard dimensions that do not have a well-defined border. Note: Not recommended for a multiple camera installation. Verify Camera 48 Setting Targets 35 Continue: Verify Camera 48

38 Setting Targets After clicking "Next" in Verify Camera, you will see the following: In order to prepare for target placement, you need to remove any targets or other obstructions from the screen area. Press "Next". You will then be presented with a series of 20 target placement screens. Place a dark round object (a lens cap works best in most situations) in the center of the black crosshair with the red background. Look in the Camera View area of the screen. The Tracker will attempt to find your object. If it does, you will see a red crosshair over your object as seen here:

39 36 Note: You do not need to be concerned about horizontal or vertical screen orientation when using Target Placement. This is accomplished by setting your targets. If the red crosshair is correctly positioned, click "Next." You need to repeat this procedure for the remaining 19 placement screens. Important! If the red crosshair in the Camera View area does not appear or does not settle on your target, you may need to make certain adjustments. For more information on settings that might affect target placement, see Target Placement - Advanced Options 40. When working with the subsequent target placement screen, your previously accepted targets will be represented by blue crosshairs, while the new target crosshair to set will be red.

40 37

41 38 After completing all 20 placement screens, your screen should look like this: If the target placement is to your satisfaction, click "Next". The following confirmation message will appear. To continue, click "Next".

42 39 Overview of Setting Target Screen Buttons Back Takes you back to previous target setting screen. Restart Cancels all target settings and allows you to start over. Next Takes you to the next target setting screen (only active when the red crosshair settles on a target). Note: Make sure that the red crosshair has settles on the expected target before pressing " Next". OK Accepts all the target settings (Only active after the last target is set). Advanced Provides access to advanced settings 40. Cancel Cancels target settings. Continue: Output 53

43 Advanced Options Before using Advanced Options There may be one or more reasons why the red crosshairs are not locating your target. Before working with these Advanced options, make sure that your physical environment is set up properly, including sufficient infrared light and no obstructions. After making any such changes, try Setting Targets 35 again. If you have confirmed that your environment has been satisfactorily optimized, and the Tracker is still having difficulty locating your target, use these advanced options. If after working with these options, the Tracker is still not locating your target, try using the Manual 25 alignment procedure instead. Multiple Cameras When using Multiple Cameras, certain Advanced Options will include separate tabs for each camera. Accessing Advanced Options To access the Target Placement Advanced Options, click "Advanced" from any one of the Target Placement screens.

44 Camera Controls Note: Please read Before Using Advanced Options 40 prior to making any adjustments. This tab helps adjust brightness settings, which may make a difference in the Tracker being able to distinguish between the target and the background. Important! If you do not suspect that camera brightness is causing your target detection problem, do not make any camera control adjustments. Method Software Controlled (default setting) In most cases, the Tracker will effectively control the camera settings. This method is also very useful in environments where lighting changes. Manual It is recommended that this method only be used in controlled environments that are not susceptible to lighting changes. Great care should be taken when adjusting the controls using this method. Show All Controls Checking this box allows for the listing of all possible controls. Note: Not all listed controls are applicable to all cameras. Once you have adjusted camera brightness, go to the Target Detector 47 tab to see if the Tracker is correctly detecting your target. If so, click "OK". If not, continue working with Advanced Options or try a different alignment procedure 23.

45 Background Model Note: Please read Before Using Advanced Options 40 prior to making any adjustments. The Tracker attempts to distinguish between the background and the target. It is possible that what has been detected as the background is not correct. It is also possible that, at some point, while you have been working through the target setting screens, your target has incorrectly been made part of the background as shown here: If this should occur, remove the target, and click the "Resample" button. The Background Model tab should look like this: Note: In most cases, the sliders should be left in their default positions.

46 43 When done, go to the Target Detector 47 tab to see if the Tracker is correctly detecting your target. If so, click "OK". If not, continue working with Advanced Options or try a different alignment procedure 23.

47 Mask Note: Please read Before Using Advanced Options 40 prior to making any adjustments. The Mask tab allows you to view and control the Tracker's detection sensitivity. With your target in place, if in the Mask pane, you see "noise" (white objects in addition to your target), click and drag the Threshold slider to the right to remove. Try to set the Threshold in such a way that you can see the target sufficiently without the presence of any noise. Mask with noise, requiring lowering of threshold. If after removing all noise, your target is too small or too large or is not visible at all (as in following screen shot), adjust the Filter and Expand sliders. The Filter slider causes the mask to close over the target (the higher the setting, the less the target will be displayed). The Expand slider causes more of the target to be seen (the higher the setting, the more the target will be displayed).

48 45 Mask incorrectly showing no tracking. Mask correctly showing target. Once you are satisfied with your new settings, go to the Target Detector 47 tab to see if the Tracker is correctly detecting your target. If so, click "OK". If not, continue working with Advanced Options or try a different alignment procedure 23.

49 Fill Gaps Note: Please read Before Using Advanced Options 40 prior to making any adjustments. If the Tracker does not appear to be fully representing your target, you can use this advanced option allows you to close any gaps. To fill gaps in the silhouette, adjust the Distance sliders. Use the left slider to set the maximum gap size to join. Use the right slider to preserve detail that may be smoothed out inadvertently. Note: The outline created by the Tracker will be made up of both the white and red silhouettes as they appear in the Filtered Mask image. Once you are satisfied with your new settings, go to the Target Detector 47 tab to see if the Tracker is correctly detecting your target. If so, click "OK". If not, continue working with Advanced Options or try a different alignment procedure 23.

50 Target Detector Note: Please read Before Using Advanced Options 40 prior to making any adjustments. This advanced option allows you to see and control how the Tracker is detecting targets. This will help you determine which settings you should adjust. Once you have determined that all other settings are correct, but the Tracker is still not detecting your target, try adjusting the Target Detector sliders (see descriptions below). You will know that the Tracker is detecting your target correctly if the red crosshair appears in the area where your target is as shown here. Position Provides currently detected x,y position. If s target not found at all, the message "Not Found" will be displayed. Maximum Diameter Sets, in pixels, the maximum diameter that an object will be considered as a possible target. The green bar indicates the current detected diameter. Roundness Threshold Sets how round an object must be in order to be considered as a possible target. A setting of 100% would mean that an object would have to be a perfect circle to be considered, while 0% is a straight line. The default setting of 50% is recommended in most cases. If you can see your target properly (the white representation of your target in the Mask pane approximately matches the shape and size of the actual target as seen in the Image pane), but the crosshair is not settling on the target, try adjusting the "Maximum Diameter" slider. If the Tracker is correctly detecting your target, click "OK". If not, continue working with Advanced Options or try a different alignment procedure 23.

51 Verify Camera The Verify Camera screen is the first screen that appears after selecting an Alignment Procedure 23. Once this adjustment has settled, the "Next" button will become available. Before clicking "Next" verify your camera's brightness and general alignment. Make sure your camera is aimed correctly at your desired presentation target area. Fully open your camera's iris. The brightness will adjust accordingly. If the screen is still too dark, it may be an indication that your IR emitters are not functioning or positioned properly. If after making sure that the camera and IR emitters are functioning correctly, the screen is still too dark, click Adjust Camera 49. Note: When using Multiple Cameras, Adjust Camera provides displays of all cameras, not just the one you are currently verifying. Front-lit installations: Screen should be medium-light gray, while avoiding pure white spots. Back-lit installations: Screen should be as bright as possible, while ensuring that interactive componants (e.g. hands, feet, objects, etc.) appear dark. Note: The Tracker's camera is specially designed to only "see" infrared light. Therefore you will not see what your projector is displaying in your presentation area, but only what is reflecting infrared light. Once you are satisfied with the camera display, click "Next". Continue: Manual (Orientation and Dimensions) 26 Continue: Screen Borders (Image Orientation) 31 Continue: Target Placement (Setting Targets) 35

52 Adjust Camera Camera Controls Tab Method Software Controlled (default setting) In most cases, the Tracker will effectively control the camera settings. This method is also very useful in environments where lighting changes. Manual It is recommended that this method only be used in controlled environments that are not susceptible to lighting changes. Great care should be taken when adjusting the controls using this method. Show All Controls Checking this box allows for the listing of all possible controls. Note: Not all listed controls are applicable to all cameras. Control Tab Provides additional controls that are available when the Software Control method is selected in the Camera Control screen. These controls may be adjusted to affect camera brightness and sensitivity. Note: In most cases the default values provide best results. Do not adjust unless truly necessary.

53 50 Histogram Displays a dynamic histogram of the current camera image. Status Displays a status message regarding the brightness of the camera image. If the image is too dark or too bright, the Tracker will attempt to automatically adjust. If adjustment is unsuccessful, the status will suggest manual adjustment of the controls. For best results, the message should read "Everything OK" before continuing Tracker set up. Percentiles Sets the brightness percentage threshold for the camera image. The Tracker will attempt to adjust overall brightness of the image to ensure that the specified percentage of pixels remain below the target brightness. In most cases the default percentile of about 75% is preferred. Target Brightness The green line indicates the current brightness of the camera image. The target brightness should be set fairly high, yet low enough to tolerate reasonably brighter objects. In most cases the default target brightness of about 53% is preferred. The two sliders set the minimum and maximum brightness levels. The Tracker will adjust the camera's gain and exposure to attempt to keep the target brightness at a level between the two sliders. If the brightness indicator moves outside the specified range, the Tracker will adjust the gain and exposure. Note: Setting a too narrow (20% or less) or too wide (35% or more) a range will likely produce undesired results. In most cases the default range of 30% is preferred. Gain (The name of this control may differ depending on your camera) The green bar represents the current gain. The two sliders set limits on the range of the Camera's gain that the Tracker will use. In most cases leaving the sliders in their default positions provides best results. Some cameras allow for low or high gain settings that are undesirable, in which cases the sliders should be adjusted accordingly. Alt Gain

54 51 Deprecated control. Will be removed in later version. Shutter/Exposure (Depending on your camera, you may have only have one of these controls. Name of control(s) may vary. The last two controls are camera specific and control shutter and exposure in various ways depending on the camera. The first of the two allow for the limiting of the setting range similar to Gain A above. The extra middle slider button allows for a initial maximum exposure setting. This is so that the Tracker will increase exposure to that level before increasing gain. When gain reaches its maximum limit, then exposure will increase again if necessary. The second of the two controls allows for a minimum setting. When you are satisfied with these settings, click another tab to view or adjust, or click "OK" to close. Multiple Cameras When using Multiple Cameras, Adjust Camera provides displays of all cameras, not just the one you are currently verifying.

55 Camera Controls The following Camera Controls screen is available from either Manual 25 or Screen Borders 30 Image Orientation screens. Note: The title of this screen may differ depending from where it is accessed. Method Software Controlled (default setting) In most cases, the Tracker will effectively control the camera settings. This method is also very useful in environments where lighting changes. Manual It is recommended that this method only be used in controlled environments that are not susceptible to lighting changes. Great care should be taken when adjusting the controls using this method. Show All Controls Checking this box allows for the listing of all possible controls. Note: Not all listed controls are applicable to all cameras. Multiple Cameras When using more than one camera, multiple tabs will appear, one for each camera. When you are finished with your adjustments, click "OK".

56 Output The Local Network screen is available via Full from the console. 10 Setup 10 or by selecting SETUP > Output If no computer is connecting to the over a network, press "Next". If other computers on a local network are to access the Tracker, check the "Enable local network communications" check box and enter the appropriate Port number. Note: If you are running a firewall, you may need to unblock the Tracker. See Unblocking when using a firewall 54. Click "Next" when done. You will receive a Finished message. In order to use the Tracker over a network you will also need to run the GroundFX Network Tracker 74. Continue: Finished 55

57 Unblocking when using a firewall To unblock the Tracker when using Windows Firewall 1. Control Panel > Security Center. 2. Under "Manage security settings for", select "Window Firewall. 3. Click the Exceptions tag. 4. Click the Add Program button. 5. Find "GroundFXTracker" in the Programs list and select it. 6. Click OK. 7. Click OK. 8. Close the Security Center. To unblock the Tracker when using a firewall other than Windows Firewall See your firewall program's documentation for information on how to unblock a program.

58 Finished The Finished message will appear when you have completed Full Setup or one of the other Setup options. To accept your settings, click "Finish". You will be returned to the console. To confirm that the Tracker is working properly as well as to access Advanced settings, you need to run the Tracker, and click on the "'advanced" button. Continue: Advanced Options 56

59 56 3 Advanced Options The Advanced Options allow you to make sure that the Tracker is tracking motion as expected. To access Advanced Options: 1. If you haven't already done so, open the Console tracker by clicking the "start" button or waiting for autostart. 4, and start the 2 Once the "advanced" button becomes active, click it. The Advanced Options screen you will use depends on your current Tracking Mode 22. Continue: Background Model - Advanced Options 57 Continue: Motion - Advanced Options 66

60 Background Model Tracking Mode Background Model Tracking Advanced Options help to confirm and adjust motion detection when using the Background Model Tracking Mode. Notes 1. Before working with Advanced Options, you need to choose a Tracking Mode If during Setup 9 you flipped your camera's orientation, the display will appear unflipped. See the Outline 64 tab for orientation confirmation.,

61 Camera Controls Provides access to several camera settings. Method Software Controlled (default setting): In most cases, the Tracker will effectively control the camera settings. This method is also very useful in environments where lighting changes. Note: When using a DirectShow compatible camera with this method, the camera image may appear black. Use the Manual method instead. Manual: It is recommended that this method only be used in controlled environments that are not susceptible to lighting changes. Great care should be taken when adjusting the controls using this method. Show All Controls Checking this box allows for the listing of all possible controls. Note: Not all listed controls are applicable to all cameras. When you are satisfied with the Camera Control settings, click another tab to view or adjust, or click "OK" to close Advanced Options.

62 Background Model Confirms and sets the background image used by the Tracker against which user presence is contrasted. The Live Image pane displays what the camera currently sees. The Background Model image displays the background image used by the Tracker. For the Tracker to work properly, the Background Model must not include anything that is not part of the unobstructed background. When Dynamic Update is active, the Tracker will analyze the camera image over a particular duration to adapt to changes in the image and update the background accordingly. If Dynamic Update is not active, then the background may be resampled by pressing the "Resample" button. The background may be resampled manually at any time whether or not Dynamic Update is active. Incorrect Background Model

63 60 Correct Background Model Total Memory Duration Only available when Dynamic Update is active. Sets the span of time, in minutes and seconds, in which the camera image will be analyzed in order to adapt to changes of large objects. Sample Integration Duration Sets the span of time, in seconds, in which the camera image will be analyzed in order to adapt to changes of very small objects, such as camera noise. Resample Pressing the Resample button resamples the current camera image and treats it as the background. Before using, make sure there are no obstructions in the current presentation area, Dynamic Update Enables Dynamic Update. When satisfied with the Background Model, click another tab to view or adjust, or click "OK" to close Advanced Options.

64 Mask Enables you to see the see the silhouette created by user presence. If in the Mask view you see "noise" (white objects other than intended user presence), click and drag the Threshold slider to the right to remove. Try to set the Threshold in such a way that you can see the silhouette of user presence sufficiently without the presence of any noise. Mask with noise Mask without noise Noise Indicates the amount of noise detected when resampling. Threshold

65 62 Determines how much noise is tolerated. It should normally be set just above the noise level. Filter Sets the pixel grid that will be accepted as part of the mask. The effect is that it removes speckles. Expand Adds pixels. The effect is that it removes holds. When you are satisfied with the silhouette, click another tab to view or adjust, or click "OK" to close Advanced Options.

66 Fill Gaps The Fill Gaps tab allows you to close any gaps in the displayed silhouette of the user. To fill gaps in the silhouette, adjust the Distance sliders. Use the left slider to set the maximum gap size to join. Use the right slider to preserve detail that may be smoothed out inadvertently. Note: The outline created by the Tracker will be made up of both the white and red silhouettes as they appear in the Filtered Mask image. When satisfied, click another tab to view or adjust, or click "OK" to close Advanced Options.

67 Outline Provides tracking outlines based on current settings. The green outline is based on current user presence. The red outline is the transformed outline of user presence incorporating current settings, including image orientation and alignment. It is this outline that Dazzler will use. Notes 1. The outlines may be difficult to see on a projected screen. 2. When viewing an un-flipped image, the two outlines may overlap. Outline using flipped camera orientation Outline without flipped orientation Click another tab to view or adjust, or click "OK" to close Advanced Options.

68 Stitched Multiple Cameras only Provides combined tracking outlines from all cameras.

69 Motion Tracking Mode Motion Tracking Advanced Options help to confirm and adjust motion detection when using the Motion Tracking Mode. Notes 1. Before working with Advanced Options, you need to choose a Tracking Mode 22, 2. If during Setup 9 you flipped your camera's orientation, the display will appear unflipped. See the Outline 64 tab for orientation confirmation.

70 Camera Controls Provides access to several camera settings. Method Software Controlled (default setting): In most cases, the Tracker will effectively control the camera settings. This method is also very useful in environments where lighting changes. When this method is selected, the settings in the Control 68 tab are utilized by the Tracker. Note: When using a DirectShow compatible camera with this method, the camera image may appear black. Use the Manual method instead. Manual: It is recommended that this method only be used in controlled environments that are not susceptible to lighting changes. Great care should be taken when adjusting the controls using this method. Show All Controls Checking this box allows for the listing of all possible controls. Note: Not all listed controls are applicable to all cameras. When you are satisfied with the Camera Control settings, click another tab to view or adjust, or click "OK" to close Advanced Options.

71 Control Provides additional controls that are available when the Software Control method is selected in the Camera Control screen. These controls may be adjusted to affect camera brightness and sensitivity. Note: In most cases the default values provide best results. Do not adjust unless truly necessary. Histogram Displays a dynamic histogram of the current camera image. Status Displays a status message regarding the brightness of the camera image. If the image is too dark or too bright, the Tracker will attempt to automatically adjust. If adjustment is unsuccessful, the status will suggest manual adjustment of the controls. For best results, the message should read "Everything OK" before continuing Tracker set up. Percentiles Sets the brightness percentage threshold for the camera image. The Tracker will attempt to adjust overall brightness of the image to ensure that the specified percentage of pixels remain below the target brightness. In most cases the default percentile of about 75% is preferred. Target Brightness The green line indicates the current brightness of the camera image. The target brightness should be set fairly high, yet low enough to tolerate reasonably brighter objects. In most cases the default target brightness of about 53% is preferred. The two sliders set the minimum and maximum brightness levels. The Tracker will adjust the camera's gain and exposure to attempt to keep the target brightness at a level between the two sliders. If the brightness indicator moves outside the specified range, the Tracker will adjust the gain and exposure. Note: Setting a too narrow (20% or less) or too wide (35% or more) a range will likely produce undesired results. In most cases the default range of 30% is preferred.

72 69 Gain (The name of this control may differ depending on your camera) The green bar represents the current gain. The two sliders set limits on the range of the Camera's gain that the Tracker will use. In most cases leaving the sliders in their default positions provides best results. Some cameras allow for low or high gain settings that are undesirable, in which cases the sliders should be adjusted accordingly. Alt Gain Deprecated control. Will be removed in later version. Shutter/Exposure (Depending on your camera, you may have only have one of these controls. Name of control(s) may vary. The last two controls are camera specific and control shutter and exposure in various ways depending on the camera. The first of the two allow for the limiting of the setting range similar to Gain A above. The extra middle slider button allows for a initial maximum exposure setting. This is so that the Tracker will increase exposure to that level before increasing gain. When gain reaches its maximum limit, then exposure will increase again if necessary. The second of the two controls allows for a minimum setting. When you are satisfied with these settings, click another tab to view or adjust, or click "OK" to close Advanced Options.

73 Mask Enables you to see the silhouette created by motion. If you see "noise" (white objects in addition to the effects of user motion), click and drag the Threshold slider to the right to remove. Try to set the Threshold in such a way that you can see the target sufficiently without the presence of any noise. Note: The user needs to be moving for the motion silhouette to appear. Mask with noise Mask without noise Smoothing

74 71 Adds pixels to smooth out silhouette. If the silhouette is not reasonably formed, increase Smoothing. Threshold Determines how much noise is tolerated. It should normally be set just above the noise level. Duration Controls how long the Tracker will retain the effects of motion. A high setting results in more of a sweep effect. In the Motion History pane in the above screen example, the gray shadow surrounding part of the silhouette represents the amount of immediate previous motion still being tracked. When you are satisfied with these settings, click another tab to view or adjust, or click "OK" to close Advanced Options.

75 Outline Provides tracking outlines based on current settings. The green outline is based on current motion. The red outline is the transformed outline of user motion incorporating current settings, including image orientation and alignment. It is this outline that Dazzler will use. Notes 1. The outlines may be difficult to see on a projected screen. 2. When viewing an un-flipped image, the two outlines may overlap. Outline using flipped camera orientation Outline without flipped orientation Click another tab to view or adjust, or click "OK" to close Advanced Options.

76 Stitched Multiple Cameras only Provides combined tracking outlines from all cameras.

77 74 4 Network Setup You can run the Tracker over a network. This enables you to have a camera connected to one computer while Dazzler is running on one or more other computers. In order to use the Tracker over the Network, you need to enable network communications in the Tracker settings on the computer that is attached to the camera. Then you need to run the special Network Tracker on the computer(s) running Dazzler. Note: Running GroundFX over a network as described here is currently deemed as beta functionality. It is being developed with a view to be fully implemented as part of the 1.4 series of GroundFX. Be aware that certain unusual behavior may occur when using this functionality, including occasional halting of the Tracker and/or communication with Dazzler. In some cases Dazzler itself may shut down. We recommend therefore that the GestLauncher tool (located in your GroundFX\Tools folder) be used to ensure that Dazzler will automatically restart.

78 Enabling Network Communications To use the Tracker over a network, you need to enable network communications by going to the Local Network screen in the Tracker setup on the computer that is connected to the camera. The Local Network screen is available via Full Setup the console. 10 or by selecting setup > Output from To enable network communications: 1. From the Local Network screen, place a check sin the "Enable local network communications" check box. 2. Enter a port number in the Port field. The default port number is "4000". You will need to enter this same port number in the Network Tracker Setup 77. Note: If you are running a firewall, you may need to unblock the Tracker. See Unblocking when using a firewall 54. Click "Next" when done. You will receive a Finished message.

79 Running Network Tracker On the computer(s) that will run Dazzler, you need to open the GroundFX Network Tracker console, by running GroundFXNetworkClient.exe (usually found in your folder). If you have never setup the Network Tracker before, click "setup". See Network Tracker Setup 74. Start the Network Tracker by clicking the "connect" button on the GroundFX Network Tracker console (alternatively you can wait for the Tracker to autostart): Note: The "Command" button is not active at this time.

80 Network Tracker Setup When you click the "SETUP" button from the GroundFX Network Tracker, the following screen will appear: Server: Enter the Computer Name or IP address of the computer that is connected to the camera and is running the. Note: If you specify a computer name, do not include the initial "\\". Port: Enter the same port number specified in the Local Network screen Tracker settings of the computer that is connected to the camera. 75 of the GroundFX Camera/Data Channel: This is normally set to "0" except in the particular case of multiple cameras, where one camera is tracking independently of the others. In that case if the display computer is getting its tracking information from the independent camera over a network, the Network Tracker's Camera/Data channel for that computer must be set to "1". Retry Time: Specifies the amount of time, in seconds, the Network Tracker will wait before trying to reconnect if, for some reason, it is disconnected. Popup on disconnect: If checked, the Network Tracker console will appear on screen if the network connection is lost. When you are satisfied with your settings, click "OK". Clicking "Default" restores the Network Tracker's default settings.