Grad projects / Independent Study

Size: px

Start display at page:

Download "Grad projects / Independent Study"

Lawrence Collins
6 years ago
Views:

1 Latest SIGGRAPH job posting now linked from my home page: Link from my home page Updated every 2 weeks or so. Grad projects / Independent Study Link from my home page. 1

2 RIT is looking for a few good programmers! ACM Programming Contest 3 people teams Tryouts Tues, Sept 22 nd at 5pm (ICL4) FREE FOOD! Contact Paul Tyman (ptt@cs.rit.edu) by Sept 21 st. Audience Experience Actor Control / mocap Integration Asset Importing Audio Staging 2

3 The major goal for checkpoint 1 for all teams: Analysis examine code to discover how things currently work Design design a solution to be implemented for Checkpoint 2. Checkpoint deliverable will be docs / presentation on your design. Members: Joshua Kirby (G) Devin Warren Tasks for Quarter Client packaging Putting audience members in their place! Position in theatre, that is. Work with audio team. Audience avatar. 3

4 Checkpoint 1 Client packaging Online asset repositiory (SVN?) Assure that all assets required for the performance are locally available on client machine Some in XML file, some referenced in code. Must get them all! Asset not there? Get it from repository. Software Correct LUSTER / VT version All required plugins Program parameters (server locations, etc.) Assets Object meshes Materials / Textures / Shaders Audio Etc. Resource / Performance manifest? 4

5 Tasks for Checkpoint 1 Discover what gets loaded for current system Discover where things get loaded from Design a system such that if current VT distribution is out of date, then update. Individual components update OR Bulk update. Members: John Lukasiewicz (G) Laura Wieme (G) Tasks for Quarter Maya as LUSTER design tool Object import and export Scene import and export Materials / textures / shaders Rigged models (work with mocap team) Lighting design. Positional audio (work with audio team) 5

6 Checkpoint 1 Object design Scene design Material / Texture / Shaders Rigged characters Tasks for Checkpoint 1 Explore the means by which objects, scenes, and materials.etc are currently exported from Maya Explore current spec for mocap capable models. Documentation of proposed pipeline for object / scene design and mocap compatibility. NOTE: Scene design using Maya is new to LUSTER / OGRE3D 6

7 Members: Kyle Shay (G) Ben Bloom (G) Brian Murphy Tasks for quarter Live streaming audio Positional audio Attaching sounds to objects. (work with Asset/ audience) Audio control (work with staging) Checkpoint 1 Focus on live streaming audio Singing / dialogue Can be internal / external to LUSTER. 7

8 Tasks for Checkpoint 1: Design of an audio subsystem to enable live streaming audio Investigate VOIP solutions Recommendations on physical setup (i.e what mikes, what environment, software, hardware, etc). New to LUSTER/VR, so experimentation expected. Members: Emmett Coakley (G) Sean Janis (G) Tasks for Quarter Tool for creating cues Tool for managing cues Tool for triggering cues Integrate tool for lighting design (Maya) work with Asset Import. 8

9 3D Virtual stage Stage Mgr app Virtual Theatre (LUA) Predefined cues LUSTER Common sound, lighting, display libraries 9

10 Tasks for Checkpoint 1: Define an interface for the stage manager For managing and triggering cues. Cues currently defined in XML file Explore how they are represented and how they are triggered. Mock-up of stage mgr interface (using FLASH for user interface). Decided to combine the mocap integration and Actor Control teams Tasks from two teams are intimately linked. Crossover between task sets Everyone gets a turn in the suit Set of tasks still distinct Combined team will be responsible for both sets of tasks. 10

to any application MB Plugin (written by Andy Brown) Streams mocap data (in terms of model joints) from MB to Internet LUSTER mocap Plugin

11 Motion Builder 3D Virtual stage Shape Recorder (measurand) MB plugin BVH Virtual Theatre Layer Stage Interface network mocap LUSTER plugin LUSTER Major components: mocap systems themselves OM Stage / measurand ShapeWrap III MotionBuilder (by Autodesk) Primary interface from mocap to any application MB Plugin (written by Andy Brown) Streams mocap data (in terms of model joints) from MB to Internet LUSTER mocap Plugin (written by David) Accepts streamed mocap data and applies to rigged character in LUSTER Character must be properly rigged (work with Asset team) 11

12 Pipeline works well BUT Hard to position actors on virtual stage Hard for actors to exchange objects, drop things, ect. Hard to assign mocap streams to different / multiple virtual actors No good physical actor POV. Members Stephen Sarnell (G) Anoop Thomas (G) Matt Kang Tom Wilson Junxia Xu Student consultants: Abishek Moothedath Pranabesh Sinha 12

13 Major tasks for quarter: Basic mocap logistics for performance Allow actors to exchange objects Make use of Wiimote Allow for easy placement of actors on stage. Allow for easy matching of mocap streams with Virtual Actors. Mechanism for more natural actor POV. Tasks for Checkpoint I: Get mocap systems up and running Exercise existing pipeline Start with measurand. Design LUSTER interface for Actor Assistant: Placement of actor on stage On/off/position perhaps actor roster. Assignment of mocap stream with actor Both currently in staging client. Design interaction mechanism for using Wiimote to exchange objects or other actor tasks. 13

14 Teams: Asset Import Audience Experience Audio mocap Staging Questions so far? Checkpoint 1 Monday, September 28 Checkpoint deliverable will primarily be presentations: Describe designs to class as a whole Describe implementation plan Explain how things might affect other teams. Expectation: 15 minutes / team Time for discussion 14

15 Also on the 28 th We will discuss deliverables for CP2 Primarily implementation of design Between now and then In-class Announcements and such for first 5 minutes Team meeting time for remainder of class time. Brian, David, Abishek, Pranabesh, & I will be available for consultation. LUSTER Runtime: Editor: EditorCandidateReleases/v1.0.2/LusterEditor-v win32.zip VT code SVN: 15

16 MB plugin: SVN: LUSTER mocap plugin: SVN: joglemotionplugin Would like to continue using SVN for codebase May also use SVN for asset/resource management? See what Audience Experience team codes up with. 16

17 Take a break After the break LET THE GAMES BEGIN!!! 17

Plan for this afternoon. Logistics. Spring Job Fair. About the teams. Are We Ready. Team Assignments. Team Assignments Expectations for Checkpoint 1

Plan for this afternoon. Logistics. Spring Job Fair. About the teams. Are We Ready. Team Assignments. Team Assignments Expectations for Checkpoint 1 Plan for this afternoon Team Assignments Team Assignments Expectations for Spring Job Fair Fair: Wednesday, March 28, 11a.m. 4 p.m. in the Gordon Field House. Inteviews Thursday, March 29 More info to