the recording of an activity by a participant in the activity, typically by way of small wearable or portable personal technologies

Size: px

Start display at page:

Download "the recording of an activity by a participant in the activity, typically by way of small wearable or portable personal technologies"

Shon Walton
5 years ago
Views:

2 Sousveillance the recording of an activity by a participant in the activity, typically by way of small wearable or portable personal technologies coined by Steve Mann stems from the contrasting French words sur, meaning "above", and sous, meaning "below", "surveillance" denotes the "eye-in-the-sky" watching from above, whereas "sousveillance" denotes bringing the camera or other means of observation down to human level, either physically (cameras on people rather than on buildings)

3 Mann's "Veillance Compass" diagram

4 Quis custodiet ipsos custodes? "Who will guard the guards themselves?" is a Latin phrase found in the work of the Roman poet Juvenal (Satire VI, ) In episode 1F09, "Homer the Vigilante", when Homer is talking about having abused his vigilante powers, his elder daughter Lisa asks, "If you're the police, who will police the police?" Homer responds, "I don't know. Coast Guard?"

7 Augmented reality (AR) a live view of a physical, real-world environment augmented (or supplemented) by computer-generated graphics and sensory input such as GPS data, audio, and video, enhancing one s current perception of reality. In contrast, virtual reality replaces the real environment with a simulated one. Augmentation is in real time and in semantic context with environmental elements, such as sports scores on TV during a match. Information about the environment and its objects is overlaid on the real world closely aligned with where they actually are in space. An example is an AR Helmet for construction workers which displays information about the construction sites.

8 An augmented reality system is one that: Combines aspects of the real and the virtual Is interactive in real-time Is registered in three dimensions

9 Examples of AR Yellow first down line used on TV broadcasts of football games: Real world elements: football field and players Virtual element: the yellow line drawn over the image by computers in realtime

Wikitude AR Travel Guide Mobile travel guide for the Android platform (open source

For location-based augmented reality, the position of objects on the screen of the

direction in which the user is facing (by using the compass) and accelerometer.

10 Wikitude AR Travel Guide Mobile travel guide for the Android platform (open source OS for cell phones). For location-based augmented reality, the position of objects on the screen of the mobile device is calculated using the user's position (by GPS or Wifi), the direction in which the user is facing (by using the compass) and accelerometer. Since August 2012, Wikitude also features image recognition technologies that allow for tracker images to trigger augmented reality technology within the app.

Milgram s reality-virtuality continuum a

elements have been integrated an Augmented

physical elements have been integrated a

11 Milgram s reality-virtuality continuum a completely physical space which has no virtual elements an Augmented Reality space is a physical space where virtual elements have been integrated an Augmented Virtuality space is a virtual space where physical elements have been integrated a completely virtual space which has no physical elements

12 Augmented Reality vs. Virtual Reality Augmented Reality System augments the real world scene User maintains a sense of presence in the real world Needs a mechanism to combine virtual and real worlds Hard to register real and virtual Virtual Reality Totally immersive environment Senses are under control of system Need a mechanism to feed virtual world to user Hard to make VR world interesting

13 Combining the Real and Virtual Worlds We need: Locations and optical properties of the viewer (or camera) and the display Calibration of all devices To combine all local coordinate systems centered on the devices and the objects in the scene in a global coordinate system

14 Combining the Real and Virtual Worlds Register models of all 3D objects of interest with their counterparts in the scene Track the objects over time when the user moves and interacts with the scene

15 Realistic Merging Requires: Objects to behave in physically plausible manners when manipulated Occlusion Collision detection Shadows

16 Research Activities Develop methods to register the two distinct sets (real, virtual) of images and keep them registered in real-time This often reduces to finding the position of a camera relative to some fiducial markers Develop new display technologies to facilitate merging

17 Performance Issues Two performance criteria are placed on the system: Update rate for generating the augmenting image Accuracy of the registration of the real and virtual image Update rate can limit registration accuracy as well 1 ms = 1mm error

18 Failures in Registration Failures in registration due to: Noise Position and pose of camera with respect to the real scene Image distortions Time delays In calculating the camera position

19 Display Technologies Monitor Based Laptops Cell phones Projectors (more Ubiquitous Computing) Head Mounted Displays: Video see-through Optical see-through

20 Monitor Based Augmented Reality Simplest available Treat laptop/pda/cell phone as a window through which you can see AR world.

21 Monitor Based AR Successful commercialization Yellow line in football broadcasts Glowing hockey puck Replace times square billboards with own commercials during New Year s Eve broadcasts Baseball cards Ad campaigns

22 A beam splitter is an optical device that splits a beam of light in two. In its most common form, a cube, it is made from two triangular glass prisms which are glued together at their base using polyester, epoxy, or urethanebased adhesives. The thickness of the resin layer is adjusted such that (for a certain wavelength) half of the light incident through one "port" (i.e., face of the cube) is reflected and the other half is transmitted due to frustrated total internal reflection. 1 - Incident light 2-50% Transmitted light 3-50% Reflected light

23 Optical see-through HMD

24 Video see-through HMD

25 Advantages of Video see-through HMD Flexibility in composition strategies Real and virtual view delays can be matched

26 Advantages of Optical see-through HMD Simplicity Resolution No eye offset

A head-up display or heads-up display also known as a HUD, is any transparent display that presents data without requiring users to look away from their usual viewpoints.

28 A head-up display or heads-up display also known as a HUD, is any transparent display that presents data without requiring users to look away from their usual viewpoints. The origin of the name stems from a pilot being able to view information with the head positioned "up" and looking forward, instead of angled down looking at lower instruments. A HUD also has the advantage that the pilot's eyes do not need to refocus to view the outside after looking at the optically nearer instruments. Although they were initially developed for military aviation, HUDs are now used in commercial aircraft, automobiles and other, mostly professional applications.

29 Displays handheld displays Handheld, flat panel LCD Displays Camera provides video seethrough

30 User Interface How do we Identify what data to provide Present data in the most effective manner Make user queries and reports effective

31 Social Acceptance How do we persuade a user to wear an AR system? Issues include but not limited to Fashion Privacy concerns

32 Smart glasses wearable computer glasses that add information alongside or to what the wearer sees, typically achieved with an optical head-mounted display (OHMD) or embedded wireless glasses with transparent heads-up display (HUD). Some are handsfree and can communicate with the Internet via natural language voice commands, while others use touch interfaces and buttons.

an EyeTap uses a beam splitter to send the same scene (with reduced intensity) to both the eye and a camera. The camera then digitizes the reflected image of the scene and sends it to a computer.

34 an EyeTap uses a beam splitter to send the same scene (with reduced intensity) to both the eye and a camera. The camera then digitizes the reflected image of the scene and sends it to a computer. The computer processes the image and then sends it to a projector. The projector sends the image to the other side of the beam splitter so that this computer-generated image is reflected into the eye to be superimposed on the original scene.

37 an optical head-mounted display (OHMD) Google Glass displayed information in a smartphone-like hands-free format. communicated with the Internet via natural language voice commands Google started selling a prototype of Google Glass to qualified "Glass Explorers" in the US on April 15, 2013, for a limited period for $1,500, before it became available to the public on May 15, The headset originally received a great deal of criticism and legislative action due to privacy and safety concerns. On January 15, 2015, Google announced that it would stop producing the Google Glass prototype.

41 Developer Google Manufacturer Foxconn Type Optical head-mounted display (OHMD), Wearable technology, Release date Developers (US): February 2013 Public (US): Around 2013 Introductory price:$1,500 USD Discontinued January 15th, 2015 Operating system:glass OS CPU OMAP 4430 System on a chip, dual-core processor Memory 2 GB RAM Storage 16 GB flash memory total (12 GB of usable memory) Display Prism projector, pixels (equivalent of a 25 in/64 cm screen from 8 ft/2.4 m away) Sound Bone conduction transducer Input Voice command through microphone, accelerometer, gyroscope, magnetometer, ambient light sensor, proximity sensor Controller input Touchpad, MyGlass phone mobile app Camera 5 Megapixel photos, 720p video Connectivity Wi-Fi b/g, Bluetooth, micro USB Power 570 mah Internal lithium-ion battery Weight 36 g (1.27oz)

42 Head-mounted displays are not designed to be workstations, and traditional input devices such as keyboard and mouse do not support the concept of smart glasses. Instead Human Computer Interface (HCI) control input needs to be methods lend themselves to mobility and/or hands-free use are good candidates, for example: Touchpad or buttons Compatible devices (e.g. smartphones or control unit) for remote control Speech recognition Gesture recognition Eye tracking Brain computer interface

Smart Glasses & Applications. Presenter: Xu Qiu! Advisor: C.-C. (Jay) Kuo!

Smart Glasses & Applications. Presenter: Xu Qiu! Advisor: C.-C. (Jay) Kuo! Smart Glasses & Applications Presenter: Xu Qiu Advisor: C.-C. (Jay) Kuo 1 1 Outline Introduction Comparison of Smart Glasses Apps for Developing Platform Development and Implementation of Computer Vision