Distributed Multimedia Systems

Transcription

1 Distributed Multimedia Systems 8. Multimedia Applications László Böszörményi Distributed Multimedia Systems Multimedia Applications - 1

2 Application Categorization Market-oriented view Kiosk, educational, cooperative work applications Communication-oriented view Interactive or distribution-oriented applications Media food chain Preparation Composition Integration Communication Consumption Entertainment László Böszörményi Distributed Multimedia Systems Multimedia Applications - 2

3 Media Preparation Multimedia I/O hardware + software Audio support Multiple-channel digital sound tracks, interaction via helmet Video support Video board + digitizers (up to 60 fps HDTV) Graphical displays Normal, head-mounted, surrounded displays, holography Scanner devices Image scanners, photo scanners (>2000 pixels/inch) Recognition devices Tracking devices László Böszörményi Distributed Multimedia Systems Multimedia Applications - 3

4 Media Composition: Text,Graphics, Image Text editors Fonts, text styles, text effects, graphical capabilities E.g. MS Word, CorelDRAW, MacDraw Graphics editors (2D, 3D) Manipulate on mathematical representations Image editors (e.g. xv) manipulate on pixels Pixel replication Sampling and filtering (high frequencies) Aliasing (instead filtering: high low frequencies) Anti-aliasing (to smooth staircasing) Increase of resolution, change intensity, color Image + graphics combined E.g. Photoshop (Adobe), PhotoStyler (Aldus) László Böszörményi Distributed Multimedia Systems Multimedia Applications - 4

5 Media Composition: Animation Animation editors (4D) Manipulate mathematical representations Additional dimension: time Tweening The intermediate frames are automatically generated from the key frame Morphing (polymorphic tweening) Transforms a shape into another shape (in The Lion King) Temporal anti-aliasing (smoothing staircasing in time) Animation tools Integrate a number of media editors E.g. Gold Disc: Movie + Cel + background editor László Böszörményi Distributed Multimedia Systems Multimedia Applications - 5

6 Sound editors Media Composition: Sound Locating and storing sounds Record, read from file, retrieve from pasteboard, create Recording and playback 8000 samples/sec, 12 bit precision, compression to 8 bits Editing Copy/paste, cut, delete, insert, replace Fragmented sound data must be compacted, otherwise playback may suffer under inefficiency E.g. MIDI-editors Allow e.g. to synthesize orchestral music Music synthesis, special effects (e.g. hall echos) Hardware support by DSPs (digital signal processor) László Böszörményi Distributed Multimedia Systems Multimedia Applications - 6

7 Video editors Media Composition: Video Individual frames can be edited as in image editors Temporal aspects as in animation editing E.g. combine several cuts into a sequence etc. E.g VidEdit, D/Vision Pro Video book FH Joanneum Graz The one-dimensional time line is made visible in the two-dimensional space Book paradigm A whole film can be presented on a few pages László Böszörményi Distributed Multimedia Systems Multimedia Applications - 7

8 Media Integration Multimedia editors Integrate all kind of data Unified view, coordinated control, multiple buffers, light-weight windows (panes) Extremely large documents, often partitioned E.g. Diamond Multimedia Editor (Diamond) Hypermedia / Hypertext Editors (HTML, SGML) Multimedia combined with non-linear links E.g. Hypercard (Macintosh), DynaText (Sun), NoteCard (Xerox PARC), Hyper-G (TU Graz) Authoring tools E.g. PowerPoint, MovieWorks (QuickTime) László Böszörményi Distributed Multimedia Systems Multimedia Applications - 8

9 Media Communication: Interactive Conversational service Synchronous communication, e.g. video conference Messaging service Asynchronous communication, e.g. blackboard Retrieval service Database queries Tele-action, tele-operation service Alarm and surveillance Transaction processing, business automation Control and command (tele-metry), utility resource management László Böszörményi Distributed Multimedia Systems Multimedia Applications - 9

10 Media Communication: Distribution Pay-per-view Set-top decoder box Video-on-demand (VOD) Near video-on-demand Compromises broadcasting and VOD Interactive TV, Cyber Vision The user may change the content or at least the flow László Böszörményi Distributed Multimedia Systems Multimedia Applications - 10

11 Media Consumption Browsing, navigation, displaying, annotation Books, proceedings, newspapers Customized access possible Kiosks Airport, train station, bank assistant, cinema information, real-estate catalogue, university, museum showcase etc. Fast response is necessary Tele-shopping László Böszörményi Distributed Multimedia Systems Multimedia Applications - 11

12 Virtual Reality Interactive TV Video-on-demand Interactive Audio Media Entertainment User may enter the music scene Games Tele-games László Böszörményi Distributed Multimedia Systems Multimedia Applications - 12

13 Trends New application domains instead of just reengineering of old ones Multi-user applications Personalized user environment (active books) Distributed environments Open solutions running on many platforms Interactive applications instead of passive consumption Bi-directional communication services instead of unidirectional communication??? László Böszörményi Distributed Multimedia Systems Multimedia Applications - 13