T Multimedia Programming. Different Operating Systems and their Multimedia Support

Transcription

1 T Multimedia Programming Different Operating Systems and their Multimedia Support Carlos Herrero September 27, 2007

2 Contents Windows DirectX.NET Framework Linux KDE & Gnome Gstreamer SDL Mac OS X QuickTime Symbiam MMF Helix Java JMF JSRs

3 Windows DirectX is the most important Multimedia Framework in Windows First version was introduced in 1995 (Windows 95) Current versions are 9.0 (Windows XP) and 10.0 (Windows Vista and Xbox 360)

4 DirectX APIs DirectX Graphics DirectDraw (2D) Direct3D DirectInput DirectPlay DirectSound DirectSound3D DirectMusic DirectSetup DirectX Media DirectAnimation DirectShow DirectX Video Acceleration Direct3D Retained Mode DirectX Transform DirectX Media Objects

5 DirectX Architecture & GDI GDI (Graphical Device Interface) Responsible for drawing primitives (lines, curves) Adequate for games and MM apps that do not require fast graphical rendering

6 .NET Framework Managed DirectX released to work with.net Mono is an opensource implementaton of CLI and.net Base Class Library (BLC)

7 Linux There are several different Linux distributions: Debian, Ubuntu, Knoppix Slackware, Suse, Gentoo Red Hat, Fedora, Mandriva, Yellow Dog The two most important desktop environments are KDE and GNOME

8 KDE K Desktop Environment is based on Trolltech's Qt toolkit. KDE includes desktop applications (KOffice, Konqueror) and developer tools (Kdevelop). Qt is now a free software cross-platform GUI development framework. Qt didn't use a free software license when KDE was launched.

9 GNOME Launched one year after KDE because of license concerns. GTK+ was used to replace non free licensed Qt toolkit. GTK+ native language is C, whereas C++ is for Qt. It is the official desktop environment of the GNU Project (Free Software Fundation). Includes Totem, a multimedia player based on GStreamer framework.

10 GStreamer Open-source multimedia framework based on GObject and written in C. It can be used to implement any kind of multimedia application. Different codecs, formats and drivers supported via plugins. GStreamer is used, e.g., in Maemo environment (Nokia tablets N800 and 770) and GNOME desktop environment

11 Gstreamer Architecture GStreamer has a graph based structure Mp3 player...

12 SDL Simple DirectMedia Layer (SDL) is an opensource, cross-platform multimedia library. It gives access to audio, keyboard, mouse, joystick, 3D hardware (i.e., OpenGL), and 2D Video Frame buffer. SDL supports Windows, Linux, Mac OS, etc.

13 SDL Architecture SDL apps: Doom 3 Quake 4 Unreal Freeciv

14 Contents Windows DirectX.NET Framework Linux KDE & Gnome Gstreamer SDL Mac OS X QuickTime Symbiam MMF Helix Java JMF JSRs

15 Mac OS X Mac OS X is based on Mach Kernel and BSD implementation of UNIX. Darwin is Apple's open source OS, similar to MAC OS X, but without Carbon and Cocoa APIs, Aqua user interface and Quartz compositor (windowing system)

16 QuickTime QuickTime is Apple's multimedia framework. Supports Mac OS X, Windows and old Mac OS. API for encoding and decoding audio and video. QuickTime file format is a multimedia container file. Competitors: MS ASF, ogg, Matroska. QuickTime for Java supports capturing, editing, playback, etc.

17 Symbian Symbian OS was originally built for handheld devices, with limited resources. Symbian C++ development: Carbide.c++, an Eclipse-based IDE developed by Nokia. Java ME applications for Symbian OS are developed using standard techniques and tools such as the Sun Java Wireless. Symbian Multimedia Framework API (MMF) supports recording, playback and streaming for audio and video, plus image functionalities.

18 Helix Framework Helix DNA is an open-source multimedia player project based on the RealPlayer. The Helix Framework contains streaming server, players, codecs, and production tools. All components are available either as commercial or open source software Since May 2006, Helix was included in over a hundred mobile phones and was distributed more than 125 million times. It is also distributed within Maemo environment.

19 Java Java is an object oriented programming language developed by Sun Microsystems. Java programs are first compiled to Java bytecode, which is then interpreted by Java Virtual Machine (JVM). Sun has defined three platforms: Java Platform, Micro Edition (Java ME) environments with limited resources Java Platform, Standard Edition (Java SE): workstation environments Java Platform, Enterprise Edition (Java EE): large distributed enterprise or Internet environments

20 Java

21 Java Media Framework JMF allows use of multimedia in Java applications Real-time network protocols Multiplexing Codecs Players File f = new File (fdialog.getfile()); Effects p.start(); Capture Control Player p = Manager.createRealizedPlayer (f.tourl());

22 Java Community Process Third parties can participate in Java platform development by proposing JSRs. A Java Specification Request (JSR) describes a technology to be added to the Java platform. Most important Multimedia-related JSRs are: JSR 135: Java Mobile Media API (for J2ME platform) JSR 32 and JSR 180: Java SIP APIs JSR 231 and 926: Java 3D graphic APIs JSR 184 and 239: Java 3D graphic APIs for J2ME JSR 226: Scalable 2D Vector Graphics API (J2ME) JSR 234: Java Advanced Multimedia API for J2ME JSR 272: Mobile Broadcast Service API for J2ME

23 Conclusions Windows DirectX.NET Framework Linux KDE & Gnome Gstreamer SDL Mac OS X QuickTime Symbiam MMF Helix Java JMF JSRs