App Development for Smart Devices. Lec #12: Audio and Video

Transcription

1 App Development for Smart Devices CS 495/595 - Fall 2011 Lec #12: Audio and Video Tamer Nadeem Dept. of Computer Science

2 Objective Playing Audio & Video Media Player Recording Audio & Video Media Recorder Taking Video, Picture, Audio Speech Recognition Presentation - Project Proposals (cont d) - Sound Sense: Scalable Sound Sensing for People-Centric Applications on Mobile Phones Presenter: Mostafa Uddin Page 2 Fall 2011 CS 495/595 - App Development for Smart Devices

3 Playing Audio & Video Page 3 Spring 2011 CS 752/852 - Wireless and Mobile Networking

4 Media Format Audio Formats: Wav (PCM uncompressed), AAC, MP3, WMA, AMR, OGG, MIDI Native: 44.1kHz 16 bit stereo Best sampling: 11kHz, 22kHz, or 44.1kHz Remember headphones Good free recording tool: audacity Video Formats: MP4 (MPEG-4 low bit rate) H.263 (3GP) H.264 (AVC) More details: Page 4 Fall 2011 CS 495/595 - App Development for Smart Devices

5 Media Player Comprehensive MediaPlayer to simplify the playback of audio and video. MediaPlayer can play media stored in application resources, local files, Content Providers, or streamed from a network URL. To play a media resource, create a new MediaPlayer instance, initialize it with a media source, and prepare it for playback. Once you ve finished playback, call mediaplayer.release() to free the associated resources. Media Player reference: Page 5 Fall 2011 CS 495/595 - App Development for Smart Devices

6 Media Player The Media Player s management of audio and video files and streams is handled as a state machine. Initialize the Media Player with media to play. Prepare the Media Player for playback. Start the playback. Pause or stop the playback prior to its completing. Playback complete. Page 6 Fall 2011 CS 495/595 - App Development for Smart Devices

7 Preparing for Audio Playback Use the static create method, passing in the application Context and one of the following: A resource identifier A URI to a local file using the file:// schema A URI to an online audio resource as a URL A URI to a local Content Provider row Context appcontext = getapplicationcontext(); MediaPlayer resourceplayer = MediaPlayer.create(appContext, R.raw.my_audio); MediaPlayer fileplayer = MediaPlayer.create(appContext, Uri.parse("file://sdcard/localfile.mp3")); MediaPlayer urlplayer = MediaPlayer.create(appContext, Uri.parse(" MediaPlayer contentplayer = MediaPlayer.create(appContext, Settings.System.DEFAULT_RINGTONE_URI); Page 7 Fall 2011 CS 495/595 - App Development for Smart Devices

8 Preparing for Audio Playback Alternatively, use the setdatasource method on an existing Media Player instance. Accepts a file path, Content Provider URI, streaming media URL path, or File Descriptor. Call prepare on the Media Player before you begin playback MediaPlayer mediaplayer = new MediaPlayer(); mediaplayer.setdatasource("/sdcard/test.3gp"); mediaplayer.prepare(); Page 8 Fall 2011 CS 495/595 - App Development for Smart Devices

9 Preparing for Video Playback Need to specify a display surface on which to show the video. Two methods: <VideoView android:id="@+id/videoview android:layout_height="fill_parent" android:layout_width="fill_parent" > </VideoView> <SurfaceView android:id="@+id/surface" android:layout_width="wrap_content" android:layout_height="wrap_content" android:layout_gravity="center"> </SurfaceView> Use the VideoView control, encapsulates the creation of a display surface and allocation and preparation of video content within a Media Player. Specify your own display surface and manipulate the underlying Media Player instance directly. Page 9 Fall 2011 CS 495/595 - App Development for Smart Devices

10 Video Playback using Video View The Video View supports the playback of local or streaming video as supported by the Media Player component. Video Views conveniently encapsulate the initialization of the Media Player. To assign a video to play, call setvideopath or setvideouri to specify the path to a local file, or the URI of a Content Provider or remote video stream: streamingvideoview.setvideouri(" localvideoview.setvideopath("/sdcard/test2.3gp"); Page 10 Fall 2011 CS 495/595 - App Development for Smart Devices

11 Video Playback using Video View Control playback using the start, stopplayback, pause, and seekto methods. The Video View also includes the setkeepscreenon method to apply a screen Wake Lock that will prevent the screen from being dimmed while playback is in progress. VideoView videoview = (VideoView)findViewById(R.id.videoview); videoview.setkeepscreenon(true); videoview.setvideopath("/sdcard/test2.3gp"); if (videoview.canseekforward()) videoview.seekto(videoview.getduration()/2); videoview.start(); [... do something... ] videoview.stopplayback(); Page 11 Fall 2011 CS 495/595 - App Development for Smart Devices

12 Setting a Surface for Video Playback The Media Player view video content by preparing a Surface onto which the video will be displayed. The Media Player requires a SurfaceHolder object for displaying video content, assigned using the setdisplay method. Once created and assigned the Surface Holder to your Media Player, use the setdatasource method to specify the path, URL, or Content Provider URI of the video resource to play. Call prepare to initialize the Media Player in preparation for playback To include a Surface Holder in your UI layout you use the SurfaceView control as shown in the sample layout XML Page 12 Fall 2011 CS 495/595 - App Development for Smart Devices

13 Surface for Video Playback Sample layout including a Surface View <?xml version="1.0" encoding="utf-8"?> <LinearLayout xmlns:android=" android:orientation="vertical" android:layout_width="fill_parent" android:layout_height="fill_parent"> <SurfaceView android:id="@+id/surface" android:layout_width="wrap_content" android:layout_height="wrap_content" android:layout_gravity="center"> </SurfaceView> </LinearLayout> Page 13 Fall 2011 CS 495/595 - App Development for Smart Devices

14 Surface for Video Playback Initializing and assigning a Surface View to a Media Player (1) public class MyActivity extends Activity implements SurfaceHolder.Callback { private MediaPlayer public void oncreate(bundle savedinstancestate) { super.oncreate(savedinstancestate); setcontentview(r.layout.main); mediaplayer = new MediaPlayer(); SurfaceView surface = (SurfaceView)findViewById(R.id.surface); SurfaceHolder holder = surface.getholder(); holder.addcallback(this); holder.settype(surfaceholder.surface_type_push_buffers); holder.setfixedsize(400, 300); Page 14 Fall 2011 CS 495/595 - App Development for Smart Devices

15 Surface for Video Playback Initializing and assigning a Surface View to a Media Player (2) public void surfacecreated(surfaceholder holder) { try { mediaplayer.setdisplay(holder); mediaplayer.setdatasource("/sdcard/test2.3gp"); mediaplayer.prepare(); mediaplayer.start(); catch (IllegalArgumentException e) { Log.d("MEDIA_PLAYER", e.getmessage()); catch (IllegalStateException e) { Log.d("MEDIA_PLAYER", e.getmessage()); catch (IOException e) { Log.d("MEDIA_PLAYER", e.getmessage()); public void surfacedestroyed(surfaceholder holder) { mediaplayer.release(); public void surfacechanged(surfaceholder holder, int format, int width, int height) { Page 15 Fall 2011 CS 495/595 - App Development for Smart Devices

16 Controlling Playback Once a Media Player is prepared, call start to begin playback. Use the stop and pause methods to stop or pause playback. The Media Player also provides the getduration method to find the length of the media being played, and getcurrentposition to find the playback position. Use seekto to jump to a specific position. mediaplayer.start(); int pos = mediaplayer.getcurrentposition(); int duration = mediaplayer.getduration(); mediaplayer.seekto(pos + (duration-pos)/10); [... wait for a duration... ] mediaplayer.stop(); Page 16 Fall 2011 CS 495/595 - App Development for Smart Devices

17 Controlling Playback Use the islooping and setlooping methods to specify if the media being played should loop when it completes. if (!mediaplayer.islooping()) mediaplayer.setlooping(true); To enable a Wake Lock that will keep the screen on during video playback use the setscreenonwhileplaying method. mediaplayer.setscreenonwhileplaying(true); To control the volume for each channel during playback using the setvolume method. It takes a scalar float value between 0 and 1 for both the left and right channels. mediaplayer.setvolume(1f, 0.5f); Page 17 Fall 2011 CS 495/595 - App Development for Smart Devices

18 Recording Audio & Video Page 18 Spring 2011 CS 752/852 - Wireless and Mobile Networking

19 Recording Audio and Video Two alternatives for recording audio and video within your application: The simplest is to use Intents to launch the video camera app. This option lets you specify the output location and video recording quality, while letting the native video recording application handle the user experience and error handling. The other is to use the Media Recorder class. This option lets you to replace the native app, get more fine-grained control over the video capture UI or recording settings. Page 19 Fall 2011 CS 495/595 - App Development for Smart Devices

20 Using Intents to Record Video Use the ACTION_VIDEO_CAPTURE Media Store static constant in an Intent passed to startactivityforresult to launch the native video camera Activity. startactivityforresult (new Intent(MediaStore.ACTION_VIDEO_CAPTURE), RECORD_VIDEO); The video capture action supports two optional extras EXTRA_OUTPUT - By default, the video recorded will be stored in the default Media Store. If you want to record it elsewhere, you can specify an alternative URI using this extra. EXTRA_VIDEO_QUALITY - The video record action allows you to specify an image quality using an integer value: 0 for low (MMS) quality videos or 1 for high (full resolution) videos. By default, the high resolution mode will be used. Page 20 Fall 2011 CS 495/595 - App Development for Smart Devices

21 Using Intents to Record Video private static int RECORD_VIDEO = 1; private static int HIGH_VIDEO_QUALITY = 1; private static int MMS_VIDEO_QUALITY = 0; private void recordvideo(uri outputpath) { Intent intent = new Intent(MediaStore.ACTION_VIDEO_CAPTURE); if (outputpath!= null) intent.putextra(mediastore.extra_output, output); intent.putextra(mediastore.extra_video_quality, HIGH_VIDEO_QUALITY); startactivityforresult(intent, protected void onactivityresult(int requestcode, int resultcode, Intent data) { if (requestcode == RECORD_VIDEO) { Uri recordedvideo = data.getdata(); // TODO Do something with the recorded video Page 21 Fall 2011 CS 495/595 - App Development for Smart Devices

22 Using the Media Recorder Multimedia recording is handled by MediaRecorder class to record audio and/or video files Your application needs the RECORD_AUDIO and/or RECORD_VIDEO permissions in manifest file. o o <uses-permission android:name="android.permission.record_audio"/> <uses-permission android:name="android.permission.record_video"/> To record, create a new Media Recorder object. Call release on Media Recorder object to free the associated resources Reference: Page 22 Fall 2011 CS 495/595 - App Development for Smart Devices

23 Using the Media Recorder The Media Recorder manages recording as a state machine. Create a new Media Recorder. Assign it the input sources to record from. Define the output format. Specify the audio and video encoder, frame rate, and output size. Select an output file. Prepare for recording. Record. End recording. Page 23 Fall 2011 CS 495/595 - App Development for Smart Devices

24 Configure/Control Video Recording MediaRecorder mediarecorder = new MediaRecorder(); // Configure the input sources mediarecorder.setaudiosource(mediarecorder.audiosource.mic); mediarecorder.setvideosource(mediarecorder.videosource.camera); // Set the output format mediarecorder.setoutputformat(mediarecorder.outputformat.default); // Specify the audio and video encoding mediarecorder.setaudioencoder(mediarecorder.audioencoder.default); mediarecorder.setvideoencoder(mediarecorder.videoencoder.default); // Specify the output file mediarecorder.setoutputfile("/sdcard/myoutputfile.mp4"); // Prepare to record mediarecorder.prepare(); [ ] mediarecorder.start(); [ ] mediarecorder.stop(); mediarecorder.release(); Page 24 Fall 2011 CS 495/595 - App Development for Smart Devices

25 Using Camera and Taking Pictures The easiest way is using the ACTION_IMAGE_CAPTURE Media Store static constant in an Intent passed to startactivityforresult startactivityforresult (new Intent(MediaStore.ACTION_IMAGE_CAPTURE), TAKE_PICTURE); The image capture action supports two modes: Thumbnail - By default, the picture taken will return a thumbnail Bitmap in the data extra within the Intent parameter returned in onactivityresult. Call getparcelableextra specifying the extra name data on the Intent parameter to return the thumbnail as a Bitmap. Full image - Specify an output URI using a MediaStore.EXTRA_OUTPUT extra in the launch Intent, the full-size image taken by the camera will be saved to the specified location. No thumbnail will be returned in the Activity result callback and the result Intent data will be null. Page 25 Fall 2011 CS 495/595 - App Development for Smart Devices

26 Taking Pictures using Intent private static int TAKE_PICTURE = 1; private Uri outputfileuri; private void getthumbailpicture() { Intent intent = new Intent(MediaStore.ACTION_IMAGE_CAPTURE); startactivityforresult(intent, TAKE_PICTURE); private void savefullimage() { Intent intent = new Intent(MediaStore.ACTION_IMAGE_CAPTURE); File file = new File(Environment.getExternalStorageDirectory(), "test.jpg"); outputfileuri = Uri.fromFile(file); intent.putextra(mediastore.extra_output, outputfileuri); startactivityforresult(intent, TAKE_PICTURE); Page 26 Fall 2011 CS 495/595 - App Development for Smart Devices

27 Taking Pictures using protected void onactivityresult(int requestcode, int resultcode, Intent picdata) { if (requestcode == TAKE_PICTURE) { Uri imageuri = null; // Check if the result includes a thumbnail Bitmap if (picdata!= null) { if (picdata.hasextra("data")) { Bitmap thumbnail = picdata.getparcelableextra("data"); // TODO Do something with the thumbnail else { // TODO Do something with the full image stored // in outputfileuri Page 27 Fall 2011 CS 495/595 - App Development for Smart Devices

28 Using Camera Need to add the CAMERA permission to your application manifest. o <uses-permission android:name="android.permission.camera"/> To access the Camera Service, use open method on the Camera class. When you re done, relinquish your hold on Camera by calling release Camera camera = Camera.open(); [... Do things with the camera... ] camera.release(); To modify camera settings, use the set* methods on Camera.Parameters object. Then, call Camera s setparameters method to pass modified Parameters object. Camera.Parameters parameters = camera.getparameters(); List<String> coloreffects = parameters.getsupportedcoloreffects(); if (coloreffects.contains(camera.parameters.effect_sepia)) parameters.setcoloreffect(camera.parameters.effect_sepia); camera.setparameters(parameters); Parameter Reference: Page 28 Fall 2011 CS 495/595 - App Development for Smart Devices

29 Using Camera Monitor the success of the Camera auto focus operation by adding an AutoFocusCallback to the Camera object. camera.autofocus(new AutoFocusCallback() { public void onautofocus(boolean success, Camera camera) { // TODO Do something on Auto-Focus success ); To view the live camera stream, include a Surface View. Implement a SurfaceHolder.Callback to listen for surface s construction, before passing it in to the setpreviewdisplay method of Camera object. A call to startpreview will begin the streaming and stoppreview will end it public class MyActivity extends Activity implements SurfaceHolder.Callback { private Camera public void oncreate(bundle savedinstancestate) { super.oncreate(savedinstancestate); setcontentview(r.layout.main); SurfaceView surface = (SurfaceView)findViewById(R.id.surface); SurfaceHolder holder = surface.getholder(); Page 29 Fall 2011 CS 495/595 - App Development for Smart Devices

30 Using Camera holder.addcallback(this); holder.settype(surfaceholder.surface_type_push_buffers); holder.setfixedsize(400, 300); public void surfacecreated(surfaceholder holder) { if (mediarecorder == null) { try { camera = camera.open(); camera.setpreviewdisplay(holder); camera.startpreview(); [... Draw on the Surface... ] catch (IOException e) { Log.d("CAMERA", e.getmessage()); public void surfacedestroyed(surfaceholder holder) { camera.stoppreview(); camera.release(); Page 30 Fall 2011 CS 495/595 - App Development for Smart Devices

31 Taking Pictures using Camera Call takepicture and pass in a ShutterCallback and two PictureCallback implementations (for RAW and JPEG-encoded). The shutter callback is triggered immediately after the shutter is closed. private void takepicture() { camera.takepicture(shuttercallback, rawcallback, jpegcallback); ShutterCallback shuttercallback = new ShutterCallback() { public void onshutter() { // TODO Do something when the shutter closes. ; PictureCallback rawcallback = new PictureCallback() { public void onpicturetaken(byte[] data, Camera camera) { // TODO Do something with the image RAW data. ; Page 31 Fall 2011 CS 495/595 - App Development for Smart Devices

32 Taking Pictures using Camera PictureCallback jpegcallback = new PictureCallback() { public void onpicturetaken(byte[] data, Camera camera) { ; // Save the image JPEG data to the SD card FileOutputStream outstream = null; try { outstream = new FileOutputStream("/sdcard/test.jpg"); outstream.write(data); outstream.close(); catch (FileNotFoundException e) { Log.d("CAMERA", e.getmessage()); catch (IOException e) { Log.d("CAMERA", e.getmessage()); Page 32 Fall 2011 CS 495/595 - App Development for Smart Devices

33 Recording Sound Use the AudioRecord class to record audio directly from the hardware buffers. int buffersize = AudioRecord.getMinBufferSize(frequency, channelconfiguration, audioencoding); AudioRecord audiorecord = new AudioRecord(MediaRecorder.AudioSource.MIC, frequency, channelconfiguration, audioencoding, buffersize); Add RECORD_AUDIO manifest permission in manifest. o <uses-permission android:name="android.permission.record_audio"/>. Run the startrecording method to begin asynchronous recording. Use the read method to add raw audio data into the recording buffer audiorecord.startrecording(); while (isrecording) { [... populate the buffer... ] int bufferreadresult = audiorecord.read(buffer, 0, buffersize); Page 33 Fall 2011 CS 495/595 - App Development for Smart Devices

34 Recording Sound (Example) int frequency = 11025; int channelconfiguration = AudioFormat.CHANNEL_CONFIGURATION_MONO; int audioencoding = AudioFormat.ENCODING_PCM_16BIT; File file = new File(Environment.getExternalStorageDirectory(), "raw.pcm"); // Create the new file. try { file.createnewfile(); catch (IOException e) { try { OutputStream os = new FileOutputStream(file); BufferedOutputStream bos = new BufferedOutputStream(os); DataOutputStream dos = new DataOutputStream(bos); int buffersize = AudioRecord.getMinBufferSize(frequency, channelconfiguration, audioencoding); Page 34 Fall 2011 CS 495/595 - App Development for Smart Devices

35 Recording Sound (Example) short[] buffer = new short[buffersize]; // Create a new AudioRecord object to record the audio. AudioRecord audiorecord = new AudioRecord(MediaRecorder.AudioSource.MIC, frequency, channelconfiguration, audioencoding, buffersize); audiorecord.startrecording(); while (isrecording) { int bufferreadresult = audiorecord.read(buffer, 0, buffersize); for (int i = 0; i < bufferreadresult; i++) dos.writeshort(buffer[i]); audiorecord.stop(); dos.close(); catch (Throwable t) { Page 35 Fall 2011 CS 495/595 - App Development for Smart Devices

36 Playing Sound Use the AudioTrack class to play raw audio directly into the hardware buffers. AudioTrack audiotrack = new AudioTrack(AudioManager.STREAM_MUSIC, frequency, channelconfiguration, audioencoding, audiolength, AudioTrack.MODE_STREAM); Run the play method to begin asynchronous playback, and use the write method to add raw audio data into the playback buffer. audiotrack.play(); audiotrack.write(audio, 0, audiolength); Write audio into the Audio Track buffer either before play has been called or after. In the former case, playback will commence as soon as play is called. In the latter playback will begin as soon as you write data to the Audio Track buffer. Page 36 Fall 2011 CS 495/595 - App Development for Smart Devices

37 Playing Sound (Example) int frequency = 11025/2; int channelconfiguration = AudioFormat.CHANNEL_CONFIGURATION_MONO; int audioencoding = AudioFormat.ENCODING_PCM_16BIT; File file = new File(Environment.getExternalStorageDirectory(), "raw.pcm"); // Short array to store audio track (16 bit so 2 bytes per short) int audiolength = (int)(file.length()/2); short[] audio = new short[audiolength]; try { InputStream is = new FileInputStream(file); BufferedInputStream bis = new BufferedInputStream(is); DataInputStream dis = new DataInputStream(bis); Page 37 Fall 2011 CS 495/595 - App Development for Smart Devices

38 Playing Sound (Example) int i = 0; while (dis.available() > 0) { audio[audiolength] = dis.readshort(); i++; // Close the input streams. dis.close(); // Create and play a new AudioTrack object AudioTrack audiotrack = new AudioTrack(AudioManager.STREAM_MUSIC, frequency, channelconfiguration, audioencoding, audiolength, AudioTrack.MODE_STREAM); audiotrack.play(); audiotrack.write(audio, 0, audiolength); catch (Throwable t) { Page 38 Fall 2011 CS 495/595 - App Development for Smart Devices

39 Speech Recognition Android supports voice input and speech recognition using the RecognizerIntent class. Voice recognition is initiated by calling startnewactivityforresult, passing in an Intent with RecognizerIntent.ACTION_RECOGNIZE_SPEECH Intent must include RecognizerIntent.EXTRA_LANGUAGE_MODEL extra to specify the language model used to parse the input audio (LANGUAGE_MODEL_FREE_FORM, or LANGUAGE_MODEL_WEB_SEARCH). You can also specify a number of optional extras: EXTRA_PROMPT Specify a string that will be displayed in the voice input dialog to prompt the user to speak. EXTRA_MAXRESULTS Integer value to limit the number of potential recognition results returned. EXTRA_LANGUAGE Specify an input language other than the device default. Page 39 Fall 2011 CS 495/595 - App Development for Smart Devices

40 Speech Recognition (Example) Voice recognition in English, returning one result, with custom prompt. Intent intent = new Intent(RecognizerIntent.ACTION_RECOGNIZE_SPEECH) // Specify free form input intent.putextra(recognizerintent.extra_language_model, RecognizerIntent.LANGUAGE_MODEL_FREE_FORM); intent.putextra(recognizerintent.extra_prompt, "or forever hold your peace"); intent.putextra(recognizerintent.extra_max_results, 1); intent.putextra(recognizerintent.extra_language, Locale.ENGLISH); startactivityforresult(intent, VOICE_RECOGNITION); Page 40 Fall 2011 CS 495/595 - App Development for Smart Devices

41 Speech Recognition (Example) The results are returned through the onactivityresult handler as an Array List of strings in the EXTRA_RESULTS extra each represents a potential protected void onactivityresult(int requestcode, int resultcode, Intent data) { if (requestcode == VOICE VOICE_RECOGNITION && resultcode == RESULT_OK) { ArrayList<String> results; results = data.getstringarraylistextra(recognizerintent.extra_results); // TODO Do something with the recognized voice strings super.onactivityresult(requestcode, resultcode, data); Page 41 Fall 2011 CS 495/595 - App Development for Smart Devices

42 Questions? Page 42 Spring 2011 CS 752/852 - Wireless and Mobile Networking

43 To DO Example - SoundPool Example - VideoView Page 43 Fall 2011 CS 495/595 - App Development for Smart Devices

44 SoundPool Android provides two API's for playing sounds: SoundPool and MediaPlayer. SoundPool can be used for small audio clips. It can repeat sounds and play several sounds simultaneously. The sound files played with SoundPool should not exceed 1 MB. SoundPool does load the file asynchronously. In recent Android SDK, it is possible to check if the loading is complete via OnLoadCompleteListener. Mediaplayer is better suited for longer music and movies. Page 44 Fall 2011 CS 495/595 - App Development for Smart Devices

45 Example of SoundPool Create an application that will start playing a sound once the finger touches the display. Create an Android project cs.edu.odu.cs495.soundpool" with the Activity "PlaySound Get a free sound effect from put it into your "res/raw" folder under the name "sound1.ogg". main.xml <?xml version="1.0" encoding="utf-8"?> <LinearLayout xmlns:android=" android:orientation="vertical" android:layout_width="fill_parent" android:layout_height="fill_parent"> <TextView android:text="click on the screen to start playing" android:id="@+id/textview1" android:layout_width="fill_parent" android:layout_height="fill_parent"> </TextView> </LinearLayout> Page 45 Fall 2011 CS 495/595 - App Development for Smart Devices

46 Example of SoundPool package edu.odu.cs.cs495.soundpool; import android.app.activity; import android.media.audiomanager; import android.media.soundpool; import android.media.soundpool.onloadcompletelistener; import android.os.bundle; import android.util.log; import android.view.motionevent; import android.view.view; import android.view.view.ontouchlistener; public class PlaySound extends Activity implements OnTouchListener { private SoundPool soundpool; private int soundid; boolean loaded = false; Page 46 Fall 2011 CS 495/595 - App Development for Smart Devices

47 Example of SoundPool /** Called when the activity is first created. public void oncreate(bundle savedinstancestate) { super.oncreate(savedinstancestate); setcontentview(r.layout.main); View view = findviewbyid(r.id.textview1); view.setontouchlistener(this); // Set the hardware buttons to control the music this.setvolumecontrolstream(audiomanager.stream_music); // Load the sound soundpool = new SoundPool(10, AudioManager.STREAM_MUSIC, 0); soundpool.setonloadcompletelistener(new OnLoadCompleteListener() public void onloadcomplete(soundpool soundpool, int sampleid, int status) { loaded = true; ); soundid = soundpool.load(this, R.raw.sound1, 1); Page 47 Fall 2011 CS 495/595 - App Development for Smart Devices

48 Example of public boolean ontouch(view v, MotionEvent event) { if (event.getaction() == MotionEvent.ACTION_DOWN) { // Getting the user sound settings AudioManager audiomanager = (AudioManager) getsystemservice(audio_service); float actualvolume = (float) audiomanager. getstreamvolume(audiomanager.stream_music); float maxvolume = (float) audiomanager. getstreammaxvolume(audiomanager.stream_music); float volume = actualvolume / maxvolume; // Is the sound loaded already? if (loaded) { soundpool.play(soundid, volume, volume, 1, 0, 1f); Log.e("Test", "Played sound"); return false; Page 48 Fall 2011 CS 495/595 - App Development for Smart Devices

49 Example of VideoView A simple example using VideoView to play 3gp from YouTube main.xml <?xml version="1.0" encoding="utf-8"?> <LinearLayout xmlns:android=" android:orientation="vertical" android:layout_width="fill_parent" android:layout_height="fill_parent" > <TextView android:layout_width="fill_parent" android:layout_height="wrap_content" android:text="@string/hello" /> <LinearLayout android:orientation="vertical" android:layout_width="fill_parent" android:layout_height="wrap_content"> <VideoView android:id="@+id/myvideoview" android:layout_width="fill_parent" android:layout_height="wrap_content" /> </LinearLayout> </LinearLayout> Page 49 Fall 2011 CS 495/595 - App Development for Smart Devices

50 Example of VideoView package edu.odu.cs.cs495.myvideoview; import android.app.activity; import android.net.uri; import android.os.bundle; import android.widget.mediacontroller; import android.widget.videoview; public class MyVideoView extends Activity { String SrcPath = "rtsp://<replace WITH PATH TO YouTube video (3gp)>"; /** Called when the activity is first created. public void oncreate(bundle savedinstancestate) { super.oncreate(savedinstancestate); setcontentview(r.layout.main); VideoView myvideoview = (VideoView)findViewById(R.id.myvideoview); myvideoview.setvideouri(uri.parse(srcpath)); myvideoview.setmediacontroller(new MediaController(this)); myvideoview.requestfocus(); myvideoview.start(); Page 50 Fall 2011 CS 495/595 - App Development for Smart Devices