Samsung Electronics Co. Ltd. Sung H. Lee

Transcription

1 Present and Future Direction of Mobile Benchmarks Samsung Electronics Co. Ltd. Sung H. Lee Mobile Forum 2014 Copyright 2014 Sung H. Lee, Samsung

2 Benchmark, is it Beauty Contest?

3 Benchmark, is it Beauty Contest? What is mean to US? Is it fair to judge and compare one to another?

4 I don t know how many(? much) System CPU GPU/3D [source: Korean Google Play store ]

5 I don t know how many(? much) System CPU GPU/3D [source: Korean Google Play store ]

6 New Technology CPU Memory Storage Display Battery OS LP3 Quad Octo LP4 Single LP2 Dual

7 What GROUND?

8 What GROUND?

9 What GROUND? Which one is better?

10 What GROUND? Which one is better?

11 What GROUND? Which one is better?

12 What GROUND? Which one is better?

13 What GROUND? Which one is better?

14 What GROUND? Which one is better?

15 What GROUND? Which one is better?

16 Ex) Case Study Conditions

17 Ex) Case Study Results MobileBench * Higher is better integer float read write sread swrite rread rwrite 2D 3D-Object α β 100 MobileBench-UX * Lower is better α β -60 Booting Video Playback Multi Video Playbcak Video Playback with App. Install Camera Video Creating Video Transcoding App. Install App. Switching ADB File Write ADB File Read MTP File Write MTP File Read β compare to α

18 Ex) Case Study Results: Processor α β α β α β 1 st 2 nd 3 rd Processor integer Processor float G2 Nexus5 G2 Nexus5 G2 Nexus5 1 회차 2 회차 3 회차

19 Ex) Case Study Results: Processor α β

20 Ex) Case Study Results: 2D α : 52fps β : 35fps α G2 Nexus5 G2 Nexus5 G2 Nexus5 β α β α β 1회차회차회차 1 st 2 nd 3 rd

21 Ex) Case Study Results: 3D α : 60fps β : 60fps α β α β α β 회차회차회차 1 st 2 nd 3 rd G2 Nexus5 G2 Nexus5 G2 Nexus5

22 Ex) Case Study Results: CPU monitoring α β

23 Ex) Case Study Results: UX * Lower is better Alpha Beta Video Playback Multi Video Playbcak Video Playback with App. Install Camera

24 Ex) Case Study Results: UX Frame Drop & Delay times Distribution of small frame drop & delay vs. big single frame drop & delay α Resource Usages Two different way of controlling write back β α β

25 Now

26 It is TIME for us to OPEN UP UX Processor Storage Optimization GPU OS Display Memory

27 So it is formed Consortium

28 It is Open Standard Body Total benchmark solutions * for Mobile Measure H/W performance & User experience Support Real time monitoring & full reports * MobileBench 1.0 & MobileBench-UX 1.0 are available NOW for Member only Public version will be available at the end of year

29 Open Standard Benchmark Standard Memory / Storage maker Carrier service Consortium Set manufacturer Chipset maker

30 Open Standardization will bring

31 What to test How to measure How long We can define What pre-conditions What test conditions User experience based, not just h/w and More

32 End of the DAY, Bench does not have to contest!

33 What do you look for? When you buy or install S/W for PC

34 What do you look for? When you buy or install S/W for PC

35 Unfortunately not the case for mobile? [source: entech.net]

36 Unfortunately not the case for mobile [source: entech.net]

37 DO WE KNOW WHAT TO BENCHMARK? Benchmark should not be just SCORE But better represent USER requirement CPU GPU DISPLAY Memory Storage

38 Welcome to join MobileBench Renaissance Shanghai Yu Garden Hotel 16 th of October 2014 (9am ~ 12pm) Lunch will be provided Registration:

39 Thank You