BENCHMARK CPU TESTING OF 13-INCH-CLASS LAPTOPS

Similar documents
A PRINCIPLED TECHNOLOGIES TEST SUMMARY DELL REFERENCE CONFIGURATIONS: SCALABLE PERFORMANCE AND SIMPLICITY IN SETUP AUGUST 2012

HP ELITEPAD 1000 G2 POWERED BY INTEL IN HEALTHCARE

INCREASING DENSITY AND SIMPLIFYING SETUP WITH INTEL PROCESSOR-POWERED DELL POWEREDGE FX2 ARCHITECTURE

VIRTUALIZATION PERFORMANCE: VMWARE VSPHERE 5 VS. RED HAT ENTERPRISE VIRTUALIZATION 3

DELL PREMIUM SUPPORT WITH SUPPORTASSIST TECHNOLOGY IMPROVES THE SUPPORT EXPERIENCE

A PRINCIPLED TECHNOLOGIES TEST REPORT DELL ACTIVE SYSTEM 800 WITH DELL OPENMANAGE POWER CENTER

A Principled Technologies deployment guide commissioned by QLogic Corporation

COMPARING DESKTOP DRIVE PERFORMANCE: SEAGATE SOLID STATE HYBRID DRIVE VS. HARD DISK DRIVES AND SEAGATE CLIENT SOLID STATE DRIVE

RESOLVING PROBLEMS WITH DELL PROSUPPORT PLUS AND SUPPORTASSIST TECHNOLOGY

iscsi STORAGE ARRAYS: AND DATABASE PERFORMANCE

VDI PERFORMANCE COMPARISON: DELL POWEREDGE FX2 AND FC430 SERVERS WITH VMWARE VIRTUAL SAN (ABRIDGED)

Microsoft Surface Book balances battery life, display quality, performance, and portability

Comparing battery life and boot performance in Microsoft Windows 10 S and Windows 10 Pro

Upgrade to Intel Optane memory and save time on everyday tasks

DEPLOYING NEW DELL SOLUTIONS WITH DELL PRODEPLOY

TABLET COMPARISON WITH BENCHMARKS TABLETS WE TESTED A PRINCIPLED TECHNOLOGIES TEST REPORT. SEPTEMBER 2014 (Revised) Commissioned by Intel Corp.

Cost savings of disk-based backup using a Dell PowerVault DL Backup to Disk Appliance powered by Symantec Backup Exec 2010 R2 vs.

TIME TO UPDATE FIRMWARE: DELL LIFECYCLE CONTROLLER 2 VS. HP INTELLIGENT PROVISIONING

WHITE PAPER February Rich clients with thin client data security: a hybrid approach

CPU PERFORMANCE COMPARISON: VMWARE VCLOUD AIR, MCROSOFT AZURE, AND AMAZON WEB SERVICES

Cost savings of disk-based backup using the Dell PowerVault DL2100 powered by Symantec Backup Exec 2010 vs. tape-based backup

How to deploy a Microsoft Windows 10 image to an AMD processor-based laptop or desktop

A Principled Technologies deployment guide commissioned by Dell Inc.

Get more work done with a Chromebook powered by an Intel Core m3 processor

Figure 2: Dell offers significant savings per chassis over HP and IBM in acquisition costs and 1-, 3-, and 5-year TCO.

98 % A cloud abroad in Paris. PREVIEW A SITE THEME in up to. LESS TIME with Sites. EMBED A YOUTUBE VIDEO in a page in. FEWER STEPS with Sites

CISCO UCS: MEETING THE GROWING NEED FOR BANDWIDTH

TEST REPORT SEPTEMBER

42 % Not all clouds are created equal. SEND AND RECEIVE ATTACHMENTS in up to. LESS TIME with Gmail. A comparison of Gmail and Outlook

50 % fewer steps to resolution

CHROMEBOOKS IN THE CLASSROOM: A COMPARISON

Stay engaged in your academic work with a Chromebook powered by the Intel Core m3 processor

VIRTUALIZED BACKUP ADVANTAGES OF THE DELL POWERVAULT DL BACKUP TO DISK APPLIANCE POWERED BY SYMANTEC BACKUP EXEC 2010 R3

Use your favorite Android apps on Chromebooks and spend less time waiting

10Gb iscsi Initiators

A Principled Technologies test report 1. Get a better Web browsing experience with an Intel processorpowered tablet

NOTEBOOK COMPUTER PERFORMANCE: LENOVO THINKPAD T420 VS. THINKPAD T430

AMD: WebBench Virtualization Performance Study

Wait less and stay unplugged longer using Microsoft Windows 10 laptops with SSDs

WORKSTATION HEAT AND POWER USAGE: LENOVO THINKSTATION P900 VS. DELL PRECISION T7910 WORKSTATION

71 % 1/5. Not all clouds are created equal. JOIN & LEAVE VIDEO CALLS in up to. LESS TIME with Google Hangouts. SHARED SCREENS appear in as little as

CHOOSING THE RIGHT CHROMEBOOK FOR THE CLASSROOM

HP CHROMEBOOK 14 G1 IN THE CLASSROOM

CONSOLIDATING SQL SERVER 2008 ONTO DELL POWEREDGE R900 AND POWEREDGE R905 USING MICROSOFT S HYPER-V

WORKSTATION HEAT, SOUND, AND POWER USAGE: LENOVO THINKSTATION S30 VS. HP Z420 WORKSTATION

BOOSTING YOUR STORAGE SERVER PERFORMANCE WITH THE INTEL XEON PROCESSOR E V2 PRODUCT FAMILY

TEST REPORT. SEPTEMBER 2007 Linpack performance on Red Hat Enterprise Linux 5.1 and 3 AS Intel-based servers

COMPARING CHROMEBOOKS FOR CONSUMERS: INTEL CELERON VS. ARM

COMPARING CHROMEBOOKS IN THE CLASSROOM

Exclusive pricing for UW students, faculty, staff and UWAA members!

Save time and IT effort resolving server hardware issues with ProSupport Plus and SupportAssist

Increase your productivity with a Chromebook powered by an Intel Core m3 processor

TABLETS IN SCHOOLS: DELL LATITUDE 10 ESSENTIALS CONFIGURATION WITH WINDOWS 8 VS. APPLE IPAD

Dell ImageDirect time savings evaluation

Dell Precision M3800 Apple MacBook Pro Retina

WebBench performance on Intel- and AMD-processorbased servers running Red Hat Enterprise Linux v.4.4

WINDOWS COMPUTER Price List

BENEFITS VIDEO BENEFITS STUDY MANAGEABILITY STUDY CONFIGURATION GUIDE PERFORMANCE REPORT

Acer Chromebook R13. Managed by Bundle includes: Acer Chromebook R13 3 Year On-site Warranty

Auburn University at Montgomery Policies and Procedures

XPS 15 Setup and Specifications

ENDPOINT MANAGEMENT WITH VMWARE HORIZON MIRAGE ABRIDGED REPORT

64-bit Black-Scholes financial workload performance and power consumption on uniprocessor Intel-processor-based servers

PERFORMANCE COMPARISON: DELL LATITUDE E6430 VS. LENOVO THINKPAD T430

Essential Dell Bundle

DATABASE PERFORMANCE OF INTEL CACHE ACCELERATION SOFTWARE

Essential Dell Bundle

ALIENWARE M11x COMPREHENSIVE SPECIFICATIONS

Dell ImageDirect time savings evaluation

CPU PERFORMANCE COMPARISON OF TWO CLOUD SOLUTIONS: VMWARE VCLOUD HYBRID SERVICE AND MICROSOFT AZURE

INTEL-POWERED HP CHROMEBOOK 14 IN THE CLASSROOM

Msystems Ltd. Specifications. Computer model. System information. Dimensions and weight. Operating system. Memory.

Technical Specifications

In our testing, we used the WMLS test tool to determine the maximum number of test video streams that each storage solution could handle acceptably.

FASTER AND MORE EFFICIENT SYSTEM MANAGEMENT WITH LENOVO XCLARITY ADMINISTRATOR VS. CISCO UCS MANAGER

XPS 15. Setup and Specifications. Computer Model: XPS Regulatory Model: P56F Regulatory Type: P56F002

Connect to your workspace easily with the Dell dock that fits your needs

Essential Dell Bundle

XPS 13 Convertible Setup and Specifications

A PRINCIPLED TECHNOLOGIES TEST REPORT. CISCO UCS DELIVERS FASTER BLADE SERVER DEPLOYMENT THAN HP c-class BLADES WITH HP VIRTUAL CONNECT

Pico 43, 49, 55 Specifications Sheet

Spend less time waiting on your Chromebook when using your favorite Android apps

Alienware 17. Views. Specifications. NOTE: The images in this document may differ from your computer depending on the configuration you ordered.

Alienware 13. Views. Specifications. NOTE: The images in this document may differ from your computer depending on the configuration you ordered.

Inline Touch Displays. Specifications

Inspiron Setup and Specifications Series. Computer Model: Inspiron 5448 Regulatory Model: (P49G) Regulatory Type: (P49G001)

TEST REPORT. JUNE 2007 SPECjbb2005 performance and power consumption on Dell and HP blade servers

INSIDE EXPLORER HARDWARE CATALOGUE MAKING THE INSIDE VISIBLE - AN INTUITIVE AND INTERACTIVE 3D LEARNING EXPERIENCE V 1.

Drafting. Specifications

Alienware 13 R3 Setup and Specifications

TEST REPORT SEPTEMBER 2009 SPECjbb2005 performance and price of the Dell PowerEdge R710 and HP ProLiant DL380 G6

No. RIS/109/2/1/ November Limited tender for the Procurement of Desktop/Laptop Computer

Inspiron Setup and Specifications

Inspiron Setup and Specifications

w Colossus 86 Specifications Sheet COLOSSUS SPEC SHEET v1.0 / EFFECTIVE 01/03/2019 / *SUBJECT TO CHANGE

DELL POWEREDGE C6220 AND UBUNTU SERVER: A LAMP REFERENCE ARCHITECTURE

XPS 13 Setup and Specifications

DELL POWEREDGE C4130 & INTEL XEON PHI COPROCESSOR 7120P

Platform. Specifications. EFFECTIVE July 24, 2018 / SUBJECT TO CHANGE

Save hands-on IT administrator time using the Dell EMC OpenManage Essentials profile mobility feature

Transcription:

BENCHMARK CPU TESTING OF 13-INCH-CLASS LAPTOPS In our hands-on testing labs at Principled Technologies, we compared the CPU performance of the Dell XPS 13 laptop to nine other 13-inchclass laptops from Acer, Apple, HP, Lenovo, Microsoft, and Razer. We tested the devices using the benchmark Maxon Cinebench 15, which uses real-world workloads to measure CPU performance. We found that, under a heavy Cinebench CPU load, the Dell XPS 13 scored higher than its competitors when it came to sustained, multi-core CPU performance. The devices we tested We compared the Dell XPS 13 laptop to nine other laptops in the 13-inch class: Microsoft Surface Laptop Microsoft Surface Book 2 Razer Blade Stealth HP Spectre Laptop -13t HP Spectre x360 Convertible Laptop - 13t Apple MacBook Air Apple MacBook Pro Lenovo Yoga 920 Acer Spin 5 Results After 10 consecutive runs of Cinebench s multi-core CPU test, the Dell XPS 13 maintained 96 percent of its original performance even as competitor scores dropped by as much as 30 percent. While the Dell XPS 13 had a 4 percent lead over its nearest competitor (the Microsoft Surface Book 2) in the first run, this lead had widened to 27 percent versus its closest competitor (the Lenovo Yoga 920) by the final run. Conclusion In our Cinebench testing of sustained, multi-core CPU performance, we found that the Dell XPS 13 maintained its initial high performance. In contrast, competitors either achieved initial strong performance that declined over time or performed at levels that were steady but significantly lower than that of the Dell XPS 13. This makes the Dell XPS 13 the most powerful 13-inch laptop that we tested, when measuring for sustained performance under a heavy CPU workload. We concluded testing on December 12, 2017. DECEMBER 2017 A PRINCIPLED TECHNOLOGIES REPORT Commissioned by Dell Technologies

Figure 1: Cinebench CPU (multi-core) results. All data current as of 12/12/2017. 800 Cinebench CPU (multi-core) higher score is better 700 600 500 400 300 200 100 0 Run 1 Run 2 Run 3 Run 4 Run 5 Run 6 Run 7 Run 8 Run 9 Run 10 Dell XPS 13 Acer Spin 5 Apple MacBook Air Apple MacBook Pro HP Spectre -13t HP Spectre x360 13t Lenovo Yoga 920 Microsoft Surface Laptop Microsoft Surface Book 2 Razer Blade Stealth A Principled Technologies report 2

Figure 2: Cinebench CPU (multi-core) results. All data current as of 12/12/2017. Dell XPS 13 Acer Spin 5 Apple MacBook Air Apple MacBook Pro HP Spectre - 13t HP Spectre x360 13t Lenovo Yoga 920 Microsoft Surface Laptop Microsoft Surface Book 2 Razer Blade Stealth Run 1 710 565 308 403 528 555 609 423 678 544 Run 2 676 524 293 396 505 470 535 398 645 514 Run 3 683 529 291 397 508 492 532 382 523 514 Run 4 684 521 290 395 423 459 552 372 500 513 Run 5 684 522 301 398 439 468 539 366 507 513 Run 6 681 523 302 394 442 460 527 360 496 529 Run 7 684 518 306 392 419 458 534 367 479 513 Run 8 675 523 297 394 419 458 535 372 505 515 Run 9 684 517 302 394 423 456 547 357 525 518 Run 10 683 524 308 393 430 459 537 371 479 512 Average 684 527 300 396 454 474 545 377 534 519 A Principled Technologies report 3

On November 17, 2017, we finalized the hardware and software configurations we tested. Updates for current and recently released hardware and software appear often, so unavoidably these configurations may not represent the latest versions available when this report appears. For older systems, we chose configurations representative of typical purchases of those systems. We concluded hands-on testing on December 12, 2017. APPENDIX A: SYSTEM CONFIGURATION INFORMATION System Acer Spin 5 Apple MacBook Air Apple MacBook Pro Dell XPS 13 Processor Vendor Intel Intel Intel Intel Name Core i7 Core i7 Core i7 Core i7 Model number 8550U 5650U 7567U 8550U Core frequency (GHz) 1.8 4.0 2.2 3.2 3.5 4.0 1.8 4.0 Number of cores 4 2 2 4 Cache 8 MB L3 4 MB L3 4 MB L3 8 MB L3 Memory Amount (GB) 8 8 16 16 Type DDR4 DDR3 DDR3 DDR3 Speed (MHz) 2,133 1,600 2,133 1,866 Graphics Vendor Intel Intel Intel Intel Model number UHD Graphics 620 HD Graphics 6000 Iris Plus Graphics 650 UHD Graphics 620 Storage Amount (GB) 512 512 512 512 Type SSD SSD SSD SSD Connectivity/expansion Wireless internet Qualcomm Atheros 802.11ac Killer Wireless -n/a/ac 802.11ac QCA61x4A 1435 Bluetooth 4.1 4.0 4.2 4.1 USB 1 x USB 2.0, 2 x USB 3.0 2 x USB 3.0, 1 x SDXC 4 x Thunderbolt 3 card slot (USB-C) 3 x USB-C Video 1 x HDMI 1 x Thunderbolt 2 DisplayPort through Thunderbolt 1 x Thunderbolt USB-C A Principled Technologies report 4

System Acer Spin 5 Apple MacBook Air Apple MacBook Pro Dell XPS 13 Battery Type Lithium-polymer Lithium-polymer Lithium-polymer Lithium-polymer Rated capacity (Wh) 47 54 49.2 52 Display Size (in.) 13.3 13.3 13.3 13.3 Type IPS LCD LED-backlit display LED-backlit display with IPS technology InfinityEdge Resolution 1,920 x 1,080 1,440 x 900 2,560 x 1,600 3,840 x 2,160 Touchscreen Yes No No Yes Operating system Vendor Microsoft Apple Apple Microsoft Name Windows 10 Home macos Sierra macos Sierra Windows 10 Home Build number or version 10.0.16299 10.13.1 10.13.2 10.0.16299 BIOS BIOS name and version Insyde 1.00 N/A N/A Dell Inc. 0.3.13 Dimensions w/ keyboard Height (in) 0.63 0.11 to 0.68 0.59 0.33 to 0.46 Width (in) 12.69 12.69 11.97 11.86 Depth (in) 8.87 8.93 8.36 7.82 Weight (lbs.) 3.39 3.01 3.02 2.62 A Principled Technologies report 5

System HP Spectre 13t laptop HP Spectre x360 13t Lenovo Yoga 920 Processor Vendor Intel Intel Intel Name Core i7 Core i7 Core i7 Model number 8550U 8550U 8550U Core frequency 1.8 4.0 1.8 4.0 1.8 4.0 Number of cores 4 4 4 Cache 8 MB L3 8 MB L3 8 MB L3 Memory Amount 16 16 16 Type DDR3 DDR3 DDR4 Speed (MHz) 2,133 2,133 2,133 Graphics Vendor Intel Intel Intel Model number UHD Graphics 620 UHD Graphics 620 UHD Graphics 620 Storage Amount 512 GB 512 GB 1 TB Type SSD SSD SSD Connectivity/expansion Wireless internet Intel AC 8265 Intel AC 8265 Qualcomm Atheros QCA61x4A Bluetooth 4.2 4.2 4.1 USB 1 x USB 3.1 Type-C 1 x USB 3.1, 2 x USB-C 2 x USB-C, 1 x USB 3.0 Video 2 x Thunderbolt 3 2 x Thunderbolt USB-C 2 x USB-C DisplayPort Battery Type Lithium-polymer Lithium-polymer Lithium-polymer Rated capacity (Wh) 43.7 60 70 Display Size (in.) 13.3 13.3 13.9 Type 4K IPS micro-edge WLED-backlit multitouch-enabled edge-toedge glass 4K IPS micro-edge WLED-backlit touch UHD IPS Multitouch Resolution 3,840 x 2,160 3,840 x 2,160 3,840 x 2,160 Touchscreen Yes Yes Yes A Principled Technologies report 6

System HP Spectre 13t laptop HP Spectre x360 13t Lenovo Yoga 920 Operating system Vendor Microsoft Microsoft Microsoft Name Windows 10 Home Windows 10 Home Windows 10 Home Build number or version 10.0.16299 10.0.16299 10.0.16299 BIOS BIOS name and version Insyde F.06 American Megatrends Inc. F.10 Lenovo 5NCN28WW Dimensions w/ keyboard Height (in) 0.41 0.53 0.53 Width (in) 12.09 12.06 12.69 Depth (in) 8.83 8.56 8.79 Weight (lbs.) 2.42 2.74 2.97 A Principled Technologies report 7

System Microsoft Surface Laptop Microsoft Surface Book 2 Razer Blade Stealth Processor Vendor Intel Intel Intel Name Core i7 Core i7 Core i7 Model number 7660U 8650U 8550U Core frequency 2.5 4.0 1.9 4.2 1.8 4.0 Number of cores 2 4 4 Cache 4 MB L3 8 MB L3 8 MB L3 Memory Amount (GB) 16 16 16 Type DDR3 DDR3 DDR3 Speed (MHz) 1,866 1,866 2,133 Graphics Vendor Intel Intel / NVIDIA Intel Model number Iris Plus Graphics 640 UHD Graphics 620 / GeForce GTX 1050 UHD Graphics 620 Storage Amount (GB) 512 512 512 Type SSD SSD SSD Connectivity/expansion Wireless internet Marvell AVASTAR Wireless-AC Marvell AVASTAR Wireless-AC Killer Wireless-n/a/ac 1535 Bluetooth 4.0 4.1 4.1 USB 1 x USB 3.0, 1 x Surface Connect 2 x USB 3.0, 1 x USB Type-C, 1 x UHS-II SDXC card reader, 2 x 1 x Thunderbolt 3, 2 x USB 3.0 Surface Connect Video 1 x Mini DisplayPort 1 x USB-C DisplayPort 1 x HDMI Battery Type Lithium-polymer Lithium-polymer Lithium-polymer Rated capacity (Wh) N/A N/A 53.6 Display Size (in.) 13.5 13.5 13.3 Type PixelSense Display PixelSense Display QHD+ Resolution 2,256 x 1,504 3,000 x 2,000 3,200 x 1,800 A Principled Technologies report 8

System Microsoft Surface Laptop Microsoft Surface Book 2 Razer Blade Stealth Touchscreen Yes Yes Yes Operating system Vendor Microsoft Microsoft Microsoft Name Windows 10 Pro Windows 10 Pro Windows 10 Home Build number or version 10.0.16299 10.0.16299 10.0.16299 BIOS BIOS name and version Microsoft 136.1736.769 Microsoft 387.1879.769 Razer 1.01 Dimensions w/ keyboard Height (in) 0.38-0.57 0.59-0.90 0.54 Width (in) 12.13 12.32 12.56 Depth (in) 8.79 9.14 8.11 Weight (lbs.) 2.83 3.57 2.98 A Principled Technologies report 9

APPENDIX B: HOW WE TESTED Performing the Cinebench R15.038 test Setting up the test 1. From https://www.maxon.net/en/products/cinebench/, download the Cinebench R15. 2. Unzip the Cinebench R15 Windows package to the desktop. 3. To launch Cinebench from inside the unzipped directory, double-click the Cinebench Windows 64-Bit icon. 4. Click Agree to the EULA. 5. Click File Advanced benchmark. 6. Deselect the check mark beside OpenGL. 7. Exit Cinebench. 8. Shut down the system. Running the test 1. Bring up an administrative command prompt by typing CMD in the Windows Search box. 2. To open App options, right-click the Command Prompt app, and click the Run as administrator button. 3. Type Cmd.exe /c start /wait Rundll32.exe advapi32.dll,processidletasks 4. Do not interact with the system until the command completes. 5. After the command completes, wait 5 minutes before running the test. 6. Launch Cinebench. 7. Verify that only the CPU and CPU (Single Core) tests are selected. 8. Select File Run all selected tests. 9. When the benchmark run completes, record the results and immediately repeat steps 6 and 7 until Cinebench has completed 10 continuous runs. A Principled Technologies report 10

ABOUT PRINCIPLED TECHNOLOGIES We provide industry-leading technology assessment and fact-based marketing services. We bring to every assignment extensive experience with and expertise in all aspects of technology testing and analysis, from researching new technologies, to developing new methodologies, to testing with existing and new tools. Principled Technologies, Inc. 1007 Slater Road, Suite 300 Durham, NC, 27703 www.principledtechnologies.com When the assessment is complete, we know how to present the results to a broad range of target audiences. We provide our clients with the materials they need, from marketfocused data to use in their own collateral to custom sales aids, such as test reports, performance assessments, and white papers. Every document reflects the results of our trusted independent analysis. We provide customized services that focus on our clients individual requirements. Whether the technology involves hardware, software, Web sites, or services, we offer the experience, expertise, and tools to help our clients assess how it will fare against its competition, its performance, its market readiness, and its quality and reliability. Our founders, Mark L. Van Name and Bill Catchings, have worked together in technology assessment for over 20 years. As journalists, they published over a thousand articles on a wide array of technology subjects. They created and led the Ziff-Davis Benchmark Operation, which developed such industry-standard benchmarks as Ziff Davis Media s Winstone and WebBench. They founded and led etesting Labs, and after the acquisition of that company by Lionbridge Technologies were the head and CTO of VeriTest. Principled Technologies is a registered trademark of Principled Technologies, Inc. All other product names are the trademarks of their respective owners. Disclaimer of Warranties; Limitation of Liability: PRINCIPLED TECHNOLOGIES, INC. HAS MADE REASONABLE EFFORTS TO ENSURE THE ACCURACY AND VALIDITY OF ITS TESTING, HOWEVER, PRINCIPLED TECHNOLOGIES, INC. SPECIFICALLY DISCLAIMS ANY WARRANTY, EXPRESSED OR IMPLIED, RELATING TO THE TEST RESULTS AND ANALYSIS, THEIR ACCURACY, COMPLETENESS OR QUALITY, INCLUDING ANY IMPLIED WARRANTY OF FITNESS FOR ANY PARTICULAR PURPOSE. ALL PERSONS OR ENTITIES RELYING ON THE RESULTS OF ANY TESTING DO SO AT THEIR OWN RISK, AND AGREE THAT PRINCIPLED TECHNOLOGIES, INC., ITS EMPLOYEES AND ITS SUBCONTRACTORS SHALL HAVE NO LIABILITY WHATSOEVER FROM ANY CLAIM OF LOSS OR DAMAGE ON ACCOUNT OF ANY ALLEGED ERROR OR DEFECT IN ANY TESTING PROCEDURE OR RESULT. IN NO EVENT SHALL PRINCIPLED TECHNOLOGIES, INC. BE LIABLE FOR INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES IN CONNECTION WITH ITS TESTING, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN NO EVENT SHALL PRINCIPLED TECHNOLOGIES, INC. S LIABILITY, INCLUDING FOR DIRECT DAMAGES, EXCEED THE AMOUNTS PAID IN CONNECTION WITH PRINCIPLED TECHNOLOGIES, INC. S TESTING. CUSTOMER S SOLE AND EXCLUSIVE REMEDIES ARE AS SET FORTH HEREIN. A Principled Technologies report 11