SOMNIUM DRT Benchmarks Whitepaper DRT v3.4 release : August 2016

Transcription

1 SOMNIUM Benchmarks Whitepaper v release : August SOMNIUM is a complete embedded software development environment which supports ARM Cortex M devices from major semiconductor vendors. Vendor Family Cortex Atmel (a subsidiary of Microchip Technology Inc.) SMART M0+, M3, M4 Kinetis M0+, M4 LPC M0, M0+, M3, M4 STM32 M0, M0+, M3, M4 NXP STMicroelectronics Other software vendors use adjectives. SOMNIUM use facts. This whitepaper compares benchmarking results for SOMNIUM against other toolchain products to demonstrate that builds the smallest, fastest most energy efficient code with no source code changes required. No defeat devices! Unlike many well known software vendors, SOMNIUM play fair and do not put benchmark special features in our products to change their behavior in the presence of known tests. We don't alter the benchmark source code, and we always use the same tool options to get an honest and fair comparison. Small memory footprint for C execution uses a highly tuned and specifically configured C runtime library with a reduced memory footprint: Over 10 smaller usage than GNU Newlib. Smaller usage than GNU Newlib Nano. Around 10 smaller statically allocated overhead than GNU Newlib Nano and GNU Newlib. Unlike vanilla GNU Newlib Nano, memory is statically allocated (where possible) and so usage is easily predicted by build time pass/fail. Vastly smaller and usage than NXP RedLib. Full support for C++ exception handling. A simple empty C program was used to show the minimum / requirement to establish a C environment: int main (int argc, char *argv[]) { while (1) {} return 0; } These memory savings made by can have huge practical impact on the usability of small memory devices. can save development time (by allowing software development in C rather than ARM assembly language), and increase the potential to use smaller memory (and lower cost, lower energy) devices. NXP Kinetis examples NXP provided CMSIS-Core routines (from Kinetis Design Studio) are called before main() to configure the on-chip PLL to highest possible frequency. 's savings are significant on small memory devices such as the KL series (starting at 8K, 1K ). Kinetis Cortex M0+ example (KL46Z) KDS3 Nano % % 440 KDS3 Newlib % 2504 CW1 Nano 66% CW1 Newlib % 3064 Kinetis Cortex M4 example (K64F) 1.4 KDS 3 Nano 75% % 440 KDS3 Newlib % 2608 CW1 Nano % CW1 Newlib % 3276 NXP LPC examples leaves more space for your application by making significant memory savings on small memory devices such as the LPC8xx series (starting at 8K, 2K ). LPC Cortex M0+ example (LPC824) % 424-3% % % 968 LPC Cortex M4 example (LPC5411) % 424-3% % % 968 STMicroelectronics STM32 examples We created an Empty C program natively in each IDE. saves a huge amount of memory versus making the use of small memory STM32 devices far more practical.

2 SOMNIUM Benchmarks Whitepaper STM32F0 : Cortex M0+ 261% % 1992 STM32F4 : Cortex M % % 1992 Industry standard benchmarks SOMNIUM are members of the EEMBC Automotive Subcommittee and use their industry standard benchmarks. We believe that in order to be useful, benchmarks should show 3 dimensions. Not just performance, but memory size and energy. It's easy to obtain higher performance by unrolling, inlining and specializing functions to the extreme, but real world systems are memory limited so this approach makes little sense if you want to get an accurate understanding of real world behaviour. We always measure both memory size, performance and where possible we measure energy, measured to the uj using the high accuracy EEMBC EnergyMonitor (due to its 29mA current limitation we couldn't use it to perform measurements on all devices). CoreMark is used to demonstrate the usable performance of a processor system running typical algorithms including list processing (to stress test data accesses), matrix manipulation (to stress test and mathematical operations, and state machines (to stress test complex control flows). Atmel SMART results We compare to the vanilla GNU tools from Atmel Studio. didn't affect usage, but always generated the smallest codesize, the fastest and lowest energy results. NXP Kinetis results We compared against the latest KDS3.2 tools and the stable GNU ARM Launchpad 4.9 tools - the vanilla GCC 5x/6x tools used in other commercial products have code generation bugs (not present in ) which manifest with the Kinetis software enablement and so we recommend against their use with Kinetis. KL02 devices are quite constrained by their memory size and performance. Using increases performance whilst saving significant amounts of, and energy. KV10 devices have high performance memory systems, with a 16-entry, 4-way set associated flash cache. Even with this high performance hardware, still increases KV10 performance and saves energy whilst reducing codesize.

3 SOMNIUM Benchmarks Whitepaper K21 devices significantly improves performance and reduces energy consumption. maintained performance whilst also producing significant memory reductions. Sadly we couldn't measure the energy benefits of as EEMBC EnergyMonitor can't supply enough current to power this MCU. STM32L053 is an ultra low power device with a very simple flash buffer rather than a cache. can significantly improve its performance and energy behaviour. NXP LPC results We compared to the LPCXpresso tools which use vanilla GCC5x (similar to the GNU tools as used in Atollic TrueStudio) both of which contain code generation bugs. LPC8xx devices LPC824 is an entry level device with no flash cache. slightly improved performance and energy usage whilst producing significant reductions in memory usage. Real world demonstration systems Its not just benchmarks! We examined applications which use real world middleware including FreeRTOS, Micrium ucos, code generated using Atmel START and Atmel Software Framework, (Kinetis) Processor Expert, Kinetis SDK v2, Sensor Fusion Library, LPCOpen, STM32CubeMX, and the egui graphic library. Atmel ASF examples Across the 2,343 unique ASF examples Os (optimize for size) on average consumes 32% less than code generated with the default Atmel Studio GNU tools. STMicroelectronics STM32 results We compared against the tools and TrueSTUDIO (both of which use the same vanilla GNU GCC 5x tools as free of charge products and contain the same bugs). STM32F446 has 64-bit wide flash, with a very sophisticated 1KByte flash cache comprising 32 * 32 byte lines and a similar 256byte structure for data accesses to flash which allow the Cortex M4 processor to run at full speed without being impacted by instruction fetch latency. SOMNIUM Cortex-M IDE introduces support for Atmel SMART devices and is available on Windows, Linux (with MacOSX support coming soon). It is fully integrated with Atmel START for ASF project creation. We also offer SOMNIUM Atmel Studio Extension - a plugin for Atmel and Atmel Studio 7. It seamlessly integrates with Atmel's tools and is provided as a new toolchain flavor. Using rather than the default GNU tools is a simple press button activity requiring no source code changes or change of environment. SAMD21freertos_oled1_tickless_xpro_example A basic FreeRTOS demo from ASF using SAMD21 (Cortex M0+): out of -O1 using Newlib Nano %

4 SOMNIUM Benchmarks Whitepaper Micrium_uCOSII_Led_Blink_SAM4S_Xpro example the available and. A basic Micrium Demo supplied with shows the / overhead on a SAM4S (Cortex M4): When built with, both Attach V1 and V2 fit into the available and. No source code changes were required, no features were removed, and made these savings automatically. out of -O1 using Newlib % % SAMB11 PXP demo uses a BLE software stack supplied as a prebuilt library in, which can't be further optimized by. Despite this library forming over 7 of the codesize of this demo, still provides significant memory savings. This shows how can leave more memory available for your application in resource constrained devices Studio % NXP Kinetis examples We examined a number of examples of NXP's Kinetis software enablement which is supported for CodeWarrior and KDS. Some Kinetis components (such as CMSIS) are also supported for IAR tools, but several key items of software enablement (including Sensor Fusion and Intelligent Sensor Framework) are only provided for GNU compatible tools (CodeWarrior and KDS). As is fully GNU compatible it supports all NXP Kinetis software enablement without requiring any source code changes. Attach is a Freescale produced demonstration program, originally written using CodeWarrior 1, then ported by Freescale to KDS2. Attach V1: only fits when built with Attach V1 Os : doesn't fit with KDS3 Nano KDS3 Nano % 1 KDS3 Newlib % % No KDS configurations (KDS2, KDS3, Newlib or Newlib Nano) result in an executable which fits within the MKL26Z128 device ( usage is too large, and is almost full even before heap and stack are allocated!) Attach V2: reduced features to fit with KDS3 Attach V2 -Os : features cut so KDS3 Nano just fits KDS3 Nano % 14.9 KDS3 Newlib % NXP Sensor Fusion Library The Sensor Fusion Library and its example programs are supplied as KDS3 source projects. We used 's automatic KDS project importer/convertor to avoid the need for any manual steps (this isn't possible with Atollic's tools which require manual conversion so we don't quote Atollic results). KL46Z Sensor Fusion Out of O KDS3 Nano 47.9 CW1 Nano 43.2 Optimized for Os % % % -158 This demonstration shows that off the shelf Kinetis software enablement ports to with no changes required and uses significantly less built with. When options are modified to optimize for size, still produces the smallest executable. NXP LPC examples We examined a number of examples of NXP's LPC software enablement for LPCXpresso which make use of LPCOpen components. LPCOpen FreeRTOS blinky -Os A basic FreeRTOS demo from LPCOpen showing the basic overhead required for LPCOpen & FreeRTOS. 's savings show how using frees up valuable memory, leaving space for your application % % 5 Freescale made significant source modifications such that when built with KDS3 Newlib Nano, Attach V2 just fits into

5 SOMNIUM Benchmarks Whitepaper LPC824 QuickJack demo Software manifest "The flexible Smartphone Quick-Jack Solution adapts the standard 3.5 mm stereo audio jack found on most ios or Android smart devices into a self-powered data port and provides a universal interface for external sensors, switches and other external devices. It gives both consumer and industrial product designers a simple, plug-and-go way to get data into an endless variety of control, monitoring, data collection, maintenance, medical and even fun applications." Vendor Product Version System Workbench for STM Studio 6.2 and 7.0 Software Framework 3.3 Atollic TrueSTUDIO for ARM EEMBC Energy Monitor Codewarrior for MCUs 1 Kinetis Design Studio 3.2 Atmel NXP/Freescale 0.2 LPCXpresso % Cortex-M IDE NXP Edition Atmel Studio Extension Built with this demo is almost half the size of the demo when built with LPCXpresso using RedLib. Gesture recognition demo The LPC824 Touch Library API is used to drive and scan capacitive sensors, processes their signal data, filters out noise and provides touch data to a gesture recognition application. The Touch Library accounts for ~45% of this demo's usage and is supplied with LPCOpen as a pre built library (as its prebuilt it can't be optimized by ). still provides significant memory savings compared to vanilla GNU tools used in LPCXpresso and TrueSTUDIO % STMicroelectronics STM32 examples We tested a the demo examples built with and TrueSTUDIO. SOMNIUM Not all tools are equal Free of charge tools use vanilla GNU and Eclipse tools. Many commercial products freeload on the same vanilla tools and offer no benefits over free products. SOMNIUM are experts in GNU and Eclipse internals and maintain GNU tools for major semiconductor vendors. We are NXP Proven Partners and produced Kinetis Design Studio for Freescale. Summary is the ideal upgrade path from entry level tools, with unique features to generate the best code quality and save development time and money. 's device-aware code generation builds the most efficient program for your choice of Cortex-M device, with no source code changes required. IDEs also include leading edge debug and trace features to improve productivity and help you reach market faster. is available in three flavors. STM32F4 Animated picture from SDCard demo uses significantly less and than other tools % 676 TrueSTUDIO % % 560 STM32F0: "No name" image browser from SDcard demo uses significantly less and than % 2192 TrueSTUDIO % MCU support Atmel Studio Atmel SMART Extension IDE Windows hosted Atmel Visual Studio Cortex-M IDE1 Atmel SMART, NXP Kinetis Windows & Linux & LPC, STMicroelectronics hosted, Eclipse IDE STM32 with debug and trace Trial and buy Find out more and get a free of charge fully featured trial of from the SOMNIUM portal: Watch video tutorials and demonstrations at: 1 SOMNIUM NXP Edition IDE also available (only supporting NXP devices)