BENCHMARK WINC1500 Wi-Fi Module Benchmark using iperf 2.0.5 Prerequisites Hardware Prerequisites Atmel Xplained Pro Evaluation Kit Atmel WINC1500 extension USB Micro Cable (TypeA / MicroB) Software Prerequisites Atmel Studio 6.2 iperf project BENCH-XXXX Introduction This document provides bandwidth information for TCP and UDP protocol. It applies to the following products: SAM4S Xplained Pro SAMG53 Xplained Pro SAMD21 Xplained Pro 42271A05/14
Table of Contents Prerequisites...1 Introduction...1 Icon Key Identifiers...3 1. Benchmark configuration...4 1.1 Solution Overview... 4 2. Firmware release 18...5 2.1 SAM4S Xplained Pro... 5 2.2 SAMG53 Xplained Pro... 7 2.3 SAMD21 Xplained Pro... 9 3. Performance summary... 11 4. Revision History... 12 Page 2 of 13
Icon Key Identifiers Icons are used to identify different assignment sections and reduce complexity. These icons are: Delivers contextual information about a specific topic Highlights useful tips and techniques Highlights objectives to be completed Highlights the expected result of an assignment step Indicates important information Highlights actions to be executed out of the target when necessary Page 3 of 13
1. Benchmark configuration 1.1 Solution Overview The purpose of this benchmark is to measure the bandwidth of the WINC1500 Wi-Fi module with several different Atmel MCU devices. The iperf version used is 2.0.5. Hence, it has been ported to Atmel MCU and operates as a server. To run this project you will need to have: Atmel Xplained Pro board (supported chip list below) Atmel WINC1500 extension Atmel Studio 6.2.1153 or above Iperf project Linux laptop with iperf v2.0.5 installed The iperf project has been ported to the following Atmel MCU: Atmel SAM4S Xplained Pro board Atmel SAMD21 Xplained Pro board Atmel SAMG53 Xplained Pro board The purpose of this document is to evaluate the bandwidth of the WINC1500 Wi-Fi module for TCP and UDP protocol throughout the available WINC1500 firmware release. Page 4 of 13
2. Firmware release 18 2.1 SAM4S Xplained Pro CPU is running at 120Mhz and SPI is set at 60Mhz, compiled with -os: RX TX TCP Bandwidth thibault@ubuntu:~$ iperf -c 192.168.1.4 -i 5 -r Server listening on TCP port 5001 TCP window size: 85.3 KByte (default) Client connecting to 192.168.1.4, TCP port 5001 TCP window size: 20.8 KByte (default) [ 5] local 192.168.1.5 port 59733 connected with 192.168.1.4 port 5001 [ ID] Interval Transfer Bandwidth [ 5] 0.0-5.0 sec 4.00 MBytes 6.71 Mbits/sec [ 5] 5.0-10.0 sec 4.00 MBytes 6.71 Mbits/sec [ 5] 0.0-10.2 sec 8.12 MBytes 6.68 Mbits/sec [ 4] local 192.168.1.5 port 5001 connected with 192.168.1.4 port 1030 [ 4] 0.0-5.0 sec 2.18 MBytes 3.66 Mbits/sec [ 4] 5.0-10.0 sec 1.24 MBytes 2.08 Mbits/sec [ 4] 0.0-10.2 sec 3.45 MBytes 2.84 Mbits/sec UDP Bandwidth thibault@ubuntu:~$ iperf -c 192.168.1.4 -i 5 -r -u -b 50m Server listening on TCP/UDP port 5001 TCP window size:??? KByte [ 7] local 127.0.0.1 port 5001 connected with 192.168.1.5 port 52128 [ 7] 0.0-10.0 sec 11.78 Mbytes 9.42 Mbits/sec 31779/ 42554 (74.6%) [ 3] 0.0-5.0 sec 8.24 MBytes 13.8 Mbits/sec 1.303 ms 43930/50578 (87%) [ 3] 5.0-10.0 sec 8.26 MBytes 13.9 Mbits/sec 0.761 ms 44235/50895 (87%) [ 3] 10.0-15.0 sec 8.00 MBytes 13.4 Mbits/sec 0.435 ms 45464/51917 (88%) [ 3] 15.0-20.0 sec 8.64 MBytes 14.5 Mbits/sec 0.427 ms 42171/49140 (86%) [ 3] 20.0-25.0 sec 7.04 MBytes 11.8 Mbits/sec 0.715 ms 49998/55674 (90%) [ 3] 25.0-30.0 sec 6.93 MBytes 11.6 Mbits/sec 0.515 ms 50671/56262 (90%) [ 3] 30.0-35.0 sec 7.19 MBytes 12.1 Mbits/sec 0.925 ms 49055/54858 (89%) [ 3] 35.0-40.0 sec 6.67 MBytes 11.2 Mbits/sec 0.729 ms 51774/57152 (91%) [ 3] 40.0-45.0 sec 7.23 MBytes 12.1 Mbits/sec 0.682 ms 49282/55112 (89%) [ 3] 45.0-50.0 sec 7.56 MBytes 12.7 Mbits/sec 1.246 ms 47350/53448 (89%) Page 5 of 13
CPU is running at 48Mhz and SPI is set at 12Mhz, compiled with -os: RX TX TCP Bandwidth thibault@ubuntu:~$ iperf -c 192.168.1.4 -i 5 -r Server listening on TCP port 5001 TCP window size: 85.3 KByte (default) Client connecting to 192.168.1.4, TCP port 5001 TCP window size: 20.8 KByte (default) [ 5] local 192.168.1.5 port 59762 connected with 192.168.1.4 port 5001 [ ID] Interval Transfer Bandwidth [ 5] 0.0-5.0 sec 1.75 MBytes 2.94 Mbits/sec [ 5] 5.0-10.0 sec 1.62 MBytes 2.73 Mbits/sec [ 5] 0.0-10.5 sec 3.50 MBytes 2.79 Mbits/sec [ 4] local 192.168.1.5 port 5001 connected with 192.168.1.4 port 1029 [ 4] 0.0-5.0 sec 1.75 MBytes 2.94 Mbits/sec [ 4] 5.0-10.0 sec 1.89 MBytes 3.17 Mbits/sec [ 4] 0.0-10.4 sec 3.67 MBytes 2.95 Mbits/sec UDP Bandwidth thibault@ubuntu:~$ iperf -c 192.168.1.4 -i 5 -r -u -b 50m Server listening on TCP/UDP port 5001 TCP window size:??? KByte [ 7] local 127.0.0.1 port 5001 connected with 192.168.1.5 port 52128 [ 7] 0.0-10.0 sec 6.75 Mbytes 5.40 Mbits/sec 36496/ 42549 (85.774047%) [ 3] 0.0-5.0 sec 5.00 MBytes 8.39 Mbits/sec 1.012 ms 1937/ 5970 (32%) [ 3] 5.0-10.0 sec 5.11 MBytes 8.57 Mbits/sec 1.377 ms 1151/ 5271 (22%) [ 3] 10.0-15.0 sec 4.89 MBytes 8.20 Mbits/sec 1.077 ms 2858/ 6799 (42%) [ 3] 15.0-20.0 sec 5.19 MBytes 8.70 Mbits/sec 1.099 ms 594/ 4778 (12%) [ 3] 20.0-25.0 sec 4.84 MBytes 8.12 Mbits/sec 1.115 ms 3099/ 7004 (44%) [ 3] 25.0-30.0 sec 5.16 MBytes 8.65 Mbits/sec 1.132 ms 785/ 4946 (16%) [ 3] 30.0-35.0 sec 5.20 MBytes 8.73 Mbits/sec 1.222 ms 509/ 4706 (11%) [ 3] 35.0-40.0 sec 5.10 MBytes 8.56 Mbits/sec 0.989 ms 1179/ 5296 (22%) [ 3] 40.0-45.0 sec 5.03 MBytes 8.44 Mbits/sec 1.080 ms 1785/ 5844 (31%) [ 3] 45.0-50.0 sec 4.86 MBytes 8.15 Mbits/sec 1.144 ms 2950/ 6870 (43%) This test gives an idea of bandwidth performance we could expect from the SAMD21 Xplained Pro if the host driver was to use DMA.. Page 6 of 13
2.2 SAMG53 Xplained Pro CPU is running at 48Mhz and SPI is set at 48Mhz, compiled with -os: RX TX TCP Bandwidth thibault@ubuntu:~$ iperf -c 192.168.1.4 -i 5 -r Server listening on TCP port 5001 TCP window size: 85.3 KByte (default) Client connecting to 192.168.1.4, TCP port 5001 TCP window size: 20.8 KByte (default) [ 5] local 192.168.1.5 port 59733 connected with 192.168.1.4 port 5001 [ ID] Interval Transfer Bandwidth [ 5] 0.0-5.0 sec 3.38 MBytes 5.66 Mbits/sec [ 5] 5.0-10.0 sec 3.38 MBytes 5.66 Mbits/sec [ 5] 0.0-10.4 sec 6.88 MBytes 5.54 Mbits/sec [ 4] local 192.168.1.5 port 5001 connected with 192.168.1.4 port 1030 [ 4] 0.0-5.0 sec 2.14 MBytes 3.58 Mbits/sec [ 4] 5.0-10.0 sec 1.51 MBytes 2.54 Mbits/sec [ 4] 0.0-10.0 sec 3.68 MBytes 2.93 Mbits/sec UDP Bandwidth thibault@ubuntu:~$ iperf -c 192.168.1.4 -i 5 -r -u -b 50m Server listening on TCP/UDP port 5001 TCP window size:??? KByte [ 7] local 127.0.0.1 port 5001 connected with 192.168.1.5 port 52128 [ 7] 0.0-10.0 sec 8.49 Mbytes 6.79 Mbits/sec 34833/ 42523 (81.915672%) [ 3] 0.0-5.0 sec 8.19 MBytes 13.7 Mbits/sec 0.783 ms 2884/ 9486 (30%) [ 3] 5.0-10.0 sec 8.14 MBytes 13.6 Mbits/sec 1.050 ms 3119/ 9681 (32%) [ 3] 10.0-15.0 sec 8.14 MBytes 13.7 Mbits/sec 0.633 ms 3264/ 9829 (33%) [ 3] 15.0-20.0 sec 8.28 MBytes 13.9 Mbits/sec 1.176 ms 2265/ 8945 (25%) [ 3] 20.0-25.0 sec 7.99 MBytes 13.4 Mbits/sec 1.072 ms 3956/10397 (38%) [ 3] 25.0-30.0 sec 7.58 MBytes 12.7 Mbits/sec 0.655 ms 5769/11883 (49%) [ 3] 30.0-35.0 sec 6.99 MBytes 11.7 Mbits/sec 1.829 ms 8201/13843 (59%) [ 3] 35.0-40.0 sec 7.76 MBytes 13.0 Mbits/sec 0.940 ms 5042/11303 (45%) [ 3] 40.0-45.0 sec 7.44 MBytes 12.5 Mbits/sec 0.843 ms 6357/12356 (51%) [ 3] 45.0-50.0 sec 7.89 MBytes 13.2 Mbits/sec 0.622 ms 4398/10762 (41%) Page 7 of 13
CPU is running at 48Mhz and SPI is set at 12Mhz, compiled with -os: RX TX TCP Bandwidth thibault@ubuntu:~$ iperf -c 192.168.1.4 -i 5 -r Server listening on TCP port 5001 TCP window size: 85.3 KByte (default) Client connecting to 192.168.1.4, TCP port 5001 TCP window size: 20.8 KByte (default) [ 5] local 192.168.1.5 port 59762 connected with 192.168.1.4 port 5001 [ ID] Interval Transfer Bandwidth [ 5] 0.0-5.0 sec 1.75 MBytes 2.94 Mbits/sec [ 5] 5.0-10.0 sec 1.75 MBytes 2.94 Mbits/sec [ 5] 0.0-10.7 sec 3.62 MBytes 2.83 Mbits/sec [ 4] local 192.168.1.5 port 5001 connected with 192.168.1.4 port 1029 [ 4] 0.0-5.0 sec 2.12 MBytes 3.55 Mbits/sec [ 4] 5.0-10.0 sec 631 KBytes 1.03 Mbits/sec [ 4] 0.0-10.1 sec 2.75 MBytes 2.29 Mbits/sec UDP Bandwidth thibault@ubuntu:~$ iperf -c 192.168.1.4 -i 5 -r -u -b 50m Server listening on TCP/UDP port 5001 TCP window size:??? KByte [ 7] local 127.0.0.1 port 5001 connected with 192.168.1.5 port 52128 [ 7] 0.0-10.0 sec 6.42 Mbytes 5.14 Mbits/sec 36814/ 42543 (86.533622%) [ 3] 0.0-5.0 sec 4.91 MBytes 8.24 Mbits/sec 1.021 ms 2780/ 6742 (41%) [ 3] 5.0-10.0 sec 4.85 MBytes 8.13 Mbits/sec 0.998 ms 3180/ 7089 (45%) [ 3] 10.0-15.0 sec 4.71 MBytes 7.91 Mbits/sec 0.895 ms 4079/ 7880 (52%) [ 3] 15.0-20.0 sec 5.09 MBytes 8.54 Mbits/sec 1.434 ms 1500/ 5607 (27%) [ 3] 20.0-25.0 sec 5.15 MBytes 8.64 Mbits/sec 1.102 ms 1244/ 5400 (23%) [ 3] 25.0-30.0 sec 5.04 MBytes 8.46 Mbits/sec 1.540 ms 1866/ 5931 (31%) [ 3] 30.0-35.0 sec 5.22 MBytes 8.76 Mbits/sec 0.973 ms 803/ 5016 (16%) [ 3] 35.0-40.0 sec 5.07 MBytes 8.51 Mbits/sec 1.280 ms 1713/ 5803 (30%) [ 3] 40.0-45.0 sec 4.97 MBytes 8.34 Mbits/sec 0.767 ms 2459/ 6467 (38%) [ 3] 45.0-50.0 sec 4.81 MBytes 8.07 Mbits/sec 1.023 ms 3457/ 7336 (47%) This test gives an idea of bandwidth performance we could expect from the SAMD21 Xplained Pro if the host driver was to use DMA. Page 8 of 13
2.3 SAMD21 Xplained Pro The SAMD21 port is not optimized as the SPI implementation is based on polling. Hence, performances are more impacted by optimization level. For this test only, several optimization levels will be tested. CPU is running at 48Mhz and SPI is set at 12Mhz, compiled with os: RX TX TCP Bandwidth thibault@ubuntu:~$ iperf -c 192.168.1.4 -i 5 -r Server listening on TCP port 5001 TCP window size: 85.3 KByte (default) Client connecting to 192.168.1.4, TCP port 5001 TCP window size: 20.8 KByte (default) [ 5] local 192.168.1.5 port 59762 connected with 192.168.1.4 port 5001 [ ID] Interval Transfer Bandwidth [ 5] 0.0-5.0 sec 768 KBytes 1.26 Mbits/sec [ 5] 5.0-10.0 sec 768 KBytes 1.26 Mbits/sec [ 5] 0.0-11.8 sec 1.62 MBytes 1.16 Mbits/sec [ 4] 0.0-5.0 sec 741 KBytes 1.21 Mbits/sec [ 4] 5.0-10.0 sec 992 KBytes 1.62 Mbits/sec [ 4] 0.0-10.0 sec 1.69 MBytes 1.42 Mbits/sec UDP Bandwidth thibault@ubuntu:~$ iperf -c 192.168.1.4 -i 5 -r -u -b 50m Server listening on TCP/UDP port 5001 TCP window size:??? KByte [ 7] local 127.0.0.1 port 5001 connected with 192.168.1.5 port 52128 [ 7] 0.0-10.0 sec 2.68 Mbytes 2.14 Mbits/sec 39985/ 42274 (94.585327%) [ 3] 0.0-5.0 sec 1.23 MBytes 2.06 Mbits/sec 4.932 ms 10/ 1002 (1%) [ 3] 5.0-10.0 sec 1.23 MBytes 2.07 Mbits/sec 4.780 ms 6/ 1002 (0.6%) [ 3] 10.0-15.0 sec 1.24 MBytes 2.08 Mbits/sec 4.870 ms 4/ 1002 (0.4%) [ 3] 15.0-20.0 sec 1.23 MBytes 2.07 Mbits/sec 4.922 ms 10/ 1005 (1%) [ 3] 20.0-25.0 sec 1.24 MBytes 2.08 Mbits/sec 4.451 ms 4/ 1002 (0.4%) [ 3] 25.0-30.0 sec 1.23 MBytes 2.06 Mbits/sec 4.832 ms 10/ 1002 (1%) [ 3] 30.0-35.0 sec 1.24 MBytes 2.08 Mbits/sec 4.910 ms 5/ 1003 (0.5%) [ 3] 35.0-40.0 sec 1.24 MBytes 2.07 Mbits/sec 4.910 ms 5/ 1002 (0.5%) [ 3] 40.0-45.0 sec 1.24 MBytes 2.08 Mbits/sec 4.963 ms 3/ 1001 (0.3%) [ 3] 45.0-50.0 sec 1.24 MBytes 2.08 Mbits/sec 4.902 ms 4/ 1004 (0.4%) [ 3] 50.0-55.0 sec 1.24 MBytes 2.07 Mbits/sec 4.933 ms 5/ 1002 (0.5%) Page 9 of 13
CPU is running at 48Mhz and SPI is set at 12Mhz, compiled with o1: RX TX TCP Bandwidth thibault@ubuntu:~$ iperf -c 192.168.1.4 -i 5 -r Server listening on TCP port 5001 TCP window size: 85.3 KByte (default) Client connecting to 192.168.1.4, TCP port 5001 TCP window size: 20.8 KByte (default) [ 5] local 192.168.1.5 port 59762 connected with 192.168.1.4 port 5001 [ ID] Interval Transfer Bandwidth [ 5] 0.0-5.0 sec 768 KBytes 1.26 Mbits/sec [ 5] 5.0-10.0 sec 768 KBytes 1.26 Mbits/sec [ 5] 0.0-11.4 sec 1.62 MBytes 1.20 Mbits/sec [ 4] local 192.168.1.5 port 5001 connected with 192.168.1.4 port 1029 [ 4] 0.0-5.0 sec 763 KBytes 1.25 Mbits/sec [ 4] 5.0-10.0 sec 909 KBytes 1.49 Mbits/sec [ 4] 0.0-10.0 sec 1.64 MBytes 1.37 Mbits/sec UDP Bandwidth thibault@ubuntu:~$ iperf -c 192.168.1.4 -i 5 -r -u -b 50m Server listening on TCP/UDP port 5001 TCP window size:??? KByte [ 7] local 127.0.0.1 port 5001 connected with 192.168.1.5 port 52128 [ 7] 0.0-10.0 sec 2.66 Mbytes 2.13 Mbits/sec 40290/ 42538 (94.715316%) [ 3] 0.0-5.0 sec 1.19 MBytes 2.00 Mbits/sec 4.794 ms 15/ 977 (1.5%) [ 3] 5.0-10.0 sec 1.21 MBytes 2.02 Mbits/sec 5.037 ms 5/ 977 (0.51%) [ 3] 10.0-15.0 sec 1.20 MBytes 2.02 Mbits/sec 5.248 ms 6/ 977 (0.61%) [ 3] 15.0-20.0 sec 1.21 MBytes 2.03 Mbits/sec 5.021 ms 3/ 978 (0.31%) [ 3] 20.0-25.0 sec 1.21 MBytes 2.03 Mbits/sec 5.021 ms 3/ 977 (0.31%) [ 3] 25.0-30.0 sec 1.21 MBytes 2.03 Mbits/sec 5.043 ms 2/ 977 (0.2%) [ 3] 30.0-35.0 sec 1.20 MBytes 2.02 Mbits/sec 5.458 ms 7/ 976 (0.72%) [ 3] 35.0-40.0 sec 1.21 MBytes 2.03 Mbits/sec 4.959 ms 2/ 978 (0.2%) [ 3] 40.0-45.0 sec 1.21 MBytes 2.02 Mbits/sec 5.002 ms 4/ 977 (0.41%) [ 3] 45.0-50.0 sec 1.21 MBytes 2.03 Mbits/sec 5.055 ms 4/ 978 (0.41%) To ensure good TCP TX performances, the send function call must NOT be made from the SOCKET_MSG_SENT callback. It is advised to put the function call directly in the program main loop (where function m2m_wifi_handle_events is periodically called). Page 10 of 13
3. Performance summary The following table gives an overview of the best possible performances according to the previous test reports: TCP UDP Chip WINC1500 Firmware Version 18 Downstream Upstream Downstream Upstream SAM4S 6.68 Mbits/sec 2.84 Mbits/sec 9.42 Mbits/sec 12.70 Mbits/sec SAMG53 5.54 Mbits/sec 2.93 Mbits/sec 6.79 Mbits/sec 13.2 Mbits/sec SAMD21 1.16 Mbits/sec 1.42 Mbits/sec 2.14 Mbits/sec 2.07 Mbits/sec The reported values are average and may slightly change when trying to reproduce this test depending on test environment. Page 11 of 13
4. Revision History Doc. Rev. Date Comments XXXXXA 01/2015 Initial document release Page 12 of 13
Atmel Corporation 1600 Technology Drive San Jose, CA 95110 USA Tel: (+1)(408) 441-0311 Fax: (+1)(408) 487-2600 www.atmel.com Atmel Asia Limited Unit 01-5 & 16, 19F BEA Tower, Millennium City 5 418 Kwun Tong Road Kwun Tong, Kowloon HONG KONG Tel: (+852) 2245-6100 Fax: (+852) 2722-1369 Atmel Munich GmbH Business Campus Parkring 4 D-85748 Garching b. Munich GERMANY Tel: (+49) 89-31970-0 Fax: (+49) 89-3194621 Atmel Japan G.K. 16F Shin-Osaki Kangyo Bldg. 1-6-4 Osaki, Shinagawa-ku Tokyo 141-0032 JAPAN Tel: (+81)(3) 6417-0300 Fax: (+81)(3) 6417-0370 2012 Atmel Corporation. All rights reserved. / Rev.: 42271A05/14 Atmel, Atmel logo and combinations thereof, Enabling Unlimited Possibilities, and others are registered trademarks or trademarks of Atmel Corporation or its subsidiaries. Other terms and product names may be trademarks of others. Disclaimer: The information in this document is provided in connection with Atmel products. No license, express or implied, by estoppel or otherwise, to any intellectual property right is granted by this document or in connection with the sale of Atmel products. EXCEPT AS SET FORTH IN THE ATMEL TERMS AND CONDITIONS OF SALES LOCATED ON THE ATMEL WEBSITE, ATMEL ASSUMES NO LIABILITY WHATSOEVER AND DISCLAIMS ANY EXPRESS, IMPLIED OR STATUTORY WARRANTY RELATING TO ITS PRODUCTS INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT. IN NO EVENT SHALL ATMEL BE LIABLE FOR ANY DIRECT, INDIRECT, CONSEQUENTIAL, PUNITIVE, SPECIAL OR INCIDENTAL DAMAGES (INCLUDING, WITHOUT LIMITATION, DAMAGES FOR LOSS AND PROFITS, BUSINESS INTERRUPTION, OR LOSS OF INFORMATION) ARISING OUT OF THE USE OR INABILITY TO USE THIS DOCUMENT, EVEN IF ATMEL HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Atmel makes no representations or warranties with respect to the accuracy or completeness of the contents of this document and reserves the right to make changes to specifications and products descriptions at any time without notice. Atmel does not make any commitment to update the information contained herein. Unless specifically provided otherwise, Atmel products are not suitable for, and shall not be used in, automotive applications. Atmel products are not intended, authorized, or warranted for use as components in applications intended to support or sustain life.