iscsi Testing At NASA GSFC

Size: px

Start display at page:

Download "iscsi Testing At NASA GSFC"

Irma Norman
5 years ago
Views:

1 iscsi Testing At NASA GSFC Hoot Thompson Clara Barton Drive Fairfax Station, VA Phone: FAX: Presented at the THIC Meeting at the Raytheon ITS Auditorium, 1616 McCormick Dr., Upper Marlboro MD November 5-6, 2002

2 Introduction Some Trends Storage consolidation continues to be a popular architectural construct Storage Area Networks (SAN) Minimizing costs while expanding storage capacity and access is an obvious driver Fibre channel connected storage remains dominant at least in the high performance space Existing IP infrastructures versus still expensive fibre channel represent an attractive mechanism for connecting users to storage at the block level Are IP based transport technologies the answer? 2

3 By Way of Review Traditional Infrastructure 3

4 Storage Area Network (SAN) Infrastructure 4

5 Definitions Fibre Channel Industry standard high-speed SCSI transport technology 1 or 2 Gbit, 10 Gbit coming Internet SCSI (iscsi) represents a light switch approach to storage networking Fibre Channel Over IP (FCIP) means of encapsulating Fibre Channel frames within TCP/IP specifically for linking Fibre Channel SANs over wide areas Internet Fibre Channel Protocol (ifcp) gateway-to-gateway protocol for providing fibre channel fabric services to fibre channel end devices over a TCP/IP network Notes: Standards largely the work of Internet Engineering Task Force (IETF) Definitions from IP SANs A Guide to iscsi, ifcp, and FCIP Protocols for Storage Area Networks by Tom Clark 5

6 IP-Based SAN Connections 6

7 GSFC Pilot SAN Configuration Linux_G1 Bldg 32 RAID Storage Fibre Channel IP Connections Linux_G2 Fibre Channel Switch iscsi Router Linux_MD W2K_G1 Linux_G3 GSFC Inter-Building Network University of Maryland Bldg 28 Sun_G1 Fibre Channel Switch iscsi Router Fibre Channel Switch SGI_G1 FCIP Bridge FCIP Bridge Fibre Channel Switch SGI_AK Bldg 33 Tape Library JBOD California/ Alaska 7

8 IP Testing iscsi in comparision to native fibre chanel Primarily Linux based machines Sun platform also looked at SGI currently does not support iscsi Windows not the platform of choice TCP off-load engine (TOE) card Evaluated on Windows machine 8

9 Benchmarks Large file, large block sequential transfers lmdd Small file, transaction oriented tests bonnie++ Postmark Application testing Composite generation from MODIS data by U of MD staff Different file systems ext2fs (native Linux file system) cvfs now StorNext File System (ADIC) Global File System (Sistina) Notes: Benchmark numbers for the most part are out of the box results and should be viewed as representative not definitive. 9

10 Linux_G2 Write Performance ext2 gfs cvfs Transfer Rate (MB) Block Size (MB) 10

11 Linux_G2 Read Performance ext2 gfs cvfs Transfer Rate (MB) Block Size (MB) 11

12 Linux_G3 Write Performance ext2 gfs cvfs Transfer Rate (MB) Block Size (MB) 12

13 Linux_G3 Read Performance ext2 gfs cvfs Transfer Rate (MB) Block Size (MB) 13

14 Linux_MD Write Performance ext2fs gfs cvfs Transfer Rate (MB) Block Size (MB) 14

15 Linux_MD Read Performance ext2fs gfs cvfs Transfer Rate (MB) Block Size (MB) 15

16 TOE Performance - Writes Transfer Rate (MB) CPU NIC (MB) TOE (MB) NIC () TOE () Block Size (MB) 16

17 TOE Performance - Reads Transfer Rate CPU NIC ( MB) TOE (MB) NIC () TOE () Block Size (MB) 17

18 Bonnie++ Results Number of Files = 10:120:80/44 Chunk Size = 2GB system file system Sequential Output Sequential Input Random Sequential Create Random Create Per Char Block Rewrite Per Char Block Seeks Create Read Delete Create Read Delete KB CPU KB CPU KB CPU KB CPU KB CPU CPU CPU CPU CPU CPU CPU CPU Linux_G2* ext2fs Linux_G2 gfs Linux_G2* cvfs Linux_G3 ext2fs Linux_G3 gfs Linux_G3 cvfs Linux_MD-IDE ext2fs Linux_MD-iSCSI ext2fs Linux_MD-iSCSI gfs Linux_MD-iSCSI cvfs

19 Postmark Results Linux_MD Time Files Data File Range Block Size FS Total Trans Trans Crtd Crtd Crtd Alone Crtd Alone Mixed w/trans Mixed w/trans Read Read App App Del Del Del Alone Del Alone Mixed w/trans Mixed w/trans MB read MB Read MB Written 16K - 1M 512 ext K - 1M 512 gfs K - 1M 512 cvfs (K) M - 8M 4096 ext M - 8M 4096 gfs M - 8M 4096 cvfs MB Writtten Linux_G2 Time Files Data File Range Block Size FS Total Trans Trans Crtd Crtd Crtd Alone Crtd Alone Mixed w/trans Mixed w/trans Read Read App App Del Del Del Alone Del Alone Mixed w/trans Mixed w/trans MB read MB Read MB Written 16K - 1M 512 ext K - 1M 512 gfs K - 1M 512 cvfs M - 8M 4096 ext M - 8M 4096 gfs M - 8M 4096 cvfs MB Writtten 19

20 Application Testing U of MD Successfully recognized and mounted storage located ~6 miles away Generated MODIS composite data ext2fs > 1hr 45 min Plus ftp overhead time of 45 min gfs > 2 hr 8 min cvfs > 3hr 15 min 20

21 AK-To To-MD FCIP Test 21

Conclusions Technology is straightforward to implement and test IP is more than just a viable SAN technology Poised to have a dramatic impact Market has yet to

22 Conclusions Technology is straightforward to implement and test IP is more than just a viable SAN technology Poised to have a dramatic impact Market has yet to play out the options - iscsi, FCIP and/or ifcp Vendor commitment still forming Gain in flexibility offsets bandwidth loss for potentially a large category of users 22

Considerations and Performance Evaluations Of Shared Storage Area Networks At NASA Goddard Space Flight Center

Considerations and Performance Evaluations Of Shared Storage Area Networks At NASA Goddard Space Flight Center Hoot Thompson Patuxent Technology Partners, LLC 11030 Clara Barton Drive Fairfax Station VA