SCI 2011 Feb 21 Latest SPC-1 and SPC-2 performance results

In $/IOPS, DS3524 Express Turbo, DS8800, Hitachi USP-V, HPE, Huawei Symantec, IBM, IOPS, MBPS, S8100, SPC, SPC-1, SPC-2, SVC, Texas Memory Systems, XP24000by AdministratorLeave a Comment

We return now to our favorite block storage benchmark, Storage Performance Council (SPC) results*.  There have been three new SPC-1 submissions since our last report, TMS RamSan-630, IBM StorWize V7000 and Pillar Data Axiom 600 Series 3, one new SPC-1 also from TMS, their RamSan-630 (first all SSD system for this throughput benchmark), and an new SPC-1C (component benchmark) the new Seagate Pulsar-XT.2 SSD.

SPC-1*results

We start our discussion with the top 10 IO/sec, or as SPC calls it IOPS™

SCI20110227-001 (c) 2011 Silverton Consulting, Inc., All Rights Reserved

SCI20110227-001 (c) 2011 Silverton Consulting, Inc., All Rights Reserved

Figure 1 Top 10 SPC-1* IOPS

Higher is better here.  The only new submission on this chart is the TMS RamSan-630 and it once again stepped in as new number 1 at 400.5K IOPS.  The remaining systems here have all been discussed in previous dispatches.  The new RamSan-630 had about 8TB of user storage using 20-640GiB SSDs.  It also used 8Gb FC front and backend interfaces.  The RamSan-630 was priced at about $419K for .

Next let’s turn to storage price performance and $/IOPS.

SCI20110227-002 (c) 2011 Silverton Consulting, Inc., All Rights Reserved

SCI20110227-002 (c) 2011 Silverton Consulting, Inc., All Rights Reserved

Figure 2 Top $/IOPS results

Lower is better on the $/IOPS. The only new submission on this chart is the IBM DS3524 Express Turbo (6.7TB) that came in at #9 with $3.26/IOPS using 4-Gb/s SAS connecitions, 4GB of cache, and RAID1 protection for 48-300GB 10Krpm SAS disk drives.  TMS storage continues to dominate this chart with the top 3 slots at $0.67, $1.13 and $1.50 respectively.  Recall that the two SUN systems (#4&5) had no RAID protection, which would provide a significant cost advantage over the other, mostly RAID1 subsystems, but seriously increases risk of data loss.

SCI20110227-003 (c) 2011 Silverton Consulting, Inc., All Rights Reserved

SCI20110227-003 (c) 2011 Silverton Consulting, Inc., All Rights Reserved

Figure 3 Top IOPS/drive spindle

Higher is better on IOPS/drive chart.  Once again, the new entry here is the IBM DS3524 Express Turbo (6.7TB) that came in at #8 with over 308 IOPS/drive spindle.  Recall that this chart excludes subsystems using any amount of SSDs and as of this report, also eliminates any subsystem that uses NAND for cache.  Similar to the $/IOPS results above, the Sun J4400 subsystem had no RAID protection and enjoys an IOPS/drive advantage because of this.

SPC-2 Results

We have not seen much activity in SPC-2 submissions of late and was beginning to think no one cared about sequential performance.  Thankfully, IBM has seen the light and released 3 new SPC-2 benchmarks for all their current enterprise class storage.  Unclear why only a limited number of vendors participate in the SPC-2 submissions, mostly IBM and Oracle Sun submissions with a smattering from other vendors.

SCI20110227-004 (c) 2011 Silverton Consulting, Inc., All Rights Reserved

SCI20110227-004 (c) 2011 Silverton Consulting, Inc., All Rights Reserved

Figure 4 SPC-2 MBS results

Higher is better on MBPS chart.  As one no doubt remembers, the SPC-2 MBPS is a composite score that averages storage performance for large file processing, large database query, and video on demand sequential workloads.  The new IBM DS8800 came in at #1 with over 9700 MBPS, using 16-8GFC links, with RAID5 protection over 768-146GB disk drives.  Also recall that the HP XP24000 is an OEM version of HDS USP-V, so the #2 and #3 slots are essentially the same subsystem.

SCI20110227-005 (c) 2011 Silverton Consulting, Inc., All Rights Reserved

SCI20110227-005 (c) 2011 Silverton Consulting, Inc., All Rights Reserved

Figure 5 SPC2 MBPS/drive spindle

Higher is better on the MBPS/drive chart.  This chart represents yet another way to view the overall MBPS performance but this time on a per spindle basis.  The new IBM DS3524 Express Turbo broke in at #8 on this chart with 41.5 MBPS/drive using 4-6Gb/s SAS connections, 4GB of cache, and RAID 5 protection over 60-300GB 10Krpm SAS disk drives.  Similar to the discussion on the SPC-1 IOPS/drive chart we eliminate subsystems using SSDs or NAND cache from this list.  Recall that the Sun J4200 had no RAID protection and as such, enjoyed an MBPS/drive advantage.

Significance

It’s good to see the SPC-1 and SPC-2 recent submissions by IBM and others.  Performance continues to be an important metric for block storage subsystems and random and sequential performance are complementary views of storage perfomance.

We are starting to see the emergence of high performing block storage subsystems based on a cluster of nodes (see Huawei 8- and 4-node SPC-1 results).  This approach first emerged with 3PAR’s storage system (now owned by HP).  Of course the other prominent cluster based storage subsystem is EMC’s VMAX but they do not submit SPC benchmark results.

We are still awaiting the latest HDS VSP benchmark results which hopefully, should take the block storage performance up another notch or two when published.  Also NetApp’s high-end storage with flash cache has yet to submit any SPC results.

As always, any suggestions on how to improve our performance analyses are welcomed.  Additionally, if you are interested in more details, we now provide a fuller version of all these charts in SCI’s SAN Storage Briefing which can be purchased separately from our website[1].

This performance dispatch was sent out to our newsletter subscribers in February of 2011.  If you would like to receive this information via email please consider signing up for our free monthly newsletter (see subscription request, above right) or subscribe by email and we will send our current issue along with download instructions for this and other reports.  Also, if you need an even more in-depth analysis of SAN storage system features and performance please take the time to examine our recently revised (May 2019) SAN Storage Buying Guide available for purchase from our website.

A PDF version of this can be found at

[wpfilebase tag=file id=159 tpl=just-link]

—-

Silverton Consulting, Inc. is a Storage, Strategy & Systems consulting services company, based in the USA offering products and services to the data storage community.


* All results from www.storageperformance.org as of 21Feb2011

 

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.