SCI Latest SPC-1 & SPC-2 performance report for August 2015

In $/IOPS, $/MBPS, EonStor DS 3024B, Hitachi VSP, Hitachi VSP G1000, IOPS, LFP, M710, Oracle, Oracle ZFS ZS3-4, Oracle ZFS ZS4-4, SPC, SPC-1, SPC-2, VMAX3, VMAX3 400K, VNX 8000, VOD, XP7 by AdministratorLeave a Comment

 

This Storage Intelligence (StorInt™) dispatch covers Storage Performance Council (SPC) results[1]. There have been five new SPC-1 and two new SPC-2 submissions since our last report in May. The new SPC-1 results are for EMC VNX 8000, HP XP7, Infortrend EonStor DS 3024B & 2024B, and NEC Storage M710. The new SPC-2 submissions are for EMC VMAX 400K and Oracle ZFS Storage ZS4-4 appliance. This is the first time EMC has submitted SPC benchmarks.

We have updated all our charts and metrics to only track ACTIVE SPC-1 and SPC-2 submissions. We were tracking some pretty old results which were no longer representative of current vendor products.

SPC-1 results

We begin our discussion with top ten SPC-1 IOPS™ (IO operation’s per second) results shown in Figure 1.

SCISPC150826(1)Figure 1 Top 10 SPC-1 IOPS results

The new HP XP7 storage tied for first place with the HDS VSP G1000 at just over 2M IO/sec. Both the HP XP7 and HDS VSP G1000 had 64 1.6TB Flash Modules for storage.  Once again, all of our top ten IOPS results are either flash/SSD only or hybrid storage systems (two of the three Huawei systems were hybrid). The new HP XP7 system was an exact performance copy of the HDS VSP G1000, matching it step for step, in IOPS and response times, at all SPC-1 measurement intervals.

None of the other new submissions managed to break into the top ten. The NEC M710 was a disk only storage, so it didn’t even have a chance on IOPS.

Next, we turn to top ten SPC-1 Price-Performance™ or $/IOPS in Figure 2.

 SCISPC150828(2)Figure 2 SPC-1 Top 10 $/IOPS™

In Figure 2, we can see three of the new mid-range storage systems: at #1 ($0.24 $/IOPS) is the InforTrend EonStor DS 3024B; at #4 ($0.41/IOPS) is the EMC VNX 8000; and at #5 ($0.43/IOPS) is the Infortrend EonStor DS 2024B.  The Infortrend storage systems had 24 200GB SSDs (DS 3024B) and 16 200 GB SSDs (DS 2024B). The EMC VNX 8000 used 40 100GB SSDs. Every one of our top ten $/IOPS systems were all flash storage.

Most top ten IOPS systems don’t do as well on $/IOPS measurements. There still seems to be a high price differential for extreme levels of performance. The lone exception in this remains the Kaminario K2.

The last SPC-1 chart is a new SCI metric, top ten IOPS/GB-NAND in Figure 3.

Figure 3 SPC-1 Top 10 IOPS/GB NANDSCISPC150828(3)

In Figure 3, we display a new chart we have been working on that shows IOPS effectiveness for flash storage systems. For some time now we have been searching for a way to measure flash storage effectiveness in a similar fashion to our IOPS/disk drive. In some of our previous reports we have used IOPS/SSD but IOPS/GB NAND seems a better measure. SSDs can come in all sizes and flavors with drastically varying performance characteristics. But NAND chips are more commoditized components and generally have equivalent or at least similar performance characteristics.

As can be seen in Figure 3, the EMC VNX 8000 is #1 with over 108 IOPS/GB NAND. None of the other new submissions cracked into the top ten here. As discussed previously, the EMC VNX 8000 used 40 100GB SSDs for their flash storage. 

SPC-2 results

In Figure 4 we show our MBPS spider chart, which depicts the achievements for the three workloads which make up the SPC-2 aggregate MBPS.

SCISPC150828(4)Figure 4 Top 10 SPC-2 MBPS results, spider chart

The EMC VMAX 400K took over first place with an impressive 55.6 GB/sec of MBPS throughput. One can see for the Large Database Query, the VMAX did significantly better at over 66.6 GB/sec, 53.1 GB/sec for the LFP and 47.1GB/sec for the VoD. The VMAX is number one in each of the SPC-2 workloads at this point. The VMAX 400K had 264 200GB SSDs.

There aren’t a lot of all SSD systems in SPC-2 submissions, just the Kamanario K2 and the EMC VMAX 400K. None of our other top ten SPC-2 charts had any changes with the two new submissions.

It would seem that Oracle is starting to make some serious inroads in high throughput storage, with three top ten SPC-2 MPBS results with ZFS Storage ZS3-2 (#6), ZFS Storage ZS3-4 (#5) and ZFS Storage ZS4-4 appliances (#4).

Significance

We are starting to see a lot more mid-range, all-flash/SSD storage systems being benchmarked in SPC-1 and introduced to the market these days. Many of these systems are starting to make their mark, especially in Price-Performance. It was also good to see some new high-end SPC-2 results again.

We introduced a new SCI derived SPC-1 metric on flash effectiveness , IOPS/GB NAND. Hopefully this will give our readers a better feel for how well storage systems use flash storage. As discussed earlier this isn’t the only flash effectiveness metric we have come up with but for the moment, we feel this is the best one available.

Both EMC systems had great first time SPC benchmark submissions. The VNX 8000 in SPC-1 did especially well in Price-Performance and IOPS/GB NAND and the VMAX 400K in SPC-2 MBPS. Both system submissions were configured as all-flash storage.

 

[Also we offer more block storage performance information plus our OLTP, Email and Throughput ChampionsCharts™ charts in our recently updated (February 2019) SAN Storage Buying Guide, or for more information on some select ESRP performance results please see our recently updated (December 2019) SAN-NAS Storage Buying Guide, both of which are available for purchase on our website.]

[This performance dispatch was originally sent out to our newsletter subscribers in August of 2015.  If you would like to receive this information via email please consider signing up for our free monthly newsletter (see subscription request, above right) and we will send our current issue along with download instructions for this and other reports. Dispatches are posted to our website at least a quarter or more after they are sent to our subscribers, so if you are interested in current results please consider signing up for our newsletter.]  

Silverton Consulting, Inc., is a U.S.-based Storage, Strategy & Systems consulting firm offering products and services to the data storage community.

[1] All SPC results available from http://www.storageperformance.org/home/ as of 26Aug2015

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.