Sometimes it’s enlightening to compare several viewpoints on similar data. At yesterday’s SNIA Persistent Memory Summit a number of presentations provided interesting overlapping views on certain subjects.
One of particular interest to The SSD Guy was latency vs. IOPS. Tom Coughlin of Coughlin Associates and I presented the findings from our recently-published IOPS survey report and in Slide 19 displayed the basic chart behind this post’s graphic (click to enlarge, or, better yet, right-click to open in a new tab). This chart compares how many IOPS our respondents said they need for the storage in their most important application, and compared that to the latency they required from this storage. For comparison’s sake we added a reference column on the left to roughly illustrate the latency of various standard forms of storage and memory.
You can see that we received a great variety of inputs spanning a very wide range of IOPS and latency needs, and that these didn’t all line up neatly as we would have anticipated. One failing of this chart format is that it doesn’t account for multiple replies for the same IOPS/latency combination: If we had been able to include that the chart would have shown a clearer trendline running from the top left to the lower right. Instead we have a band that broadly follows that trend of upper-left to lower-right.
Two other speakers presented the IOPS and latency that could be Continue reading
On January 12 IBM announced some very serious upgrades to its DS8000 series of storage arrays. Until this announcement only the top-of-the-line model, the IBM System Storage DS8888, was all-flash while the less expensive DS8886 and DS8884 sported a hybrid flash + HDD approach. The new models of the DS8886 and DS8884 are now also all-flash.
But that’s not all: Every model in this product family has been upgraded.
The original DS8000 systems used a module called the High Performance Flash Enclosure (HPFE) for any flash they included, while these newer models are all based on HPFE Gen 2. While the original HPFE was limited to a maximum capacity of 24TB in a 1U space, the larger 4U HPFE Gen 2 can be configured with as much as 153.6 TB, for more than six times the storage of the previous generation. By making this change, and by optimizing the data path, the Gen 2 nearly doubles read IOPS to 500K and more than triples read bandwidth to 14GB/s. Write IOPS in the Gen 2 have been increased 50% to 300K, while write bandwidth has been increased by nearly 4x to 10.5GB/s .
This kind of performance opens new Continue reading
Yesterday IBM unveiled a sweeping update of its existing flash storage products. These updates cover a range of products, including IBM Storwize All Flash arrays: V7000F, V7000 Gen2+, and V5030F, the FlashSystem V9000, the IBM SAN Volume Controller (SVC), and IBM’s Spectrum Virtualize Software.
The company referred to this effort as a part of a: “Drumbeat of flash storage announcements.” IBM has a stated goal of providing its clients with: “The right flash for the right performance at the right price.”
IBM’s representatives explained that the updates were made possible by the fact that the prices of flash components have been dropping at a rapid pace while reliability is on the rise. The SSD Guy couldn’t agree more.
Here’s what IBM announced:
Starting from the low end and moving up, the V5030F entry-level/midrange array is an Continue reading
In a joint press release, SanDisk and IBM announced support for each other’s products. The IBM Spectrum Scale filesystem will support SanDisk’s InfiniFlash all-flash array to provide a high-capacity high-speed software-defined storage system.
At first glance this may seem a little odd, since IBM sells its own all-flash array, the FlashSystem, which became an IBM product line when the company acquired Texas Memory Systems (TMS) back in 2012. That is not the case, though. IBM has been validating that its Spectrum Storage products will work with just about any storage type that its customers may want to use. Rather than narrowing this software’s support to only IBM storage systems, IBM is showing that Spectrum Scale is flexible enough to work with a multitude of solutions, supporting InfiniFlash the same as it does other internal server capacity and other external storage in the form of JBODs (“Just a Bunch of Disks”) or JBOFs (“Just a Bunch of Flash”).
In this case IBM has worked with SanDisk to validate that its Spectrum Scale storage management software works with InfiniFlash, just as it does with those many other storage solutions.
In the announcement IBM explains that Continue reading
A recent conversation with some fellow analysts revealed a puzzling set of claims. EMC, at its EMC World conference (May 3-7) claimed to be the leader in flash array shipments. The very next week, in the same Las Vegas hotel, IBM also claimed leadership in flash.
Who do you believe?
- EMC is counting XtremIO Arrays as units shipped and according to Gartner Group held the #1 market share position with a 31.1% share, which is over a ten percentage point share lead
- IBM is counting capacity of PBs shipped with all of their flash storage solutions: The FlashSystem 840, 900, V840, V9000, DS8000, plus the XIV systems, Storwize V7000, IBM Flash DAS, and IBM PCIe Adapters
- NetApp is the leader if you count total flash systems shipped (NetApp-branded plus privately-branded systems) spanning multiple years as their SANtricity operating system and E-Series platforms have sold over 750,000 units
- Pure Storage uses its 700% growth to show that it’s the #1 fastest-growing flash storage company
- Then, if you want to compare any vendor’s total all flash array (AFA) systems sold this past year against hybrid storage arrays, Nimble Storage beats any of the AFA vendors.
With a webcast in the style of the big system makers like EMC and Oracle, SanDisk announced its InfiniFlash flash appliance. InfiniFlash is a box that crams a whopping 500 terabytes into only 3U of rack space.
How big is 500 terabytes? It’s more bytes than SanDisk’s entire flash output for 2001.
SanDisk boasts that InfiniFlash is a “category-defining product”, and pointed to the fact that IDC, who provided support for the roll-out, created a new “Big Data Flash” storage product category for this device.
The system boasts performance of one million random-read IOPS, which is impressive, but doesn’t give much indication of how it performs in standard enterprise dataflow, which is generally assumed to consist of a 70/30 split of reads and writes. (I should mention here that Objective Analysis published a survey of users’ IOPS and latency needs which can be purchased on our website.)
Price is a major focus for this product. SanDisk says that it will sell systems bundled with software at less than Continue reading
IBM has unveiled its new IBM FlashSystem V9000, an all-new offering that supports scale-up and scale-out flash growth models. The FlashSystem V9000 is an upgrade to the company’s FlashSystem V840 product. IBM also introduced the new IBM FlashSystem 900, the follow-on generation to the IBM FlashSystem 840. A full complement of software services (including snapshots and replication) is bundled with the product.
Over 4,000 IBM FlashSystems have shipped since the brand was introduced two years ago causing the company’s bit shipments to outpace the combined shipments of the second and third-ranked flash array providers.
The IBM FlashSystem V9000 comes in a 6U package that incorporates twelve IBM MicroLatency modules that provide 57TB of RAID 5 usable capacity, which then blooms to 285TB with IBM Real-time Compression. The proprietary modules provide more consistent performance than SSD-based systems – the system is as fast when it is 90% full as it is when only 10% of its total capacity is in use.
IBM tells us that the FlashSystem V9000 is not simply a virtualized node built up from a number of IBM FlashSystem 900 systems, but is a single, integrated system purpose-built to address the needs and focus of cloud, analytics, mobile/social and security. It supports seamless concurrent capacity increases up to its 2.2 petabyte upper limit when real-time compression is used.
IBM’s FlashSystem V9000 is currently available and carries a 7-year warranty as well as an optional 5-year “TCO” lease that IBM has priced to be cheaper than the high-performance disk arrays it has been designed to replace. This is intended to bring peace of mind to skittish would-be flash users.
An acquaintance pointed out that EMC has published a case study detailing how one of its divisions, EMC Corporate IT, decided to use an EMC Isilon storage system over other competing candidates:
After considering various storage solutions, EMC IT selected EMC Isilon® scale-out storage as the foundation for a new Hadoop-as-a-Service (HDaaS) offering.
My acquaintance wondered exactly which systems EMC IT evaluated before selecting an EMC array, and whether or not there was even the option of choosing a product from any of the numerous competing storage array vendors. He pointed out how embarrassing it would have been if this case study had been written by a competitor to tout its win at EMC IT.
You really have to wonder why EMC published this case study. Its customers take it for granted that the company will use its own offerings, and would probably leave in droves if it did not.
To paraphrase an old saying: “No EMC employee ever got fired for choosing EMC!”
Tom Coughlin and I have just released a new report that helps shed a lot of light on a pretty challenging subject: We asked nearly 200 IT managers to tell us how much storage performance their systems require. They provided candid replies about their IOPS, latency, and capacity needs for a number of leading applications.
The results of the Storage Performance Council’s SPC-1 report, show Kaminario surpassing last year’s record performance by 20k IOPS.
Interestingly enough Kaminario set the 2012 record using DRAM while this year the company was able to do it with its fourth-generation all-flash K2.
Why is the SPC1 test so highly respected in Continue reading