SSDs Need Controllers with More, NO! Less Power

More Power-Less PowerThe Storage Developer Conference in September gave a rare glimpse into two very different directions that SSD architectures are pursuing.  While some of the conference’s presentations touted SSDs with increasing processing power (Eideticom, NGD, Samsung, and ScaleFlux) other presentations advocated moving processing power out of the SSD and into the host server (Alibaba, CNEX, and Western Digital).

Why would either of these make sense?

A standard SSD has a very high internal bandwidth that encounters a bottleneck as data is forced through a narrower interface.  It’s easy to see that an SSD with 20+ NAND chips, each with an 8-bit interface, could access all 160 bits simultaneously.  Since there’s already a processor inside the  SSD, why not open it to external programming so that it can perform certain tasks within the SSD itself and harness all of that bandwidth?

Example tasks would include Continue reading “SSDs Need Controllers with More, NO! Less Power”

Podcast: Flash Memory Summit

GreybeardsThose of you who enjoy listening to podcasts may want to hear Ray Lucchesi (Silverton Consulting) and Howard Marks (Deep Storage) interview The SSD Guy for their series “Greybeards on Storage.”

This interview is their 70th episode covering the world of storage.  These guys do a fantastic job of probing this industry with great enthusiasm and insight.

This episode is a 42-minute compendium of the sights and goings-on at last August’s Flash Memory Summit along with a number of side trips into the world of SSDs and memory chips.  It’s not strictly structured, and not strictly serious, but just three industry insiders having a lot of fun sharing their observations.

Some of the broad range of subjects that we Continue reading “Podcast: Flash Memory Summit”

WDC: No SSD/HDD Crossover

WDC HDD vs NAND Price per GB 10X GapThose who have been reading posts on The SSD Guy blog for some time have often heard me explain that SSD prices will not fall below HDD prices anytime soon.  Last week Western Digital shared a roadmap that shows that we can expect for there to be a sizeable price gap between the two technologies at least through 2028.

Let me stop for a moment to point out that Western Digital Corp, or WDC, no longer has any reason to take sides in the HDD vs. SSD battle now that the company has acquired SanDisk, a leading SSD maker.  Even before that, WDC’s HGST business has been the market leader in SAS SSDs for a number of years.  WDC doesn’t take sides in arguments about SSDs vs. HDDs.  Instead the company stands ready to sell whichever one the customer finally decides to use.

This post’s graphic comes from a chart that WDC used on October 11 when introducing its new MAMR head technology, which the company expects to propel HDD capacities up, and HDD price per terabyte down, for a number of years.  To create this chart WDC’s HDD team joined forces with the SanDisk flash team to project both HDD and NAND price per terabyte for the next 11 years.  The most important conclusion is that Continue reading “WDC: No SSD/HDD Crossover”

Comparing SSDs to Tomatoes

TomatoA few years ago The SSD Guy posted an analogy that Intel’s Jim Pappas uses to illustrate the latency differences between DRAM, an SSD, and an HDD.  If we look at DRAM latency to be a single heartbeat, then what happens when we scale that timing up to represent SSDs and HDDs?  How many heartbeats would it take to access either one, and what could you do in that time?

I still think it’s a pretty interesting way to make all these latency differences easier to understand.

Just recently I learned of a Rich Report video of a 2015 presentation in which Micron’s Ryan Baxter uses a different and equally interesting analogy based on tomatoes.

Tomatoes aren’t the first thing that comes to my mind when I think about SSDs, but this video may change my way of thinking!

The tomato slide, 9:30 into the presentation, is Continue reading “Comparing SSDs to Tomatoes”

Getting the Most from Data Center SSDs

2017-09-19 Calypso Real World Workload TestMy friend and associate Eden Kim of Calypso Systems has published a new white paper on real workloads for SSDs.

This is the company that has helped the Storage Networking Industry Association (SNIA) to develop performance tests for SSDs that get past the issues that plague SSD users: Yes, it does well when it’s new, but how will an SSD perform after a year or two of service?

Calypso has recently published a new White Paper entitled: Datacenter Server Real World Workloads.  This document analyzes real-life datacenter server workloads and performance to provide important insight into how an SSD might perform in actual environments rather than in synthesized workloads.  It compares data center class SSDs against SAS HDDs to take a lot of the guessing out of issues about IOPS requirements, endurance needs, and so forth by comparing the measured activity over 24 hours of a 2,000-outlet retail chain web portal running SQL.

The tests in the paper represent a Continue reading “Getting the Most from Data Center SSDs”

NGD’s New “In-Situ Processing” SSD

NGD In Situ graphicStart-up NGD Systems (formerly NxGenData) has just announced the availability of an SSD with in situ processing – that is, the SSD can actually process data rather than simply store it.  The new “Catalina 2” SSD is said to have the ability to run advanced applications directly on the drive.

NGD tells us that the SSD, which comes in both U.2 and AIC (PCIe add-in card) formats, is currently available for purchase.

If your memory is long enough you may recall that The SSD Guy wrote a post four years ago about something like this.  At the 2013 Flash Memory Summit Micron Technology delivered a keynote detailing a research project in which they reprogrammed SSDs so that each SSD in a system could perform basic database management functions.

Although Micron demonstrated significant advantages of using of this approach, nobody, not even Micron, has followed through with a product until now.

NGD briefed me and explained that the data explosion expected with the Internet of Things will not Continue reading “NGD’s New “In-Situ Processing” SSD”

Comparing Wear Figures on SSDs

DWPD TBW GB/Day TriangleI have been receiving questions lately from people who are puzzled when companies use different parameters than their competitors use to specify the endurance of their SSDs.  How do you compare one against the other?  Some companies even switch from one parameter to another to define the endurance of different SSDs within their product line.

I have found that Intel uses three different endurance measures for its products: DWPD (drive writes per day), TBW (terabytes written), and GB/day.

There’s not any real difference between any of these measures – each one is one way of stating how many times each of the SSD’s locations can be overwritten before the drive has gone past its warrantied life.

The relationships between these three measures are illustrated in this post’s graphic.  You can click on it to see an expanded version.  It’s all pretty simple.  We’ll spell out the relationships in detail below, but in brief, if you want to compare Continue reading “Comparing Wear Figures on SSDs”

Managing SSDs Using Machine Learning

Focusrite Recoring Console - photo by JacoTenSSDs use a huge number of internal parameters to achieve a tricky balance between performance, wear, and cost.  The SSD Guy likes to compare this to a recording studio console like the one in this post’s graphic to emphasize just how tricky it is for SSD designers to find the right balance.  Imagine trying to manage all of those knobs!  (The picture is JacoTen’s Wikipedia photo of a Focusrite console.)

Vendors who produce differentiated SSDs pride themselves in their ability to fine-tune these parameters to achieve better performance or endurance than competing products.

About a year ago I suggested to the folks at NVMdurance that they might consider applying their machine learning algorithm to this problem.  (The original NVMdurance product line was described in a Memory Guy post a while ago.)  After all, the company makes a machine learning engine that tunes the numerous internal parameters of a NAND flash chip to extend the chip’s life while maintaining the specified performance.  SSD management would be a natural use of machine learning since both SSDs and NAND flash chips currently use difficult and time-consuming manual processes to find the best mix of parameters to drive the design.

Little did I know that NVMdurance’s researchers Continue reading “Managing SSDs Using Machine Learning”

Latency, IOPS & NVDIMMs

Latency vs IOPS Persectives - PowerPointSometimes it’s enlightening to compare several viewpoints on similar data.  At yesterday’s SNIA Persistent Memory Summit a number of presentations provided interesting overlapping views on certain subjects.

One of particular interest to The SSD Guy was latency vs. IOPS.  Tom Coughlin of Coughlin Associates and I presented the findings from our recently-published IOPS survey report and in Slide 19 displayed the basic chart behind this post’s graphic (click to enlarge, or, better yet, right-click to open in a new tab). This chart compares how many IOPS our respondents said they need for the storage in their most important application, and compared that to the latency they required from this storage.  For comparison’s sake we added a reference column on the left to roughly illustrate the latency of various standard forms of storage and memory.

You can see that we received a great variety of inputs spanning a very wide range of IOPS and latency needs, and that these didn’t all line up neatly as we would have anticipated.  One failing of this chart format is that it doesn’t account for multiple replies for the same IOPS/latency combination: If we had been able to include that the chart would have shown a clearer trendline running from the top left to the lower right.  Instead we have a band that broadly follows that trend of upper-left to lower-right.

Two other speakers presented the IOPS and latency that could be Continue reading “Latency, IOPS & NVDIMMs”

Why SSD and HDD Prices Move in Parallel

ASTC 2016 HDD RoadmapWhy are HDD prices tracking SSD prices?  Why don’t they cross over?  These are questions that The SSD Guy is often asked, especially by people who anticipate a crossover in the near future.

In essence it’s because both the HDD industry and the semiconductor industry have set goals for themselves to achieve 30% average annual price reductions.  If they are both on the same trajectory, and if there’s an order of magnitude difference between HDD and SSD prices today, then there will be an order of magnitude difference in the future as well.

The 30% average annual decline in SSD prices has a convenient name: Moore’s Law.  Although there’s no physical, economic, or other restriction behind Moore’s Law (so it’s not really a law at all) it serves as a guide for the industry.  Chip makers set their sights at doubling the number of transistors on a chip every couple of years, and this equates to average annual price decreases of 30%.

The HDD business also Continue reading “Why SSD and HDD Prices Move in Parallel”