I have to admit that it’s embarrassing when The SSD Guy misses something important in the world of flash storage, but I only recently learned of a paper that Baidu, China’s leading search engine, presented at the ASPLOS conference a year ago. The paper details how Baidu changed the way they use flash to gain significant benefits over their original SSD-based systems.
After having deployed 300,000 standard SSDs over the preceding seven years, Baidu engineers looked for ways to achieve higher performance and more efficient use of the flash they were buying. Their approach was to strip the SSD of all functions that could be better performed by the host server, and to reconfigure the application software and operating system to make the best of flash’s idiosyncrasies.
You can only do this if you have control of both the system hardware and software.
The result was SDF, or “Software-Defined Flash”, a card that Continue reading