Introduction

Deduplication and Compression

The amount of data in the virtualized datacenters is continuously growing, making VM-centric storage solutions more and more expensive. This introduces a challenge for vendors to develop storage which can sustain constant data growth and maintain the required level of performance. With server virtualization not yet on its peak, the demand, popularity, and production of VDIs are starting to elevate. This means that industry is about to face а much bigger data wave, and the VM-centric storage challenge becomes even more relevant than ever.

Explore StarWind VSAN —

go!

Download VSAN

White Paper WP

Problem

Problems of Deduplication and Compression in All-Flash Environments

Existing space reduction (deduplication and compression) technologies available on the market are not tailored for the needs of flash based storage. Offline space reduction assumes that data is written to the array twice: first time as is, and second time when it’s "dehydrated". This causes premature flash wear out and doesn’t preserve space, which is critical for arrays with high $/IO and $/GB ratio. Starting the data optimization process after raw data is physically written to the array also requires the array to maintain space reserved for storing raw data until it’s optimized.

Implementing space reduction on commodity SAS and SATA storage arrays doesn’t make much sense because space reduction process is stealing a vast amount of IOPS from an initially slow array and gives no significant improvement for the cost per terabyte and cost per IO in return. With the modern high capacity SATA and SAS drives it is more cost effective to add an extra drive instead.

Traditional space reduction technologies are write-intensive

Solution

StarWind VSAN Deduplication and Compression

StarWind Virtual SAN implements in-line deduplication using industry standard 4 KB block for highest effectiveness and optimal deduplication ratio. Deduplication is then followed with optional compression of the written data blocks. Combined with Log Structuring this results in a double profit:

Amount of data physically written to the array is reduced which gives more IOPS for the VMs and no IOPS stolen by the data optimization engines
Less data written also means less erase and write cycles resulting in much better flash storage utilization and flash cell lifespan
Log structuring allows to get rid of flash drive "spot burns"

With the VDI scenarios where the amount of overlapping data is close to 90% StarWind inline deduplication makes it possible to elevate the performance further by implementing in-memory computing. With this approach entire VM data is pinpointed in RAM cache resulting in uncompromised performance for virtual desktop infrastructures. A log structured copy of the data is stored on commodity spindle-based storage array to protect the volatile high performance storage layer.

StarWind in-line deduplication writes physically less data to the array

Conclusion

Increase Storage Utilization Efficiency of Flash-based Storage with In-Line Deduplication

StarWind Virtual SAN dramatically increases the usable space available on the flash based storage by deduplicating the data before it physically hits the storage array. Combined with log structuring, In-line Deduplication engine does not cripple performance and steal IOPS from the tier 1 storage. In fact, it significantly increases the performance compared to a scenario where local flash-based storage is used.

Success Stories

We were able to build 2-node storage clusters based on virtualization in 19 hypermarkets without any problems and with high cost-efficiency.

Vass Sandor, IT Infrastructure Leader

By being able to virtualize our environment with StarWind, we were able to retire some old hardware, get our services highly available, reduce power consumption and heat in our server closet.

David Gardner, Information Systems Manager

We are satisfied with StarWind. The support is really fantastic. Whenever any issue arises, the response is very prompt, and solution is immediate.

Srinivas Kouda, Company’s Representative

StarWind got us off the clustered environment, which was a big help. So, I could regain control of my storage and reclaim and redistribute the space we desperately needed.

Ryan Fulton, Company’s Representative

Price + Simplicity. StarWind VSAN offers great pricing and allows us to get work done without expensive custom hardware. It also makes getting back online quick and easy after an outage or hardware failure.

Aaron Hayes, IT Manager

We chose StarWind Mainly because of the cost compared to other vendors. Simplicity of setup was also a major factor and I like the fact that you don’t need a vendor certified engineer to perform the installation.

John Harris, Windows System Administrator,
Department of Physics, University of Oxford

Because of recommendations of older colleagues, with StarWind, we got a reliable storage with no additional hardware. There was a need to increase IT infrastructure performance and we saw StarWind as the most cost-effective solution.

Željko Medić, Director of IT Department

StarWind is the best storage product I have ever used! It satisfies and exceeds requirements.

Joe Gursky, Director of IT

Fill the gaps

Choose how you would like to start:

Download a 30-day trial
Send me a quote
Schedule a live demo

You agree that StarWind Software Inc. may use the above information to accommodate your requests, keep in touch with you, and offer a better customer experience.
You can withdraw your consent at any time by reaching us at dataprotection@starwind.com.
For more information on how we process your personal data, please read our Privacy Policy.