Deduplication Performance

DavidMcKnight · Fri Jan 04, 2013 9:34 pm

I just installed Starwind 6.0.5189. I wanted to start testing Deduplication so I created a DDup disk. This test is being done on a 10 gigabit network infrastructure. From inside of VMware, I migrated a VM from a non DDup iSCSI target to my DDup target I just created. I'm seeing network speeds just under 1 gigabit. When I migrate from the same non DDup source Target to another target that is not DDep, I get a smooth 7-8 gigabit transfer speed.

I either case I'm seeing no real CPU usage.

Is using DDup suppose to have that kind of performance hit?

Sun Jan 06, 2013 2:48 pm

For now it's not recommended to use a dedupe-enabled device for storing VM images with primary storage in mind. We did implement data retention in this public version (read - deduplicated blocks never get deleted from dedupe database) which works fine for VM backup purpose but with extremely hot data everything get bloated very fast. We decided not to release deletion-enabled version based on this code branch now as we'll be pushing other implementation of deduplication engine which will **INCREASE** raw disk performace. Please stay tuned with V8 beta we'll finally push in mid-January (if nothing will break real hard).

DavidMcKnight wrote:I just installed Starwind 6.0.5189. I wanted to start testing Deduplication so I created a DDup disk. This test is being done on a 10 gigabit network infrastructure. From inside of VMware, I migrated a VM from a non DDup iSCSI target to my DDup target I just created. I'm seeing network speeds just under 1 gigabit. When I migrate from the same non DDup source Target to another target that is not DDep, I get a smooth 7-8 gigabit transfer speed.

I either case I'm seeing no real CPU usage.

Is using DDup suppose to have that kind of performance hit?