Massive speed difference between 2 images

[hongman]

Hi

I have 2 starwind images (VMWare vmdk) on the same array of 15k SAS drives.

Users are experiencing slow access to one of the drives, so I ran a disk speed utility:

Problem disk:



Uploaded with ImageShack.us

Ok disk:



Uploaded with ImageShack.us

Both disks have WB Caching enabled at 2048MB, and are identical really.

Can you shed some light?

[hongman]

The disk speed utility was run within the Windows VM.

Here is the same results, run directly on the SAN:



Uploaded with ImageShack.us

Please help me understand the results and any problems...

[Max (staff)]

Are the Disks connected via the same NIC interface, any Vlans configured?
I think you need to benchmark the physical array itself, the problem may appear to be in the hardware.

[hongman]

The comparisons below were run from 2 different ESXi hosts, but they both have the same capacity links back to the SAN and are both identical hardware.

What benchmarking software would you recommend?

[anton (staff)]

ATTO Disk Benchmark (quick run), Intel I/O Meter (long run), SQLIO and Intel NAS Performance Toolkit for production-level tests (together with Intel I/O Meter with special access patterns). Please re-run the tests with at least ATTO, check network performance between both ESX nodes and storage and let us know your numbers. Thanks!

[hongman]

Thanks.

Overnight, one of the (brand new) 15K SAS drives failed so now the array is running degraded, so a bit pointless doing tests until the drive is replaced!

Shall download the programs you mentioned to get ready though, will be posting results asap.

[anton (staff)]

Disk being dead on arrival could be a good reason why you get bogus data during your tests.

Sure! Please take your time on fixing hardware related issue and we'd be happy if you'd share your test results with us

Thanks.

Overnight, one of the (brand new) 15K SAS drives failed so now the array is running degraded, so a bit pointless doing tests until the drive is replaced!

Shall download the programs you mentioned to get ready though, will be posting results asap.

[hongman]

The disk only died last night, not doa.

But I'm thinking if it was on it's way out, could
Also be the reason for funny results!

[anton (staff)]

Absolutely!

The disk only died last night, not doa.

But I'm thinking if it was on it's way out, could
Also be the reason for funny results!

[hongman]

Ok, sorry about the delay, got caught up.

ATTO Benchmarks:

15K SAS Raid 5


Uploaded with ImageShack.us
7.2K NL SAS Raid 6


Uploaded with ImageShack.us

Looks "normal" to you?

[anton (staff)]

From what I understand you're providing RAW disk numbers (no StarWind involved). If yes then they are probably OK as RAID5/6 has issues with writes being much slower then reads (see link below). I would try to enable write back cache on RAID controller and experiment with RAID10 configuration.

If not then please provide details about network configuration, StarWind version, amount of cache allocated etc etc etc

http://daverdave.com/node/165 <-- Nice place to start reading about RAID5/6 Vs. anything else on Earth.