Recommended settings for ESX iSCSI initiator.

[Constantin (staff)]

Configuration of ESX host

• ESX iSCSI initiator fully supports NIC binding and MPIO (multipath) but VmWare doesn`t support using them at the same time.
• If you use NFS and iSCSI storage on one host you should use NIC teaming for both and don`t use MPIO.
• Using "IP Hash" load balancing policy with NIC teaming, but will limit you with 1 iSCSI connection per host. Also you can take a look to VmWare KB article 100737 about troubleshooting and proper configuration of IP Hash load balancing policy.
• Default path failure detection is 300 sec. VmWare doesn`t recommend to change, but if you like you can do it going to Advanced settings of ESX and change value of option Disk.PathEvalTime from 30 to 1500.

Configuration of Windows VMs
You can set up disk I/O timeout in Windows registry in following key

Code: Select all

HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Disk\TimeOutValue

Default values are:

• Without VMware Tools installed (non-cluster) - 10 seconds
• Without VMware Tools installed (cluster node) - 20 seconds
• With VMware Tools installed - 60 seconds

Configuration of Linux VMs
You can set up I/O timeoutwith following command:

Code: Select all

cat /sys/block/<disk>/device/timeout

Default values are:

• Without VMware Tools installed = 60 seconds (for CentOS)
• With VMware Tools installed = 180 seconds

Please note, that 60 seconds is adequate timeout for most cases.

Using recommended MPIO policy
To achieve higher performance we recommend to use Round Robin policy in iSCSI initiator. By default ESX(i) uses FixedPath policy. You can change it to RR by choosing "Manage path" option in properties of datastore or target (can be found in "Datastore" or "Storage devices" menu).
Either by default ESX(i) switches to another path every 1000 IOPS. To improve bandwidth and performance you can change this value to lower. You can do it following way:
Connect to ESX(i) with SSH or open local console, and type in

Code: Select all

esxcli nmp roundrobin setconfig --device [UUID] --iops 1 --type iops

or

Code: Select all

esxcli storage nmp psp roundrobin deviceconfig set -d naa.хххх -t iops -I 1

UUID of device you can found in "Storage adapters", while amount of IOPS 1 is the best recommended option. You can check properties of your device with following command:

Code: Select all

esxcli nmp roundrobin getconfig --device [UUID]

Please note that all setting provided above require testing to find best configuration for your environment.