Random Post: VAAI and supportability
RSS .92| RSS 2.0| ATOM 0.3
  • Home
  •  

    vSphere Round Robin MultiPathing

    There are a number of blog posts describing the configuration of Round Robin (RR) multipathing on vSphere.  *Note: Content on this page has been distilled from the sources referenced below, as well as my colleague vmwise.com.  Check those sites for a deeper dive in to the content.  I’ve also removed some identifiers from the output.

    http://www.boche.net/blog/index.php/2010/02/04/configure-vmware-esxi-round-robin-on-emc-storage/

    http://www.yellow-bricks.com/2009/03/19/pluggable-storage-architecture-exploring-the-next-version-of-esxvcenter/

    http://www.ivobeerens.nl/?p=465

    The three commands that are your friends throughout this post:

    esxcli nmp satp list <- Storage Array Type Plugin (SATP)

    esxcli nmp psp list <- Path Selection Plugin (PSP)

    esxcli nmp device list <- List the LUNs from the SAN represented as their device names

    1) SSH in to the server (assuming you enabled remote tech support from the console).

    2) Display the current pathing configuration:

    esxcli nmp device list

    naa.60
    Device Display Name: Fibre Channel Disk (naa.60)
    Storage Array Type: VMW_SATP_DEFAULT_AA
    Storage Array Type Device Config: SATP VMW_SATP_DEFAULT_AA does not support device configuration.
    Path Selection Policy: VMW_PSP_FIXED
    Path Selection Policy Device Config: {preferred=vmhba:C:T:L;current=vmhba:C:T:L}

    3.1) If you have storage from NetApp, do(note, there are two dashes before “psp” and “satp”):

    esxcli nmp satp setdefaultpsp –psp VMW_PSP_RR –satp VMW_SATP_DEFAULT_AA

    3.2) If you have certain storage from an EMC DMX, do:

    esxcli nmp satp setdefaultpsp –psp VMW_PSP_RR –satp VMW_SATP_SYMM

    These commands will change the default pathing to round robin (PSP or Path Selection Plugin) for the specific SATP (Storage Array Type Plugin).

    3.3) At this point, you can reboot the  if LUNs were already presented.  If no SAN storage is attached, scan in the new devices, and they will be automagically set to round robin.  Or, run the following command to set the Path Selection Policy:

    for i in `ls /vmfs/devices/disks/ | grep naa.60` ; do esxcli nmp device setpolicy –device $i -P VMW_PSP_RR ; done

    4) Check the current config, post reboot:

    esxcli nmp device list

    naa.60
    Device Display Name: Fibre Channel Disk (naa.60)
    Storage Array Type: VMW_SATP_DEFAULT_AA
    Storage Array Type Device Config: SATP VMW_SATP_DEFAULT_AA does not support device configuration.
    Path Selection Policy: VMW_PSP_RR
    Path Selection Policy Device Config: {policy=rr,iops=1000,bytes=10485760,useANO=0;lastPathIndex=1: NumIOsPending=0,numBytesPending=0}

    Look at Path Selection Policy.  It now says WVM_PSP_RR instead of VMW_PSP_FIXED.  We are getting closer to our goal.

    5) Now we want to configure the round robin policy to send 1 IO down a path, and then round robin to the next path (note: there are two dashes before “type”).

    for i in `ls /vmfs/devices/disks/ | grep naa.60` ; do echo $i ; esxcli nmp roundrobin setconfig –type “iops” –iops=1 –device $i ;done

    This command will look in the /vmfs/devices/disks/ directory, grab anything that starts with naa.60 (which should pick up SAN storage), and then set the round robin policy to 1 IO per path.

    6) Verify the new configuration:

    esxcli nmp device list

    naa.60
    Device Display Name: Fibre Channel Disk (naa.60)
    Storage Array Type: VMW_SATP_DEFAULT_AA
    Storage Array Type Device Config: SATP VMW_SATP_DEFAULT_AA does not support device configuration.
    Path Selection Policy: VMW_PSP_RR
    Path Selection Policy Device Config: {policy=iops,iops=1,bytes=10485760,useANO=0;lastPathIndex=5: NumIOsPending=0,numBytesPending=0}

    Validating our output, we now have our policy=iops, and iops=1.

    13 responses to “vSphere Round Robin MultiPathing”

    1. Roman says:

      There is a way sort out all the duplicate LUN-s and local devices. To do that I use instead of :

      for i in `ls /vmfs/devices/disks/ | grep naa.60`

      this :

      `ls /vmfs/devices/disks/|grep naa.60060|cut -d ":" -f1|sort -u`

      VMware uses naa.60050 to mark it’s local VMFS storage in newer versions.

      Bregs, Roman

    2. Roman says:

      Forgot to thank You for a wonderful article. Very useful.

    3. […] comes Round Robin to many cheers and hoorays, and we merrily go about our business and configure our hosts to use it.  We extolled the virtues to our management saying how available our connection to the […]

    4. […] (DeinosCloud) Best practices for HP EVA, vSphere 4 and Round Robin multi-pathing (Ivobeerens.nl) vSphere Round Robin MultiPathing (Phil the Virtualizer) Multipathing policies in ESX 4.x (VMware […]

    5. Johnson says:

      Easy to follow instructions!
      Followed to tweak more performance out of my new Vmware + HP P4300 setup

    6. Stuart Thompson says:

      I have hp arrays and have selected the path policy as round robin through the gui, is this enough or must I make the changes you,ve shown in the cli?

      • philipditzel says:

        You should go to the CLI and run steps 3.2 and 5 at the minimum. 3.2 will set your default PSP, which is sticky for the next time you read in devices. You will have to run step 5 every time you read in new devices.

    7. Justin says:

      Does anyone know how to customize the ks.cfg to set RR as your default path poicy in ESXi 5.0?

    8. […] (DeinosCloud) Best practices for HP EVA, vSphere 4 and Round Robin multi-pathing (Ivobeerens.nl) vSphere Round Robin MultiPathing (Phil the Virtualizer) Multipathing policies in ESX 4.x (VMware KB) Did you know that you can now […]

    Leave a Reply

    Your email address will not be published. Required fields are marked *