Comments for Vaughn StewartVaughn Stewart

Comment on Heads up! Avoiding VMware vSphere ESXi 5 NFS Disconnect Issues by AndyT

AndyT — Fri, 10 May 2013 15:45:24 +0000

ONTAP release 8.1.2P4 has been released today where bug 321428 has been marked as fixed.

Comment on Software Defined Storage: The Evolution of Storage by @PublicCloudGuy

@PublicCloudGuy — Thu, 09 May 2013 23:54:27 +0000

Great post Vaughn (as always). Interesting that much of the existing value proposition you articulate here is evident in the recent ViPR announcement but only as a concept (or as Chuck says in his blog post “what EMC ViPR aspires to achieve”). Proves once again that there is a very good reason why ONTAP is the No.1 storage OS.

Comment on Heads up! Avoiding VMware vSphere ESXi 5 NFS Disconnect Issues by S.Meyer

S.Meyer — Wed, 08 May 2013 08:43:51 +0000

Vaughn, when will 8.1.2p4 be available??? The workarounds are no option for our customer. New MetroCluster installation with vSphere 5.1. What are your suggestions?

Comment on Heads up! Avoiding VMware vSphere ESXi 5 NFS Disconnect Issues by cng360

cng360 — Wed, 10 Apr 2013 11:11:19 +0000

We encountered NetApp bug 393877 and confirmed that 8.12P3 resolved the issue. http://techfailures.wordpress.com/2013/03/28/netapp-fail-2/

Comment on Thoughts on Best Practices with VMware vSphere 5 by MOhammed Raffic

MOhammed Raffic — Wed, 10 Apr 2013 00:43:53 +0000

Awesome….Very useful

Mohammed Raffic
http://www.vmwarearena.com

Comment on Heads up! Avoiding VMware vSphere ESXi 5 NFS Disconnect Issues by OZ

OZ — Wed, 03 Apr 2013 16:50:27 +0000

Are you sure the a similar problem does not exist on FAS6200 series? We were seeing NFS disconnect\reconnects prior to enabling Storage I/O.

Comment on Heads up! Avoiding VMware vSphere ESXi 5 NFS Disconnect Issues by Dan

Dan — Tue, 02 Apr 2013 02:45:03 +0000

Just ran into this issue today while building out VMware cluster for Oracle. Vaughn – Do you know if this issue has been resolved in any of the 8.1.2P* releases?

Thanks,

Dan

Comment on Heads up! Avoiding VMware vSphere ESXi 5 NFS Disconnect Issues by Vaughn

Vaughn — Fri, 29 Mar 2013 19:24:39 +0000

Awesome!

Comment on Heads up! Avoiding VMware vSphere ESXi 5 NFS Disconnect Issues by Heath

Heath — Fri, 29 Mar 2013 16:35:40 +0000

Been running 7.3.7P1D2 on the FAS2020A for 48 hours now. Completely cleared up the disconnects. No negative side effects. Thanks all!

Comment on Heads up! Avoiding VMware vSphere ESXi 5 NFS Disconnect Issues by Heath

Heath — Thu, 28 Mar 2013 01:59:35 +0000

It’s been running 8 hours with no NFS drops. Looks good so far. Will update again tomorrow.

Comment on Heads up! Avoiding VMware vSphere ESXi 5 NFS Disconnect Issues by Vaughn

Vaughn — Thu, 28 Mar 2013 01:48:17 +0000

Heath – thanks, looking forward to your results

Comment on Heads up! Avoiding VMware vSphere ESXi 5 NFS Disconnect Issues by Heath

Heath — Wed, 27 Mar 2013 18:10:11 +0000

I am having this issue with a FAS2020A right now. Seemed to pop up for the first time about 2 – 3 weeks following our upgrade to ESXi 5.1. The workaround of changing the NFS MaxQueueDepth to 64 had no positive result for us. Currently in the process of upgrading the filer to 7.3.7P1D2. Will advise with results.

Comment on Heads up! Avoiding VMware vSphere ESXi 5 NFS Disconnect Issues by Vaughn

Vaughn — Tue, 26 Mar 2013 17:35:50 +0000

Thanks to the brilliance of John Ferry, NetApp Critical Problem Resolution Escalations Engineer, for the support shared above

Comment on Heads up! Avoiding VMware vSphere ESXi 5 NFS Disconnect Issues by Vaughn

Vaughn — Tue, 26 Mar 2013 17:33:25 +0000

Jude,

I sent this to you privately but am reposting here for the community…

I’d clean up the alignment or get rid of the linked clones if that’s what they’re using.
Also verify the settings for burt 90314 are in effect since a vmware snap delete is a filer wafl delete.

It’s a 3140 in 7-mode
The actual number if NFS ops is pretty low based upon – https://latx/viewperf/id/149681

Elpsd CP CP CP CP CP CP CP CP CP CP CP CP CP CP CP
Time Total Blkd Nrml Timer Snap Bufs Drty Full B2B Flsh Sync vbufs dB2B dVecs mSecs
( 293)01/16/013 22:01:02 35 0 35 5 0 0 0 30 0 0 0 0 0 0 102226
( 293)01/16/013 22:08:04 53 1 52 0 0 0 0 48 1 0 4 0 0 0 132543
( 294)01/16/013 22:14:55 106 2 104 0 0 0 0 104 2 0 0 0 0 0 157300
( 293)01/16/013 22:22:20 40 1 39 3 0 0 4 29 1 0 3 0 0 0 120899
( 293)01/16/013 22:29:29 31 0 31 13 0 0 0 18 0 0 0 0 0 0 86016

NFS TCP input flow control is engages so the read latency is getting hit:

tcp input flowcontrol receive=30808, xmit=0
tcp input flowcontrol out, receive=30808, xmit=0

They do have alignment issues: look at all the delta files…….
And that’s a small sunset..
The lun stats look fine though so just NFS…..

Files Causing Misaligned IO’s
[Counter=38505], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/NCS01/NCS01-flat.vmdk
[Counter=89345], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFAISPI01/CFAISPI01_1-000002-delta.vmdk
[Counter=12], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFAISPI01/CFAISPI01-000002-delta.vmdk
[Counter=43], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFASISD01/CFASISD01-000003-delta.vmdk
[Counter=631], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFABSMD01/CFABSMD01_1-000003-delta.vmdk
[Counter=4], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFASQLS05/CFASQLS05_2-000001-delta.vmdk
[Counter=6], Filename=DC1_PROD_VMDK_SAS_03/VMDK_03/CFAEVLT01/CFAEVLT01-flat.vmdk
[Counter=94], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFABSMD01/CFABSMD01_1-000001-delta.vmdk
[Counter=12], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFAIDNS01/CFAIDNS01-flat.vmdk
[Counter=1474], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFAMSPA03/CFAMSPA03-000001-delta.vmdk
[Counter=1055], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFASQLS05/CFASQLS05_1-000001-delta.vmdk
[Counter=75], Filename=DC1_PROD_VMDK_SAS_02/VMDK_02/CFANOPM01/CFANOPM01-000004-delta.vmdk
[Counter=2], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFAIDNS01/CFAIDNS01-flat.vmdk
[Counter=19], Filename=DC1_PROD_VMDK_SAS_02/VMDK_02/CFANOPM01/CFANOPM01-000004-delta.vmdk
[Counter=12121], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFAISPI01/CFAISPI01_1-000002-delta.vmdk
[Counter=255], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFAMSPA03/CFAMSPA03-000001-delta.vmdk
[Counter=35], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFABSMD01/CFABSMD01_1-000003-delta.vmdk
[Counter=4688], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/NCS01/NCS01-flat.vmdk
[Counter=1], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFAHPRO02/CFAHPRO02-000003-delta.vmdk
[Counter=131], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFASQLS05/CFASQLS05_1-000001-delta.vmdk
[Counter=5], Filename=DC1_PROD_VMDK_SAS_02/VMDK_02/ilm1/ilm1-000001-delta.vmdk
[Counter=1], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFAUCMD01/CFAUCMD01-000002-delta.vmdk
[Counter=1], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFACCAM01/CFACCAM01_2-000001-delta.vmdk
[Counter=26], Filename=DC1_PROD_VMDK_SAS_01/VMDK_01/CFABSMD01/CFABSMD01_1-000001-delta.vmdk