Re: EMC VMAX with VxVM 5.0
Neil Swallow <nswallow <at> csc.com>
2012-11-29 16:35:42 GMT
Sebastien, thanks for the reply
Yes, I made the filesystem on /dev/rdsk/c3t50000974081A7118d1s0 There
is currently just one path from the server whilst we do the migration so I
had to use the -f on the disable command as you suggest. This eliminated
vxdmp and vxvm in my mind but EMC weren't convinced - hence these emails.
As of a few minutes ago I think we've now persuaded them to stop pointing
the finger (though I have to say even I still find it a bit odd how much
worse things appeared with a vxfs filesystem than a UFS filesytem).
We patched the server as a result of gathering pre-req's from EMC (rather
than running any tools) but we've run EMCgrab at the request of EMC after
logging the call with them and they've highlighted a few things that needed
setting (like the ssd... stuff but are not too forthcoming on the actual
values to use, I'm not familiar with the "+HEAT" bit though - I'll have a
google of that.
We set these after some digging around the internet and any EMC doc's we
could find.
forceload: drv/ssd
set ssd:ssd_io_time=0x3c
set ssd:ssd_max_throttle=20
set fcp:ssfcp_enable_auto_configuration=1
We also set these in qlc.conf after some digging around
hba1-execution-throttle=20;
hba1-login-retry-count=8;
hba1-port-down-retry-delay=0;
hba1-connection-options=1;
hba1-fc-tape=0;
hba1-persistent-binding-configuration=1;
hba1-fast-error-reporting=0;
(restricted it to hba1 as we didn't want to impact the HDS access that is
still perfectly OK).
None of this has made any difference so far.
thanks,
Neil
From: DAUBIGNE Sebastien <sebastien.daubigne <at> atos.net>
To: Neil Swallow/GBR/CSC <at> CSC, Tony Griffiths
<tony_griffiths <at> symantec.com>
Cc: "veritas-vx <at> mailman.eng.auburn.edu"
<veritas-vx <at> mailman.eng.auburn.edu>
Date: 29/11/2012 15:38
Subject: RE: [Veritas-vx] EMC VMAX with VxVM 5.0
"modinfo |grep vx" would give you the exact revision of VxVM.
MP3 is highly recommended for 5.0 (see
https://sort.symantec.com/checklist/install), latest rev is MP3RP5HF1 for
vxvm module.
Also when you say " I've manually disabled the path and created a separate
vxfs..." : do you mean that you made you filesystem directly on the Solaris
path, for instance /dev/rdsk/c3t50000974081A7118d1s0 ?
Did you disable all paths to the EMC storage in DMP (vxdmpadm -f
disable ...) to prevent VxVM send any I/O to the VMAX during your test ?
if this is the case, you can exclude any VxVM/DMP issue : this could be
Solaris kernel/driver/firmware issue, but under no circumstances VxVM
issue, since no VxVM component was involved in your test.
I assume you ran EMCgrab+HEAT and applied all prereqs (patchs,
firmwares, /etc/system settings : ssd_io_time, ssd_max_throttle, ...)
Inappropriate queue depth settings can cause transport errors : for
instance, max_throttle recommended setting for DMX is 20 for EMC simples
LUNs, 32 for metaLUNs).
-----Message d'origine-----
De : veritas-vx-bounces <at> mailman.eng.auburn.edu [
mailto:veritas-vx-bounces <at> mailman.eng.auburn.edu] De la part de Neil
Swallow
Envoyé : jeudi 29 novembre 2012 16:03
À : Tony Griffiths
Cc : veritas-vx <at> mailman.eng.auburn.edu
Objet : Re: [Veritas-vx] EMC VMAX with VxVM 5.0
Tony,
plenty of errors in iostat ....
# iostat -En
c2t50060E80004469D0d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI Product: DF600F Revision: 0000 Serial No:
Size: 53.69GB <53687091200 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 2 Predictive Failure Analysis: 0
c2t50060E80004469D1d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI Product: DF600F Revision: 0000 Serial No:
Size: 53.69GB <53687091200 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 2 Predictive Failure Analysis: 0
c3t50000974081A7118d1 Soft Errors: 0 Hard Errors: 372 Transport Errors: 383
Vendor: EMC Product: SYMMETRIX Revision: 5874 Serial No:
Size: 59.06GB <59061043200 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c3t50000974081A7118d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: EMC Product: SYMMETRIX Revision: 5874 Serial No:
Size: 0.00GB <2949120 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
Straight 5.0GA as far as I know - I assume that's what this is telling
me....
PKGINST: VRTSvxvm
VERSION: 5.0,REV=05.11.2006.17.55
thanks,
Neil
From: Tony Griffiths <tony_griffiths <at> symantec.com>
To: "P.Tsvetkov <at> inform.gazprom.ru" <P.Tsvetkov <at> inform.gazprom.ru>,
Neil Swallow/GBR/CSC <at> CSC, "veritas-vx <at> mailman.eng.auburn.edu"
<veritas-vx <at> mailman.eng.auburn.edu>
Date: 29/11/2012 13:37
Subject: RE: [Veritas-vx] EMC VMAX with VxVM 5.0
Hi
Are the errors reported in iostat -En ?
Also is this VxVM 5.0 GA or a later update i.e 5.0MP3, 5.1 ...
cheers
tony
-----Original Message-----
From: veritas-vx-bounces <at> mailman.eng.auburn.edu [
mailto:veritas-vx-bounces <at> mailman.eng.auburn.edu] On Behalf Of
P.Tsvetkov <at> inform.gazprom.ru
Sent: 29 November 2012 13:26
To: nswallow <at> csc.com; veritas-vx <at> mailman.eng.auburn.edu
Subject: Re: [Veritas-vx] EMC VMAX with VxVM 5.0
Hello Neil,
VxVM gives you no errors if there are no problems in SAN.
SAN can be a problem even if there are seen no critical errors on switches.
Cables , buffer credits , 8Gbps Brocade Fill Word etc.
If hba is ok, if frond-end VMAX port is ok, if cables are ok (and switches)
then VxVM is ok as well
Regards, Pavel
-----Original Message-----
From: veritas-vx-bounces <at> mailman.eng.auburn.edu [
mailto:veritas-vx-bounces <at> mailman.eng.auburn.edu] On Behalf Of Neil Swallow
Sent: Thursday, November 29, 2012 4:54 PM
To: veritas-vx <at> mailman.eng.auburn.edu
Subject: [Veritas-vx] EMC VMAX with VxVM 5.0
Hello all,
Just after some feedback on whether anyone has experienced anything similar
to an issue we're currently seeing.
We're trying to migrate from an HDS SAN to an EMC VMAX on a Solaris 10
server. We have the server up to supported levels for drivers etc. and
have removed one of two paths to the HDS and routed that to the EMC and all
is seen OK. However when we try using the EMC (mirroring the volumes from
the HDS to the VMAX) we are inundated with scsi transport errors and a lot
of i/o wait time. DMP (VX, not powerpath) is disabling the path and
re-enabling it at random points (not necessarily during mirroring) and even
if the mirror completes the plexes on the VMAX LUN are disabling eventually
and vxdisk list reports the LUN as failing.
I've manually disabled the path and created a separate (vxfs) fileystem on
the LUN and done some file copies etc and still get problems so I'm not
convinced it's a DMP issue. I've also done the same with a UFS filesytem
and oddly UFS provides the least amount of i/o waiting and out-and-out
read/write failures of the copy commands etc. but still registers lots of
transport errors.
With no issues on HDS I'm loathe to blame any of the VX elements but EMC
are providing no help since the VMAX itself and all the switches are
reporting no issues and they are trying to blame vxvm/vxdmp/vxfs. Whilst I
agree that things appear better without any VX involved, the issues do not
go away entirely so I am currently putting that down to a lower tolerance
to issues on the part of the various VX elements.
Anyway, if anyone has any idea/suggestions/similar issues (any additional
logging I can add at a VX level to help prove anything) that have been
rectified, I'd appreciate it
thanks,
Neil
_______________________________________________
Veritas-vx maillist - Veritas-vx <at> mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx
_______________________________________________
Veritas-vx maillist - Veritas-vx <at> mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx
_______________________________________________
Veritas-vx maillist - Veritas-vx <at> mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx
________________________________
Ce message et les pièces jointes sont confidentiels et réservés à l'usage
exclusif de ses destinataires. Il peut également être protégé par le secret
professionnel. Si vous recevez ce message par erreur, merci d'en avertir
immédiatement l'expéditeur et de le détruire. L'intégrité du message ne
pouvant être assurée sur Internet, la responsabilité du groupe Atos ne
pourra être engagée quant au contenu de ce message. Bien que les meilleurs
efforts soient faits pour maintenir cette transmission exempte de tout
virus, l'expéditeur ne donne aucune garantie à cet égard et sa
responsabilité ne saurait être engagée pour tout dommage résultant d'un
virus transmis.
This e-mail and the documents attached are confidential and intended solely
for the addressee; it may also be privileged. If you receive this e-mail in
error, please notify the sender immediately and destroy it. As its
integrity cannot be secured on the Internet, the Atos group liability
cannot be triggered for the message content. Although the sender endeavors
to maintain a computer virus-free network, the sender does not warrant that
this transmission is virus-free and will not be liable for any damages
resulting from any virus transmitted.