VPLEX: How should I configure the fill word

setting on VPLEX internal Brocade switches?

Article Number:000015706 Version:5
Key Information
Audience: Level 40 = Employees
and Partners

Original Create Date: Mon May

28 09:43:39 GMT 2012
First Published: Fri May 31
Channels: Customer , Internal App
05:04:14 GMT 2013
Originally Created By: John
Last Modified: Tue Aug 27
Colburn
20:03:20 GMT 2013
Summary:

Article Type: How To

Validation Status: Final Approved
Last Published: Tue Aug 27
20:03:20 GMT 2013

Article Content
Goal: How should I configure the fill word setting on VPLEX internal Brocade switches?
Issue: The er_bad_os counter increments rapidly on VPLEX internal Brocade switch ports.
An incorrect or incompatible fill word setting at 8Gbps will cause the er_bad_os (Invalid ordered set)
value to increase rapidly.
Environment: Product: Connectrix DS-300B
Product: VPLEX VS1
Cause: An incorrect or incompatible fill word setting (at 8Gbps) has been specified. See example below:
FC-Switch-A:
service> switchshow
switchName:FC-Switch-A
switchType:71.2
switchState:Online
switchMode:Native
switchRole:Principal
switchDomain:1
switchId:fffc01
Index Port Address Media Speed State Proto
==============================================
4 4 011600 id N8 Online FC F-Port 50:00:14:42:70:77:23:31

< VPLEX Engine 8Gbps port

FC-Switch-A:service> porterrshow
frames enc crc crc too too bad enc disc link loss loss frjt fbsy
tx rx in err g_eof shrt long eof out c3 fail sync sig
============================================================================================

4: 204 204 0 0 0 0 0 0 0 0 0 0 0
FC-Switch-A:service> portcfgshow
FC-Switch-A:service> Ports of Slot 0 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
-----------------+--+--+--+--+----+--+--+--+----+--+--+--+----+--+--+-Speed
AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN
Fill Word
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 < The fill word

set to mode 0 in al

the default)
FC-Switch-A:service> portstatsshow 4
stat_wtx
stat_wrx
stat_ftx
stat_frx

5660 4-byte words transmitted

5620 4-byte words received
340 Frames transmitted
340 Frames received

er_bad_os 66690961 Invalid ordered set

Command re-issued 6 seconds later:
FC-Switch-A:service> portstatsshow 4
stat_wtx
stat_wrx
stat_ftx
stat_frx

6118 4-byte words transmitted

6061 4-byte words received
367 Frames transmitted
367 Frames received

er_bad_os 2728928202 Invalid ordered set

< Note the very rapid increase.

Changed fill word to mode 3.

FC-Switch-A:service>
FC-Switch-A:service>
FC-Switch-A:service>
FC-Switch-A:service>

portdisable 4
portcfgfillword 4 3
portenable 4
statsclear

Switch-A:service> portcfgshow
Ports of Slot 0 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
-----------------+--+--+--+--+----+--+--+--+----+--+--+--+----+--+--+-Speed
AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN
Fill Word
0 0 0 0 3 0 0 0 0 0 0 0 0 0 0 0 < Port 4 now set to mode 3
FC-Switch-A:service> portstatsshow 4
stat_wtx
stat_wrx
stat_ftx
stat_frx
er_bad_os

781 4-byte words transmitted

987 4-byte words received
44 Frames transmitted
52 Frames received
0

Invalid ordered set

mode=0 to mode=3.

< the Port 4 er_bad_os counter was stable (0) after changing fil

Resolution: To resolve this issue, change the fill word setting to mode 3 (Brocade recommended value) on
all VPLEX internal switch ports.
For a "live" system this should be planned carefully as I/O will be disrupted, as the change is
made, the switch port (in effect) bounces.
Notes
Note: VPLEX Engineering have agreed to make this internal configuration change from the
(Restricted): 5.2 code.
Note: In order to access the internal switches, use the following internal FC switches
addresses for a VPLEX Local:
FC switch A 128.221.252.34
FC switch B 128.221.253.34
Use the ssh service@128.221.252.34 command from the Management Server and use the
Service Password MI@Dim7T
If this is a VPLEX-Metro or Geo there will be Brocade switches on cluster-2 below are the IP
addresses for the cluster-2 Brocade 300Bs:
FC switch A 128.221.252.66
FC switch B 128.221.253.66

Article Metadata
Product: Connectrix - B-Series, Connectrix DS-300B, VPLEX VS1
Shared: Yes
RCA Status: Not Started
External Source: Primus
Primus/Webtop solution ID: emc295545
Originally Created By: John Colburn