cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
4595
Views
0
Helpful
3
Replies

delayed show command output with error code

Lukas Mazur
Level 1
Level 1

hi all,

i've got a weird behavior on one of mine ESX hosts.

when i execute a show command related to a specific module / interface the output takes some time and sometimes generates an error.

The ESX host is patched to the latest release and im running N1kv 1(2).

have a look at the commands:

a show mod indicates nothing suspicious:

N1kv# sh mod
Mod  Ports  Module-Type                      Model              Status
---  -----  -------------------------------- ------------------ ------------
1    0      Virtual Supervisor Module        Nexus1000V         active *
2    0      Virtual Supervisor Module        Nexus1000V         ha-standby
3    248    Virtual Ethernet Module          NA                 ok
4    248    Virtual Ethernet Module          NA                 ok
5    248    Virtual Ethernet Module          NA                 ok

Mod  Sw               Hw
---  ---------------  ------
1    4.0(4)SV1(2)     0.0
2    4.0(4)SV1(2)     0.0
3    4.0(4)SV1(2)     1.11
4    4.0(4)SV1(2)     1.10
5    4.0(4)SV1(2)     1.11

Mod  MAC-Address(es)                         Serial-Num
---  --------------------------------------  ----------
1    00-19-07-6c-5a-a8 to 00-19-07-6c-62-a8  NA
2    00-19-07-6c-5a-a8 to 00-19-07-6c-62-a8  NA
3    02-00-0c-00-03-00 to 02-00-0c-00-03-80  NA
4    02-00-0c-00-04-00 to 02-00-0c-00-04-80  NA
5    02-00-0c-00-05-00 to 02-00-0c-00-05-80  NA

Mod  Server-IP        Server-UUID                           Server-Name
---  ---------------  ------------------------------------  --------------------
1    172.22.210.1     NA                                    NA
2    172.22.210.1     NA                                    NA
3    172.22.210.102   3f766178-0f44-11df-1111-aaaaaaaaa05f  vie-esx2.ucs.

4    172.22.210.103   3f766178-0f44-11df-1111-aaaaaaaaa02f  vie-esxi1.ucs.

5    172.22.210.104   3f766178-0f44-11df-1111-aaaaaaaaa03f  vie-esxi2.ucs.

when i take a look at the interfaces with show int x/x for the eth / po interfaces i get an error :

N1kv# sh int po 1
Error sending opc 9004 to sap 800 on node 0x302 for ifidx 16000000 (err=0x6e)
Unable to get sf stat for port channel port-channel1
port-channel1 is up
  Hardware: Port-Channel, address: 0050.565a.bb2f (bia 0050.565a.bb2f)
  MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA
  Port mode is trunk
  full-duplex, 10 Gb/s
  Beacon is turned off
  Input flow-control is off, output flow-control is off
  Switchport monitor is off
  Members in this channel: Eth3/2
  Last clearing of "show interface" counters never
  2 interface resets

or

N1kv# sh int eth 3/2
Error sending opc 9004 to sap 800 on node 0x302 for ifidx 1a020100 (err=0x6e)
Ethernet3/2 is up
  Hardware: Ethernet, address: 0050.565a.bb2f (bia 0050.565a.bb2f)
  MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,
     reliability 0/255, txload 0/255, rxload 0/255
  Encapsulation ARPA
  Port mode is trunk
  full-duplex, 10 Gb/s
  Beacon is turned off
  Auto-Negotiation is turned off
  Input flow-control is off, output flow-control is off
  Auto-mdix is turned on
  Switchport monitor is off
  1 interface resets

it takes some time till the output is displayed (app 10-15sek).

on the veth side i have the same delay but no error message is displayed.

thats my config of the uplink port-profile

port-profile type ethernet Uplink
  vmware port-group
  switchport mode trunk
  switchport trunk native vlan 210
  switchport trunk allowed vlan all
  channel-group auto mode on mac-pinning
  no shutdown
  system vlan 210-213,215-216
  state enabled

the ESX host is accessible and traffic also passes the VEM.

i had this issue some weeks ago but a simple reboot of the host did the job - since this is the second time I'll keep the host running.

maybe we can investigate together what might cause this behavior.

BR

Lukas

3 Replies 3

nenduri
Cisco Employee
Cisco Employee

Lukas,

Can you send the output of the following command on VSM?

show svs neighbors

thanks,

Naren

hi Naren,

i experienced the issue again ... ( 2 weeks everything was ok)

here's the output of sh svs neighbors

N1kv# sh svs neighbors

Active Domain ID: 1

AIPC Interface MAC: 0050-56ab-783b
Inband Interface MAC: 0050-56ab-2c62

Src MAC           Type   Domain-id    Node-id     Last learnt (Sec. ago)
------------------------------------------------------------------------

0050-56ab-416c     VSM         1         0201     677183.33
0002-3d40-6502     VEM         1         0302     424038.86
0002-3d40-0105     VEM         1         0402     410030.50
0002-3d40-0104     VEM         1         0502     677143.50
0002-3d40-0105     VEM         1         0602     410030.50

thx lukas

Hi Lukas,

The issue is two modules (in your case it is module 6 and module 4) having the same MAC address. All the unicast messages to module 4 will fail.

This has been fixed and the fix will be available in the upcoming release. (April 2010).

N1kv# sh svs neighbors

Active Domain ID: 1

AIPC Interface MAC: 0050-56ab-783b
Inband  Interface MAC: 0050-56ab-2c62

Src MAC           Type   Domain-id     Node-id     Last learnt (Sec. ago)
------------------------------------------------------------------------

0050-56ab-416c      VSM         1         0201     677183.33
0002-3d40-6502      VEM         1         0302     424038.86
0002-3d40-0105      VEM         1         0402     410030.50
0002-3d40-0104      VEM         1         0502     677143.50
0002-3d40-0105      VEM         1         0602     410030.50

The work around is, on module 4 run the following commands:

vem stop

vem start

thanks,

Naren