Re: no snmp data on vlan (cisco 6509 with native ios)

Peter Gastinger · ‎05-12-2010

Hi guys,

We are having troubles with one of our cisco 6509 switches (with native IOS) which acts
as MPLS router. We don't get SNMP counter values anymore (at least not
all of them). We have a second identical MPLS router (same model, same
IOS image) which does not have any problems at all,
what we already did:
- reload
- os upgrade

In the following graph, you can see that we don't get any counter
values any more (red coloured text): (I am sorry for the language, but
you should be able to get the important part without german skills)
http://img405.imageshack.us/img405/5517/snmpmpls6509counters.png

MTRG graph says that this suddenly started in May 2009:
http://img190.imageshack.us/img190/8217/mrtgn.png

We already checked the changes, but we could not find anything special.

At the moment, we are out of options. We could replace the sup720, but
I am not sure if this has any effect (each 6509 switch as two sup720,
so I guess it would not be a problem).

Any other ideas? Thanks

best regards

peter

David Stanford · ‎05-12-2010

If you manually poll index value 164 do you see results??

Peter Gastinger · ‎05-12-2010

No, unfortunately not:

snmpget -v2c -c snmpsecret mpls-6509-1 IF-MIB::ifOutOctets.164
IF-MIB::ifOutOctets.164 = Counter32: 0
snmpget -v2c -c snmpsecret mpls-6509-1 IF-MIB::ifInOctets.164
IF-MIB::ifInOctets.164 = Counter32: 0

I does not matter from where and from which tool I try to poll these values. The second (working) 6509-switch is in the same network and it worked until May 2009. Then it suddenly stopped.

David Stanford · ‎05-12-2010

Can you do a walk of ifTable and make sure .164 still corresponds to the correct interface?

Peter Gastinger · ‎05-12-2010

mpls-6509-1#sh snmp mib ifmib ifindex vlan 811
Interface = Vlan811, Ifindex = 164

snmpwalk -v2c -c secret mpls-6509-1 IF-MIB::ifDescr | grep 811
IF-MIB::ifDescr.164 = STRING: Vlan811
IF-MIB::ifDescr.168 = STRING: unrouted VLAN 811
IF-MIB::ifDescr.296 = STRING: Vlan811-mpls layer

snmpwalk -v2c -c secret mpls-6509-1 IF-MIB::ifOutOctets.164
IF-MIB::ifOutOctets.164 = Counter32: 0
snmpwalk -v2c -c secret mpls-6509-1 IF-MIB::ifOutOctets.168
IF-MIB::ifOutOctets.168 = Counter32: 2450516191
snmpwalk -v2c -c secret mpls-6509-1 IF-MIB::ifOutOctets.296
IF-MIB::ifOutOctets.296 = Counter32: 0

snmpwalk -v2c -c secret mpls-6509-rhw1 IF-MIB::ifTable | grep ".164"
IF-MIB::ifIndex.164 = INTEGER: 164
IF-MIB::ifDescr.164 = STRING: Vlan811
IF-MIB::ifType.164 = INTEGER: propVirtual(53)
IF-MIB::ifMtu.164 = INTEGER: 9216
IF-MIB::ifSpeed.164 = Gauge32: 430000000
IF-MIB::ifPhysAddress.164 = STRING: 0:14:1b:f:10:0
IF-MIB::ifAdminStatus.164 = INTEGER: up(1)
IF-MIB::ifOperStatus.164 = INTEGER: up(1)
IF-MIB::ifLastChange.164 = Timeticks: (21766) 0:03:37.66
IF-MIB::ifInOctets.164 = Counter32: 0
IF-MIB::ifInUcastPkts.164 = Counter32: 0
IF-MIB::ifInNUcastPkts.164 = Counter32: 828938
IF-MIB::ifInDiscards.164 = Counter32: 0
IF-MIB::ifInErrors.164 = Counter32: 0
IF-MIB::ifInUnknownProtos.164 = Counter32: 0
IF-MIB::ifOutOctets.164 = Counter32: 0
IF-MIB::ifOutUcastPkts.164 = Counter32: 0
IF-MIB::ifOutNUcastPkts.164 = Counter32: 0
IF-MIB::ifOutDiscards.164 = Counter32: 0
IF-MIB::ifOutErrors.164 = Counter32: 0

mpls-6509-1#sh int vlan 811
Vlan811 is up, line protocol is up
Hardware is EtherSVI, address is 0014.1b0f.1000 (bia 0014.1b0f.1000)
Description: desc
Internet address is 172.20.7.34/30
MTU 9216 bytes, BW 430000 Kbit, DLY 10 usec,
     reliability 255/255, txload 4/255, rxload 3/255
Encapsulation ARPA, loopback not set
Keepalive not supported
Carrier delay is 0 msec
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:02, output 00:00:02, output hang never
Last clearing of "show interface" counters 1d00h
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 5473000 bits/sec, 1726 packets/sec
5 minute output rate 8382000 bits/sec, 1736 packets/sec
L2 Switched: ucast: 42865 pkt, 3030838 bytes - mcast: 9394 pkt, 883036 bytes
L3 in Switched: ucast: 115724758 pkt, 47064512047 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 117839759 pkt, 75707182712 bytes mcast: 0 pkt, 0 bytes
     115782031 packets input, 47067168127 bytes, 0 no buffer
     Received 9395 broadcasts (0 IP multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     117912973 packets output, 75611995847 bytes, 0 underruns
     0 output errors, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out

It is indeed the right interface, it is still there and it is transferring packets. We are just unable to get SNMP counters for ALL vlan interfaces on this switch. Every "real" interface (e.g. Gi1/46) is working as expected:

mpls-6509-1#sh snmp mib ifmib ifindex gi1/46
Interface = GigabitEthernet1/46, Ifindex = 46

snmpwalk -v2c -c secret mpls-6509-1 IF-MIB::ifOutOctets.46
IF-MIB::ifOutOctets.46 = Counter32: 2443388863

Peter Gastinger · ‎05-18-2010

any other ideas? anyone?

In your opinion, is it worth a try to change the supervisor? Because we are using a dual sup setup, it would not be that big of a deal to try the other one, but there should be at least a small chance of success :-)