Re: Cisco 1921 IPV6 issue

mgraham94 · ‎09-23-2011

Greetings...I have a Cisco 1921 with one EHWIC-D-8ESG module installed.

I have a test system where I have to use static IPV6 addresses on the connected devices, all these devices are connected to the EHWIC ports.

I can ping these devices from the router, through the EHWIC, but I cannot do a device to device ping. IPV4 ping work fine in either direction. Here is my configuration file.

Marcin Latosiewicz · ‎09-24-2011

Mike,

I'm not aware of any additional requirements to be put on L2 ports to support IPv6 (in theory there should be none exactly like for IPv4). I'm also not aware of this module not being supported with IPv6.

I assume you checked:

- for DAD failures

- ping not only between assigned addresses but also between link-local

- neigborship table on the devices.

Quite honestly I would start by sniffing traffic to see if the router is just consuming network discovery packets.

Marcin

Mark Holm · ‎09-24-2011

I'm having the same issue - IPv6 works fine from hosts on the LAN towards the internet and from hosts to the router itself, but local traffic between hosts connected to the EHWIC-8ESG-P is not working. None of my hosts can reach each other directly. I'm currently doing some investigations, but so far I have not had any luck finding a solution. I have a feeling that IPv6 packets aren't being correctly processed by the switching engine when the destination is something else than the router itself (SVI in my case). Alternatively it may be related to the handling of multicasts (my end hosts are not seeing the ICMPv6 NS messages at all), but both of these only a hunch as of now, since I have yet to find any real proof of it .

The problem exists under both 15.1(4)M1 and 15.2(1)T.

If anyone has suggestions, feel free to chime in.

Cheers,

Mark

Marcin Latosiewicz · ‎09-24-2011

Mark, Mike,

Looks like this is something symptomatic.

I think it's best to open a TAC case so we can look into this ASAP, it's either a software bug or lack of documentation (in which case it's a documentation bug).

Marcin

Mark Holm · ‎09-25-2011

Agreed. I've not been able to make any progress at all. I'll create a TAC case right away.

/Mark

Marcin Latosiewicz · ‎09-25-2011

Mark,

Can you give me the number? I'd like to spy on it ;-)

M.

Mark Holm · ‎09-25-2011

Sure - I'd like to, but my CCO login has apparently never been associated with the relevant service contracts, so I can't create the TAC case as the serial number of the router is out of the perimeter of my profile.

I'll have to get that sorted out first - hopefully I can get that done quickly.

/Mark

Marcin Latosiewicz · ‎09-26-2011

Mark,

Can you check for me "show controllers" for the interface you have IPv6 enabled?

This is a proper output, we see that the device will accept mcast addresses.

GM#show controllers e 1/0

Interface Ethernet1/0

Hardware is AMD Unknown

ADDR: 327DF38, FASTSEND: 1A2D14, MCI_INDEX: 0

DIST ROUTE ENABLED: 0

Route Cache Flag: 11

amdp2_instance=0x327EFE8, registers=0x327DEE0, ib=0x327F498

rx ring entries=32, tx ring entries=64

rxring=0x327F4E8, rxr shadow=0x327F720, rx_head=0, rx_tail=0

txring=0x327F7D8, txr shadow=0x327FC10, tx_head=0, tx_tail=21, tx_count=21

Software MAC address filter(hash:length/addr/mask/hits):

0x01: 0 3333.0000.0001 0000.0000.0000 0

0xC0: 0 0100.0ccc.cccc 0000.0000.0000 0

0xC5: 0 0180.c200.0007 0000.0000.0000 0

0xFE: 0 3333.ff03.6601 0000.0000.0000 0

0xFE: 1 3333.ff00.0001 0000.0000.0000 0

Marcin

Mark Holm · ‎09-26-2011

Hi Marcin,

It doesn't give any (useful) information:

AR1#sh controllers gigabitEthernet 0/1/2

Controller GigabitEthernet0/1/2

PHY registers :

Copper ctrl reg (reg 0 ) is : 0x1140

Copper status reg (reg 1 ) is : 0x796D

Copper ctrl reg1 (reg 16) is : 0x3360

Copper status reg1 (reg 17) is : 0xAF48

Interrupt ena reg (reg 18) is : 0x404

Copper status reg3 (reg 26) is : 0x9040

I'm still struggling to get my CCO account setup correctly, so I can create the TAC case.

/Mark

mgraham94 · ‎09-26-2011

All

Here is what I see when I run wireshark

When I ping from device 1 to device 2's IP v6 address fd00:0:20:1::4, device 1 multicast neighbor solicitation to try to resolve the MAC address of fd00:0:20:1::4, however I don’t see a neighbor advertisement sent back, so it is possible that somehow the router(with the embedded switch ports) doesn’t forward the multicast packets.

Here is a whole com log capture of the router version and the show controller port.

Console # show version
Cisco IOS Software, C1900 Software (C1900-UNIVERSALK9-M), Version 15.1(4)M1, RELEASE SOFTWARE (fc1)
ROM: System Bootstrap, Version 15.0(1r)M9, RELEASE SOFTWARE (fc1)

System returned to ROM by power-on
System restarted at 14:39:32 UTC Mon Sep 26 2011
System image file is "usbflash0:c1900-universalk9-mz.SPA.151-4.M1.bin"
Last reload type: Normal Reload

Cisco CISCO1921/K9 (revision 1.0) with 487424K/36864K bytes of memory.
Processor board ID FTX1532814H
10 Gigabit Ethernet interfaces
1 terminal line
DRAM configuration is 64 bits wide with parity disabled.
255K bytes of non-volatile configuration memory.
250864K bytes of USB Flash usbflash0 (Read/Write)

License Info:

License UDI:

-------------------------------------------------
Device# PID SN
-------------------------------------------------
*0 CISCO1921/K9 FTX1532814H

Technology Package License Information for Module:'c1900'

-----------------------------------------------------------------
Technology    Technology-package           Technology-package
              Current       Type           Next reboot
------------------------------------------------------------------
ipbase        ipbasek9      Permanent      ipbasek9
security      None          None           None
data          None          None           None

Configuration register is 0x2102

Console# show controllers gigabitEthernet 0/1/0
Controller GigabitEthernet0/1/0
EHWIC registers:
id                : 0x00000002,   rev               : 0x00000000
status            : 0x00000000,   control           : 0x0000CA00
Interrupt Event   : 0x00000000,   scratch           : 0x00000000
Fatal Error       : 0x00000000
Low level status : 0x0000080C,   Core reset control: 0x00000000
NIOS reset control: 0x00000000,   NIOS PC           : 0x00205260
FPGA registers:
Hardware/Version        : 0x0C030600, NIOS II Interrupt status: 0x00002000
NIOS II Interrupt enable: 0x00001808, NIOS II Interrupt test : 0x00000000
Host interrupt status   : 0x00000400, Host interrupt enable   : 0x00020A80
Host interrupt test     : 0x00000000, Reset control           : 0x00000000
SRAM parity error addr : 0x00000000, SRAM parity error data : 0x00000000
CMD Queue:
Read Index: 14, Write Index: 14
IRQ count:
Host to NIOS IRQs: 0, PHY IRQ: 2, Switch IRQ: 0
POE IRQ: 0, Other NIOS IRQs: 0
NIOS:
SMI read count: 2965, SMI read errors: 0
SMI write count: 4201, SMI write errors: 0
DMA Q count: 0, DMA Q Max count: 3, DMA IRQ: 336
PHY read errors: 0, Link Event errors: 0
I2C read count: 0, I2C read errors: 0
I2C write count: 0,I2C write errors: 0
I2C reset count: 0,I2C reset fail: 0
Stats IOS busy: 0, Stats data err: 0

ESWGE FPGA VERSIONS in hwic slot 1
---------------------------------------
Golden area fpga version: 00030600
Upgrade area fpga version: 00FFFFFF
IOS bundled fpga version: 00030600
Running fpga version is : 00030600
BPSM counters:
0 from invalid slot, 0 not for CPU, 0 Unknown packet, 0 Invalid output packets

GigabitEthernet0/3 is up, line protocol is up
Hardware is Backplane CN Gigabit Ethernet, address is 30e4.dbe0.b1c3 (bia 30e4.dbe0.b1c3)
MTU 9576 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
     reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full Duplex, 1Gbps, media type is internal
output flow-control is unsupported, input flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
30 second input rate 0 bits/sec, 0 packets/sec
30 second output rate 0 bits/sec, 0 packets/sec
     0 packets input, 0 bytes, 0 no buffer
     Received 0 broadcasts (0 IP multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 0 multicast, 0 pause input
     0 packets output, 0 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out
CPU port:
Statistics for slot:1, switch port:9
-----------------------------------------------------
30 second input rate 0 packets/sec
30 second output rate 0 packets/sec
0 packets input, 0 bytes, 0 overruns
Received 0 broadcasts, 0 multicast, 0 unicast
0 runts, 0 giants, 0 jabbers
0 input errors, 0 CRC, 0 fragments, 0 pause input
0 packets output, 0 bytes, 0 underruns
0 broadcast, 0 multicast, 0 unicast
0 late collisions, 0 collisions, 0 deferred
0 bad bytes received, 0 multiple, 0 pause output

Switch egress queues drop count register(READ CLEAR): 0x0
PHY registers :
Copper ctrl reg (reg 0 ) is      : 0x1140
Copper status reg (reg 1 ) is    : 0x7949
Copper ctrl reg1 (reg 16) is     : 0x3360
Copper status reg1 (reg 17) is   : 0x8010
Interrupt ena reg (reg 18) is    : 0x404
Copper status reg3 (reg 26) is   : 0x9140

Mark Holm · ‎09-26-2011

It gives more detailed info when performed on the first port (Gi0/1/0):

Controller GigabitEthernet0/1/0

EHWIC registers:

id : 0x00000002, rev : 0x00000000

status : 0x00000000, control : 0x0000CA00

Interrupt Event : 0x00000000, scratch : 0x00000000

Fatal Error : 0x00000000

Low level status : 0x00000808, Core reset control: 0x00000000

NIOS reset control: 0x00000000, NIOS PC : 0x00206E70

FPGA registers:

Hardware/Version : 0x08030600, NIOS II Interrupt status: 0x00002000

NIOS II Interrupt enable: 0x00001808, NIOS II Interrupt test : 0x00000000

Host interrupt status : 0x00000400, Host interrupt enable : 0x00020A80

Host interrupt test : 0x00000000, Reset control : 0x00000000

SRAM parity error addr : 0x00000000, SRAM parity error data : 0x00000000

CMD Queue:

Read Index: 54, Write Index: 54

IRQ count:

Host to NIOS IRQs: 0, PHY IRQ: 35, Switch IRQ: 307

POE IRQ: 0, Other NIOS IRQs: 0

NIOS:

SMI read count: 4234, SMI read errors: 0

SMI write count: 5457, SMI write errors: 0

DMA Q count: 0, DMA Q Max count: 5, DMA IRQ: 490359

PHY read errors: 0, Link Event errors: 0

I2C read count: 367531147, I2C read errors: 0

I2C write count: 17710,I2C write errors: 0

I2C reset count: 0,I2C reset fail: 0

Stats IOS busy: 0, Stats data err: 0

POE Registers Device 0

Device ID reg: 0x51 Power event reg: 0x0

Detect event reg: 0x0 Fault event reg: 0x0

Start event reg: 0x0 Supply event reg: 0x2

Port1 status reg: 0x34 Port2 status reg: 0x64

Port3 status reg: 0x1 Port4 status reg: 0x1

Power status reg: 0x33 Pin status reg: 0x1

Operating mode reg: 0xAA Disconnect enable reg: 0xF0

Timing cfg reg: 0x0 Misc cfg reg: 0xA0

Mode 3 reg: 0x0 PWR Priority reg: 0x0

ICUT p1p2 reg: 0x22 ICUT p3p4 reg: 0x22

IDC p1 LSB: 0xDC IDC p1 MSB: 0xB

VDC p1 LSB: 0xDC VDC p1 MSB: 0x22

IDC p2 LSB: 0xCE IDC p2 MSB: 0x5

VDC p2 LSB: 0xBF VDC p2 MSB: 0x22

IDC p3 LSB: 0x0 IDC p3 MSB: 0x0

VDC p3 LSB: 0xC9 VDC p3 MSB: 0x2

IDC p4 LSB: 0x0 IDC p4 MSB: 0x0

VDC p4 LSB: 0xBD VDC p4 MSB: 0x2

2X PWR reg: 0xF0

POE Registers Device 1

Device ID reg: 0x51 Power event reg: 0x0

Detect event reg: 0xF Fault event reg: 0x0

Start event reg: 0x0 Supply event reg: 0x2

Port1 status reg: 0x1 Port2 status reg: 0x1

Port3 status reg: 0x1 Port4 status reg: 0x1

Power status reg: 0x0 Pin status reg: 0x5

Operating mode reg: 0xAA Disconnect enable reg: 0xF0

Timing cfg reg: 0x0 Misc cfg reg: 0xA0

Mode 3 reg: 0x0 PWR Priority reg: 0x0

ICUT p1p2 reg: 0x22 ICUT p3p4 reg: 0x22

IDC p1 LSB: 0x0 IDC p1 MSB: 0x0

VDC p1 LSB: 0xAD VDC p1 MSB: 0x2

IDC p2 LSB: 0x0 IDC p2 MSB: 0x0

VDC p2 LSB: 0xC7 VDC p2 MSB: 0x2

IDC p3 LSB: 0x0 IDC p3 MSB: 0x0

VDC p3 LSB: 0xEA VDC p3 MSB: 0x2

IDC p4 LSB: 0x0 IDC p4 MSB: 0x0

VDC p4 LSB: 0xBB VDC p4 MSB: 0x2

2X PWR reg: 0xF0

ESWGE FPGA VERSIONS in hwic slot 1

---------------------------------------

Golden area fpga version: 00030600

Upgrade area fpga version: 00FFFFFF

IOS bundled fpga version: 00030600

Running fpga version is : 00030600

BPSM counters:

0 from invalid slot, 0 not for CPU, 0 Unknown packet, 0 Invalid output packets

GigabitEthernet0/3 is up, line protocol is up

Hardware is Backplane CN Gigabit Ethernet, address is 30e4.dbf7.4483 (bia 30e4.dbf7.4483)

MTU 9576 bytes, BW 1000000 Kbit/sec, DLY 10 usec,

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA, loopback not set

Keepalive not set

Full Duplex, 1Gbps, media type is internal

output flow-control is unsupported, input flow-control is unsupported

ARP type: ARPA, ARP Timeout 04:00:00

Last input never, output 00:00:00, output hang never

Last clearing of "show interface" counters never

Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0

Queueing strategy: fifo

Output queue: 0/40 (size/max)

30 second input rate 9000 bits/sec, 14 packets/sec

30 second output rate 146000 bits/sec, 20 packets/sec

1006065 packets input, 121351792 bytes, 0 no buffer

Received 123735 broadcasts (0 IP multicasts)

0 runts, 0 giants, 0 throttles

0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored

0 watchdog, 0 multicast, 0 pause input

2123337 packets output, 1133642405 bytes, 0 underruns

0 output errors, 0 collisions, 0 interface resets

0 unknown protocol drops

0 babbles, 0 late collision, 0 deferred

0 lost carrier, 0 no carrier, 0 pause output

0 output buffer failures, 0 output buffers swapped out

CPU port:

Statistics for slot:1, switch port:9

-----------------------------------------------------

30 second input rate 19 packets/sec

30 second output rate 13 packets/sec

2123256 packets input, 1142121993 bytes, 0 overruns

Received 2 broadcasts, 1155502 multicast, 967752 unicast

0 runts, 0 giants, 0 jabbers

0 input errors, 0 CRC, 0 fragments, 0 pause input

1005913 packets output, 125360494 bytes, 0 underruns

63387 broadcast, 60199 multicast, 882327 unicast

0 late collisions, 0 collisions, 0 deferred

0 bad bytes received, 0 multiple, 0 pause output

Switch egress queues drop count register(READ CLEAR): 0x0

PHY registers :

Copper ctrl reg (reg 0 ) is : 0x1140

Copper status reg (reg 1 ) is : 0x796D

Copper ctrl reg1 (reg 16) is : 0x3360

Copper status reg1 (reg 17) is : 0xAC48

Interrupt ena reg (reg 18) is : 0x404

Copper status reg3 (reg 26) is : 0x9040

But not sign of MAC address filters in the output...

/Mark

Marcin Latosiewicz · ‎09-26-2011

Gents,

I do not have a device in the lab with that module and the only way I can request it is via our lab folks but for that we will need a TAC case :[

I guess the problem in fact might be that router will consume L2 mcast rather then forward it out everywhere on the vlan (as Mike mentioned).

I think at this point in time it's best you open a SR.

Marcin

Mark Holm · ‎09-26-2011

I think we're on the right track - I just did a simple test:

ipv6 access-list MCAST

permit ipv6 any FF00::/8 log-input

permit ipv6 any any

int vlan20

ipv6 traffic-filter MCAST out

Sep 26 2011 21:21:44.510 CEST: %IPV6_ACL-6-ACCESSLOGDP: list MCAST/10 permitted icmpv6 200x:xxxx:xxxx:1:9477:3122:1BD2:6AEF (Vlan20 bcae.c574.94ab) -> FF02::1:FF00:14 (135/0), 150 packets

Sep 26 2011 21:22:44.510 CEST: %IPV6_ACL-6-ACCESSLOGDP: list MCAST/10 permitted icmpv6 200x:xxxx:xxxx:1:9477:3122:1BD2:6AEF (Vlan20) -> FF02::1:FF00:B (135/0), 1 packet

Sep 26 2011 21:22:44.510 CEST: %IPV6_ACL-6-ACCESSLOGDP: list MCAST/10 permitted icmpv6 200x:xxxx:xxxx:1:9477:3122:1BD2:6AEF (Vlan20 bcae.c574.94ab) -> FF02::1:FF00:B (135/0), 1 packet

(The host I'm trying to ping is at 200x:xxxx:xxxx:1::14, which maps to the FF02::1:FF00:14 multicast address)

Traffic is sent out the SVI, but magically disappears somewhere en route towards the interface.

/Mark

Marcin Latosiewicz · ‎09-27-2011

Mark,

The thing as I see it. This module is a switch module thus, mcast/broadcast/unknown unicast frames should be sent out all the ports.

Check on SVI is not really a valid test - it might depend on implmenttion. We're talking about L3 SVI and packets which sould be L2 switched (not L3).

Marcin

mgraham94 · ‎10-05-2011

Mark and Marcin

Did anyone open a TAC ticket or SR against this issue?

Mike