04-30-2024 07:48 AM
Hello everyone, I hope you are all well.
I came to ask for help regarding a very intriguing case.
I'm in a project that involves high convergence connections between the Cisco C9600 (with two supervisors, 2 SFP modules of 100 and 50GB and 1 module with 25GB SFPs), two nexus 9300 and two nexus and 2 slaves from the 5000 series.
When trying to create a trunk between the 9600 chassis and the Nexus 5000, the ARP appears as incomplete.
I've already validated everything, network settings, MTU, configurations of the SVI's involved and everything is fine.
The equipment can be seen via CDP but does not exchange TCP (as we say here in Brazil) "nem com reza braba"
I will leave some information about the environment
Chassi 9600:
IOS Version: 17.09.04a
sh int vlan 520 (VLAN Used for the link)
Vlan520 is up, line protocol is up , Autostate Enabled
Hardware is Ethernet SVI, address is cc36.cfae.8a05 (bia cc36.cfae.8a05)
Internet address is 192.168.110.12/24
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive not supported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:24, output 00:00:24, output hang never
Last clearing of "show interface" counters 4d01h
Input queue: 0/375/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
13914 packets input, 1472594 bytes, 0 no buffer
Received 0 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
12939 packets output, 1584806 bytes, 0 underruns
Output 0 broadcasts (0 IP multicasts)
0 output errors, 0 interface resets
0 unknown protocol drops
0 output buffer failures, 0 output buffers swapped out
--------------
sh int vlan 1 (another vlan used for the link)
Vlan1 is up, line protocol is up , Autostate Enabled
Hardware is Ethernet SVI, address is cc36.cfae.8a05 (bia cc36.cfae.8a05)
Internet address is 192.168.10.218/24
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive not supported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 4d01h, output 00:00:09, output hang never
Last clearing of "show interface" counters 3d23h
Input queue: 0/375/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 packets output, 0 bytes, 0 underruns
Output 0 broadcasts (0 IP multicasts)
0 output errors, 3 interface resets
0 unknown protocol drops
0 output buffer failures, 0 output buffers swapped out
-----------
sh cdp nei detail (CDP with N5k)
Device ID: NEXUS-5548-01.*****.local(SSI1745092K)
Entry address(es):
IP address: 192.168.10.1
Platform: N5K-C5548UP, Capabilities: Router Switch IGMP CVTA phone port
Interface: FiftyGigE5/0/5, Port ID (outgoing port): Ethernet1/20
Holdtime : 176 sec
Version :
Cisco Nexus Operating System (NX-OS) Software, Version 7.1(4)N1(1)
advertisement version: 2
Peer Source MAC: 002a.6aa8.76fb
Native VLAN: 1
Duplex: full
---------------
SW-CORE-CAMPUS-9600#sh int fi5/0/5
FiftyGigE5/0/5 is up, line protocol is up (connected)
Hardware is Fifty Gigabit Ethernet, address is 24d5.e4ae.d204 (bia 24d5.e4ae.d204)
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 10Gb/s, link type is auto, media type is SFP-10GBase-SR
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 00:00:03, output hang never
Last clearing of "show interface" counters 3d23h
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 1740000 bits/sec, 256 packets/sec
5 minute output rate 1000 bits/sec, 1 packets/sec
606721 packets input, 492376337 bytes, 0 no buffer
Received 0 broadcasts (0 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 0 multicast, 0 pause input
0 input packets with dribble condition detected
1539 packets output, 151932 bytes, 0 underruns
Output 0 broadcasts (0 multicasts)
0 output errors, 0 collisions, 1 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
-------------
SW-CORE-CAMPUS-9600#sh int status | inc connected
Hu1/0/1 connected trunk full 100G QSFP 40/100G SRBD
Hu1/0/3 connected trunk full 40G QSFP 40GE CSR-S
Hu2/0/1 connected trunk full 100G QSFP 40/100G SRBD
Hu2/0/3 connected trunk full 40G QSFP 40GE CSR-S
Fif5/0/5 connected trunk full 10G SFP-10GBase-SR
SW-CORE-CAMPUS-9600#
SW-CORE-CAMPUS-9600#sh ip int br
Interface IP-Address OK? Method Status Protocol
Vlan1 192.168.10.218 YES manual up up
Vlan520 192.168.110.12 YES NVRAM up up
--------
SW-CORE-CAMPUS-9600#sh arp
Protocol Address Age (min) Hardware Addr Type Interface
Internet 192.168.10.1 0 Incomplete ARPA
Internet 192.168.10.218 - cc36.cfae.8a05 ARPA Vlan1
Logs N5k
IOS Version: 7.1.4.N1.1
As you can see, the N5k "sees" the 9600 through ARP but not the other way around.
When I use the interface in access mode, the link is established without problems. The fault is only in TRUNK.
Has anyone experienced this or seen something similar so I can have troubleshooting information? Because I've already exhausted my possibilities hahaha
Solved! Go to Solution.
07-22-2024 06:52 AM
Hey guys!
Just to conclude the topic. After a firmware update on the 9600 the problem was resolved.
Thank you to everyone who has contributed so far.
04-30-2024 08:25 AM
Show interface status
Show spanning tree
Show etherchannel (or port channel) summary
MHM
04-30-2024 10:21 AM
Hello MHM, thanks for the response.
I can't bring you that information right now but look,
The Show Status interface I have:
SW-CORE-CAMPUS-9600#sh int status | inc connected
Hu1/0/1 connected trunk full 100G QSFP 40/100G SRBD
Hu1/0/3 connected trunk full 40G QSFP 40GE CSR-S
Hu2/0/1 connected trunk full 100G QSFP 40/100G SRBD
Hu2/0/3 connected trunk full 40G QSFP 40GE CSR-S
Fif5/0/5 connected trunk full 10G SFP-10GBase-SR
The spanning-tree show has chassis 9600 (which is currently L2) with vlans 1-3,520 as Root FWD (Cost 2000) for the N5k (which is currently the L3 of the network).
Regarding ehterchannel, I still don't have anything configured for this environment.
04-30-2024 12:26 PM
Hello,
I assume the trunk on both sides allows Vlans 1(native) and 520 ?
04-30-2024 12:31 PM
Hello, Geaorg!
Thanks for reply!
Yes, I tested with native VLAN 1 allowing 1-3,520 and also tested with native 520 on both sides.
05-01-2024 12:12 AM
this is your topolgy if I am correct ?
add to this topolgy link between SW
05-02-2024 10:11 AM
Hello MHM,
This's my topology:
05-02-2024 10:23 AM
C9600 and N5K ARP is OK
C9600 and both N9K arp incomplete?
Are N9K form vPC pair?
MHM
05-02-2024 10:39 AM
Incomplete ARP is between 9600 and N5K.
On the N5K side it learned the MAC address of the 9600 but the 9600 did not learn the MAC of the N5K, making it incomplete.
The other trunks work, but I had to enable the "VLAN tag native enable" command on the N9K for it to work. Since it's a non-production environment, I had no problem doing this, but the N5K is a production device so I couldn't do the same.
N9k do not have vPC, only the physical link.
05-02-2024 10:42 AM
in C9600
can I see
show interface trunk
show vlan brief
MHM
05-02-2024 10:38 AM
Hello,
there must be something very basic missing. Post the full running configs of both neighboring switches (with the trunks configured)...
07-22-2024 06:52 AM
Hey guys!
Just to conclude the topic. After a firmware update on the 9600 the problem was resolved.
Thank you to everyone who has contributed so far.
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide