03-07-2023 10:38 AM - edited 03-07-2023 10:40 AM
Hi everyone. I have problem with enput errors on tengigabit port, and I hope some of you will be able to help me undertand the reason of that.
cisco 4500 and cisco 3560 is connected via brand new cisco SFP-10GBase-LR with singlemode 2m patchcord. There is only one laptop connected to cisco 3560X. There is no overflow..! i
showinterfaces" showing input errors. also pinging of this switch (3560) is not stable via those GIBIC connection. What can be a reason? did I miss some basic configuration ? Firmwares of both switches and service-module is up to date. other switches connected fo 4500 via Gbic doing well, but those all 4 are 1Gb uplinked, not 10Gbit.
TenGigabitEthernet1/2 is up, line protocol is up (connected)
Hardware is Ten Gigabit Ethernet, address is fc5b.3985.e0b6 (bia fc5b.3985.e0b6)
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
reliability 148/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full-duplex, 10Gb/s, link type is auto, media type is SFP-10GBase-LR
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 00:00:09, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
484923 packets input, 254472405 bytes, 0 no buffer
Received 275839 broadcasts (249466 multicasts)
0 runts, 0 giants, 0 throttles
173407 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 249466 multicast, 0 pause input
0 input packets with dribble condition detected
177258 packets output, 27866660 bytes, 0 underruns
0 output errors, 0 collisions, 1 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
Cisco-3560X_3#sh switch service-modules
Switch/Stack supports service module CPU version: 03.08.10.WAL
Temperature CPU
Switch# H/W Status (CPU/FPGA) CPU Link Version
-----------------------------------------------------------------
1 OK 56C/45C connected 03.08.10.
03-07-2023 11:16 AM
8% errorpackets
03-07-2023 11:24 AM
couple of things need to be checked --
reliability 148/255, txload 1/255, rxload 1/255 - check the reliability - this can cause many issue. SFP issue both the side need to check, also use 5meter OS2 cable and test it (LR means Long reach. so you see SFP get heated high, if you use short cables).
what is other side same output ? what you see errors ?
common input errors troubleshotting :
03-07-2023 11:58 AM
Hi, thanx for your reply.
Gbics are : SFP-10G-LR-S CISCO 10GBASE-LR SFP+ 1310NM 10KM connected with 2m pachcord.
03-07-2023 12:01 PM
personally i have seen the issue -S and normal one. (this my experience, soon i use both the side -S or or just LR both the side works as expected)
make sure both the side either use -S or LR (you can not mix and it did not worked for me as i mentioned with my testings)
03-07-2023 11:34 AM
here are logs from 4500x site:
TenGigabitEthernet1/9 is up, line protocol is up (connected)
Hardware is Ten Gigabit Ethernet Port, address is 885a.92cd.8830 (bia 885a.92cd.8830)
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 10Gb/s, link type is auto, media type is 10GBase-LR
input flow-control is on, output flow-control is on
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:15, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 4000 bits/sec, 4 packets/sec
5 minute output rate 8000 bits/sec, 7 packets/sec
235847 packets input, 37249787 bytes, 0 no buffer
Received 68890 broadcasts (63296 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 input packets with dribble condition detected
1028134 packets output, 373400102 bytes, 0 underruns
0 output errors, 0 collisions, 3 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier
0 output buffer failures, 0 output buffers swapped out
03-07-2023 11:43 AM
we do not see any issue on Cat 4K side,
Hope both the side cisco SFP ?
change the patch cable and check ?
reset SFP and reboot 3560 and test ?
can you post show run config on the port, check any duplex or other configuration applied ?
show controller x/x (from both the side )
03-07-2023 12:15 PM
BOTH SFP are original brand new cisco (as wrote in intro)
SFP-10G-LR-S CISCO 10GBASE-LR SFP+ 1310NM 10KM
Patchcable were replaced. It also have same issue when 3metters MULTIOMODE patchcord connected
singlemode patchcord and multimode patchcorde hve the same result. Currently is correct singlemode patchcord applied.
Pinging switch via TE1/2:
Cisco-3560X_3#show running-config interface tenGigabitEthernet 1/2
Building configuration...
Current configuration : 124 bytes
!
interface TenGigabitEthernet1/2
switchport trunk encapsulation dot1q
switchport mode trunk
flowcontrol receive on
end
"check any duplex or other configuration applied ? " - all is default.
Transmit TenGigabitEthernet1/2 Receive
48060753 Bytes 263597086 Bytes
343244 Unicast frames 245003 Unicast frames
47021 Multicast frames 254256 Multicast frames
4546 Broadcast frames 27062 Broadcast frames
0 Too old frames 241653130 Unicast bytes
0 Deferred frames 19189260 Multicast bytes
0 MTU exceeded frames 2754696 Broadcast bytes
0 1 collision frames 0 Alignment errors
0 2 collision frames 183840 FCS errors
0 3 collision frames 0 Oversize frames
0 4 collision frames 0 Undersize frames
0 5 collision frames 0 Collision fragments
0 6 collision frames
0 7 collision frames 189708 Minimum size frames
0 8 collision frames 143834 65 to 127 byte frames
0 9 collision frames 16149 128 to 255 byte frames
0 10 collision frames 7576 256 to 511 byte frames
0 11 collision frames 8734 512 to 1023 byte frames
0 12 collision frames 160320 1024 to 1518 byte frames
0 13 collision frames 0 Overrun frames
0 14 collision frames 0 Pause frames
0 15 collision frames
0 Excessive collisions 0 Symbol error frames
0 Late collisions 0 Invalid frames, too large
0 VLAN discard frames 0 Valid frames, too large
0 Excess defer frames 0 Invalid frames, too small
98264 64 byte frames 0 Valid frames, too small
249444 127 byte frames
18555 255 byte frames 0 Too old frames
15045 511 byte frames 0 Valid oversize frames
6132 1023 byte frames 0 System FCS error frames
7371 1518 byte frames 0 RxPortFifoFull drop frame
0 Too large frames
0 Good (1 coll) frames
0 Good (>1 coll) frames
ASIC Rxbiterr Rxunder Fwdctfix Txbuflos Rxbufloc Rxbufdrain
-------------------------------------------------------------------------
ASIC0 0 0 0 0 0 0
ASIC1 0 0 0 0 0 0
ASIC2 0 0 0 0 0 0
03-07-2023 12:24 PM
Just give clarity is the both side SFP ? SFP-10G-LR-S or one side SFP-10G-LR and another side SFP-10G-LR-S ?
3metters MULTIOMODE patchcord connected behavior is the same - are you sure ? OM4 cable worked ?
for testing default the interface make Layer 3 P2P and check with pings ? (since we are not sure where is your Layer 3 interface here.)
Remove the patch cable :
default interface TenGigabitEthernet1/2 (other side also)
interface TenGigabitEthernet1/2
no switchport
ip address x.x.x.x 255.255.255.252
no shutdown
from switch to switch ping x.x.x.x and post the results to identify the issue ?
03-07-2023 12:43 PM - edited 03-07-2023 12:51 PM
are you sure ? OM4 cable worked ? - YES! orange cable multimode working same as new one yellow single mode. behavior was the SAME!
can you guys tell me what exactly it means: reliability 148/255
Cisco-3560X_3#sh inv
NAME: "1", DESCR: "WS-C3560X-48P"
PID: WS-C3560X-48P-E , VID: V06 , SN: FDO1834Z27R
NAME: "Power Supply 1", DESCR: "FRU Power Supply"
PID: C3KX-PWR-1100WAC , VID: V02L , SN: LIT18400DGF
NAME: "FRULink Slot 1 - FRULink Module", DESCR: "FRULink 10G SM Module"
PID: C3KX-SM-10G , VID: V01 , SN: FDO1705M0DN
NAME: "TenGigabitEthernet1/2", DESCR: "SFP-10GBase-LR"
PID: SFP-10G-LR-S , VID: V01 , SN: FNS19450MYC
NAME: "Switch System", DESCR: "Cisco Systems, Inc. WS-C4500X-16 2 slot switch " PID: , VID: , SN: JAE17450FA4 NAME: "Supervisor(slot 1)", DESCR: "4500X-16 10GE (SFP+)" PID: WS-C4500X-16 , VID: V02 , SN: JAE17450FA4 NAME: "TenGigabitEthernet1/1", DESCR: "1000BaseSX" PID: GLC-SX-MMD , VID: V01 , SN: OPM22410Z94 NAME: "TenGigabitEthernet1/5", DESCR: "1000BaseLH" PID: GLC-LH-SMD , VID: V01 , SN: OPM2232152Y NAME: "TenGigabitEthernet1/7", DESCR: "1000BaseLH" PID: Unspecified , VID: , SN: CIB131211207 NAME: "TenGigabitEthernet1/9", DESCR: "SFP-10Gbase-LR" PID: SFP-10G-LR-S , VID: V01 , SN: FNS19510289
as you can see, both SFPs are THE SAME, but error packets exist all the time. Both ports - on 4500 and 3560x were set to default now. but still problem exist.
Is there some basic configuration needed for SERVICEMODULE with SFP 10G ? i dont think so.., but iam beginer
03-07-2023 01:48 PM
yes we can see both have the same SFP module: I was suspecting maybe some bug on the 3560 side (this is a guess) - never seen this issue even though you mentioned replacing the cable.
what Logs do you see on both devices?
you have not shared the outcome after default the interface and configured layer3 interface and ping outcome - that is important here to understand here.
also, post below output from both devices.
#show idprom interface tenGigabitEthernet x/x
Also, check module information - see anything we missing here : ( also make sure IOS and module are up to date - you mentioned they are up to date, but not provided show version of switch 3560)
03-07-2023 06:03 PM
@Wooldorf wrote:reliability 148/255
Layer 1 issue.
Start by replacing the optics and the patch cords at both sides.
03-08-2023 03:22 AM
I have replaced GBIcs with another pair, and everything is ok now.
Thanx all of you guys ,aspecially to balaji.bandi and Leo Laohoo
03-08-2023 03:25 AM
glad all good and our suggestion make you to fix the issue and can we mark as resolved
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide