C3850 - High number of events received on the port.

[mmazhar]

Good Morning,

We started having this issue on our edge switch interface where we have our primary internet circuit :

%ILPOWER-3-CONTROLLER_PORT_ERR: Controller port error, Interface Gi1/0/1: High number of events received on the port, please monitor the connected device

%ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/1: PD removed

The interface keeps flapping, on and off. 

#show int gig 1/0/1
GigabitEthernet1/0/1 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 00d6.fe9c.f781 (bia 00d6.fe9c.f781)
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 4/255, rxload 10/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 1000Mb/s, media type is 10/100/1000BaseTX
input flow-control is on, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:43, output 00:00:05, output hang never
Last clearing of "show interface" counters never
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 42782000 bits/sec, 5745 packets/sec
5 minute output rate 18158000 bits/sec, 4090 packets/sec
345131423743 packets input, 330581672796817 bytes, 0 no buffer
Received 580827547 broadcasts (618929 multicasts)
0 runts, 0 giants, 0 throttles
45 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 618929 multicast, 0 pause input
0 input packets with dribble condition detected
234755081574 packets output, 112727313003441 bytes, 0 underruns
0 output errors, 0 collisions, 4 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out

Thank you.

[Flavio Miranda]

Hi

 This message is more often seeing in a PoE connection which seems not to be your case, right ?

I would start by cheching the cable condiction with the command "test cable tdr interface Gi10/1"

and then "sh cable tdr interface Gi 1/0/1"

But also keep in mind that the message says " High number of events received on the port, please monitor the connected device"

so, check the other device also.

[mmazhar]

Hi Flavio,

Thank you for your response.

Interface Speed Local pair Pair length Remote pair Pair status
--------- ----- ---------- ------------------ ----------- --------------------
Gi1/0/1 1000M

Pair A 14 +/- 10 meters Pair B Normal
Pair B 14 +/- 10 meters Pair A Normal
Pair C 14 +/- 10 meters Pair D Normal
Pair D 14 +/- 10 meters Pair C Normal

The other device connected is the ISP circuit, I will  call them to inquire if they see or know anything.

Do you recommend/suggest anything else on my end?

Thank you.

[mmazhar]

I take it back, its not connected to the circuit. It's connected to Cisco 4000 Series router. I will inquire more about this.

[MHM Cisco World]

0 output errors, 0 collisions, 4 interface resets <<- the interface is reset 
there is 
45 input errors

show interfaces gi x/x counter errors <<- share this 

[mmazhar]

[MHM Cisco World]

3800#show platform qos queue stats gigabitEthernet x/x

[mmazhar]

[MHM Cisco World]

qos queue-softmax-multiplier 300 <<- add this and monitor the input error count ach 5 min. 

[mmazhar]

Could you please explain how you read this?

I know the Queue 0 is for control and 1 is for data.

What is that Enqeue-TH1 and Enqeue-TH2?

[MHM Cisco World]

TH0/TH1/TH2 these are the three drop threshold for queue'

If queue is full then the packet start to drop'

Some of these packet can be control packet and you face some issue in interface.

[mmazhar]

I cleared the counters after applying: 

qos queue-softmax-multiplier 300 <<- add this and monitor the input error count ach 5 min. 

After some time: The counters are normal 

GigabitEthernet1/0/1 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 00d6.fe9c.f781 (bia 00d6.fe9c.f781)
Description: OLD-Century Link 1GB INTERNET ETH100-15703695
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 4/255, rxload 12/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 1000Mb/s, media type is 10/100/1000BaseTX
input flow-control is on, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:11, output 00:00:00, output hang never
Last clearing of "show interface" counters 04:24:07
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 50449000 bits/sec, 6568 packets/sec
5 minute output rate 18173000 bits/sec, 4255 packets/sec
117007789 packets input, 105481964335 bytes, 0 no buffer
Received 274084 broadcasts (314 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 314 multicast, 0 pause input
0 input packets with dribble condition detected
88456973 packets output, 61771082815 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out

BUT

The port flapped again with the same log message:

*Apr 1 14:43:27.047 EDT: %ILPOWER-3-CONTROLLER_PORT_ERR: Controller port error, Interface Gi1/0/1: High number of events received on the port, please monitor the connected device
*Apr 1 14:43:37.051 EDT: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/1: PD removed

Anything else I could try?

[mmazhar]

[MHM Cisco World]

Hi friend 

Do

Debug ilpower powerman 

Debug ilpower event 

Share output here'

The solution is either config static power or run 2x-mode

@Leo Laohoo is better than me in PoE'

So share the debug output to suggest to you excat command need.

[Leo Laohoo]

1. What firmware is the stack on? 
2. What is the uptime of the switch?
3. Is there a PoE device (PD) connected to that port?  If the other end of Gi1/0/1 is not a PD, then disable CDP and LLDP:

interface Gi1/0/1
 no cdp run
 no lldp receive
 no lldp transmit
 power inline never
end
wr