Issue C9348GC NXOS

[saidpro2021]

Hello ,

 i have this error in my Cisco Nexus bellow : 

2024 Jan 10 16:11:49 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/29 is down (Link failure)
2024 Jan 10 16:11:49 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/27 is down (Link failure)
2024 Jan 10 16:11:56 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/29, operational speed changed to 100 Mbps
2024 Jan 10 16:11:56 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/29, operational duplex mode changed to Full
2024 Jan 10 16:11:56 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/29, operational Receive Flow Control state changed to off
2024 Jan 10 16:11:56 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/29, operational Transmit Flow Control state changed to off
2024 Jan 10 16:11:56 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/27, operational speed changed to 100 Mbps
2024 Jan 10 16:11:56 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/27, operational duplex mode changed to Full
2024 Jan 10 16:11:56 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/27, operational Receive Flow Control state changed to off
2024 Jan 10 16:11:56 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/27, operational Transmit Flow Control state changed to off
2024 Jan 10 16:11:56 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/29 is up in mode access
2024 Jan 10 16:11:56 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/27 is up in mode access
2024 Jan 10 16:12:06 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/29 is down (Link failure)
2024 Jan 10 16:12:06 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/27 is down (Link failure)
2024 Jan 10 16:12:13 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/27, operational speed changed to 100 Mbps
2024 Jan 10 16:12:13 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/27, operational duplex mode changed to Full
2024 Jan 10 16:12:13 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/27, operational Receive Flow Control state changed to off
2024 Jan 10 16:12:13 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/27, operational Transmit Flow Control state changed to off
2024 Jan 10 16:12:13 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/27 is up in mode access
2024 Jan 10 16:12:13 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/29, operational speed changed to 100 Mbps
2024 Jan 10 16:12:13 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/29, operational duplex mode changed to Full
2024 Jan 10 16:12:13 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/29, operational Receive Flow Control state changed to off
2024 Jan 10 16:12:13 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/29, operational Transmit Flow Control state changed to off
2024 Jan 10 16:12:13 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/29 is up in mode access
2024 Jan 10 16:12:16 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/46 is down (Link failure)
2024 Jan 10 16:12:17 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/45 is down (Link failure)
2024 Jan 10 16:12:23 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/46, operational speed changed to 1 Gbps
2024 Jan 10 16:12:23 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/46, operational duplex mode changed to Full
2024 Jan 10 16:12:23 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/46, operational Receive Flow Control state changed to off
2024 Jan 10 16:12:23 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/46, operational Transmit Flow Control state changed to off
2024 Jan 10 16:12:23 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/46 is up in mode access
2024 Jan 10 16:12:24 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/45, operational speed changed to 1 Gbps
2024 Jan 10 16:12:24 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/45, operational duplex mode changed to Full
2024 Jan 10 16:12:24 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/45, operational Receive Flow Control state changed to off
2024 Jan 10 16:12:24 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/45, operational Transmit Flow Control state changed to off
2024 Jan 10 16:12:24 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/45 is up in mode access
2024 Jan 10 16:12:48 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/27 is down (Link failure)
2024 Jan 10 16:12:51 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/29 is down (Link failure)
2024 Jan 10 16:12:53 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/27, operational speed changed to 1 Gbps
2024 Jan 10 16:12:53 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/27, operational duplex mode changed to Full
2024 Jan 10 16:12:53 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/27, operational Receive Flow Control state changed to off
2024 Jan 10 16:12:53 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/27, operational Transmit Flow Control state changed to off
2024 Jan 10 16:12:53 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/27 is up in mode access
2024 Jan 10 16:12:54 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/27 is down (Link failure)
2024 Jan 10 16:12:57 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/29, operational speed changed to 1 Gbps
2024 Jan 10 16:12:57 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/29, operational duplex mode changed to Full
2024 Jan 10 16:12:57 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/29, operational Receive Flow Control state changed to off
2024 Jan 10 16:12:57 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/29, operational Transmit Flow Control state changed to off
2024 Jan 10 16:12:57 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/29 is up in mode access
2024 Jan 10 16:12:57 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/29 is down (Link failure)
2024 Jan 10 16:13:00 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/27, operational speed changed to 1 Gbps
2024 Jan 10 16:13:00 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/27, operational duplex mode changed to Full
2024 Jan 10 16:13:00 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/27, operational Receive Flow Control state changed to off
2024 Jan 10 16:13:00 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/27, operational Transmit Flow Control state changed to off
2024 Jan 10 16:13:00 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/27 is up in mode access
2024 Jan 10 16:13:05 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/29, operational speed changed to 1 Gbps
2024 Jan 10 16:13:05 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/29, operational duplex mode changed to Full
2024 Jan 10 16:13:05 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/29, operational Receive Flow Control state changed to off
2024 Jan 10 16:13:05 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/29, operational Transmit Flow Control state changed to off
2024 Jan 10 16:13:05 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/29 is up in mode access
2024 Jan 10 16:14:26 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/27 is down (Link failure)
2024 Jan 10 16:14:35 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/29 is down (Link failure)
2024 Jan 10 16:15:19 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/27, operational speed changed to 1 Gbps
2024 Jan 10 16:15:19 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/27, operational duplex mode changed to Full
2024 Jan 10 16:15:19 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/27, operational Receive Flow Control state changed to off
2024 Jan 10 16:15:19 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/27, operational Transmit Flow Control state changed to off
2024 Jan 10 16:15:19 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/27 is up in mode access
2024 Jan 10 16:15:28 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/29, operational speed changed to 1 Gbps
2024 Jan 10 16:15:28 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/29, operational duplex mode changed to Full
2024 Jan 10 16:15:28 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/29, operational Receive Flow Control state changed to off
2024 Jan 10 16:15:28 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/29, operational Transmit Flow Control state changed to off
2024 Jan 10 16:15:28 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/29 is up in mode access
2024 Jan 10 16:57:33 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/29 is down (Link failure)
2024 Jan 10 16:57:50 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/29, operational speed changed to 100 Mbps
2024 Jan 10 16:57:50 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/29, operational duplex mode changed to Full
2024 Jan 10 16:57:50 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/29, operational Receive Flow Control state changed to off
2024 Jan 10 16:57:50 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/29, operational Transmit Flow Control state changed to off
2024 Jan 10 16:57:50 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/29 is up in mode access
2024 Jan 10 16:58:01 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/29 is down (Link failure)
2024 Jan 10 16:58:08 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/29, operational speed changed to 100 Mbps
2024 Jan 10 16:58:08 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/29, operational duplex mode changed to Full
2024 Jan 10 16:58:08 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/29, operational Receive Flow Control state changed to off
2024 Jan 10 16:58:08 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/29, operational Transmit Flow Control state changed to off
2024 Jan 10 16:58:08 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/29 is up in mode access
2024 Jan 10 16:58:21 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/27 is down (Link failure)
2024 Jan 10 16:58:29 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/27, operational speed changed to 100 Mbps
2024 Jan 10 16:58:29 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/27, operational duplex mode changed to Full
2024 Jan 10 16:58:29 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/27, operational Receive Flow Control state changed to off
2024 Jan 10 16:58:29 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/27, operational Transmit Flow Control state changed to off
2024 Jan 10 16:58:29 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/27 is up in mode access
2024 Jan 10 16:58:30 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/29 is down (Link failure)
2024 Jan 10 16:58:35 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/29, operational speed changed to 1 Gbps
2024 Jan 10 16:58:35 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/29, operational duplex mode changed to Full
2024 Jan 10 16:58:35 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/29, operational Receive Flow Control state changed to off
2024 Jan 10 16:58:35 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/29, operational Transmit Flow Control state changed to off
2024 Jan 10 16:58:35 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/29 is up in mode access
2024 Jan 10 16:58:37 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/29 is down (Link failure)
2024 Jan 10 16:58:42 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/27 is down (Link failure)
2024 Jan 10 16:58:42 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/29, operational speed changed to 1 Gbps
2024 Jan 10 16:58:42 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/29, operational duplex mode changed to Full
2024 Jan 10 16:58:42 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/29, operational Receive Flow Control state changed to off
2024 Jan 10 16:58:42 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/29, operational Transmit Flow Control state changed to off
2024 Jan 10 16:58:42 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/29 is up in mode access
2024 Jan 10 16:58:48 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/27, operational speed changed to 100 Mbps
2024 Jan 10 16:58:48 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/27, operational duplex mode changed to Full
2024 Jan 10 16:58:48 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/27, operational Receive Flow Control state changed to off
2024 Jan 10 16:58:48 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/27, operational Transmit Flow Control state changed to off
2024 Jan 10 16:58:48 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/27 is up in mode access
2024 Jan 10 16:59:14 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/27 is down (Link failure)
2024 Jan 10 16:59:19 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/27, operational speed changed to 1 Gbps
2024 Jan 10 16:59:19 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/27, operational duplex mode changed to Full
2024 Jan 10 16:59:19 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/27, operational Receive Flow Control state changed to off
2024 Jan 10 16:59:19 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/27, operational Transmit Flow Control state changed to off
2024 Jan 10 16:59:19 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/27 is up in mode access
2024 Jan 10 16:59:21 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/27 is down (Link failure)
2024 Jan 10 16:59:26 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/27, operational speed changed to 1 Gbps
2024 Jan 10 16:59:26 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/27, operational duplex mode changed to Full
2024 Jan 10 16:59:26 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/27, operational Receive Flow Control state changed to off
2024 Jan 10 16:59:26 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/27, operational Transmit Flow Control state changed to off
2024 Jan 10 16:59:26 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/27 is up in mode access
2024 Jan 10 16:59:58 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/29 is down (Link failure)
2024 Jan 10 17:00:38 COROPO %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/27 is down (Link failure)
2024 Jan 10 17:00:48 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/29, operational speed changed to 1 Gbps
2024 Jan 10 17:00:48 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/29, operational duplex mode changed to Full
2024 Jan 10 17:00:48 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/29, operational Receive Flow Control state changed to off
2024 Jan 10 17:00:48 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/29, operational Transmit Flow Control state changed to off
2024 Jan 10 17:00:48 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/29 is up in mode access
2024 Jan 10 17:01:26 COROPO %ETHPORT-5-SPEED: Interface Ethernet1/27, operational speed changed to 1 Gbps
2024 Jan 10 17:01:26 COROPO %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/27, operational duplex mode changed to Full
2024 Jan 10 17:01:26 COROPO %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/27, operational Receive Flow Control state changed to off
2024 Jan 10 17:01:26 COROPO %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/27, operational Transmit Flow Control state changed to off
2024 Jan 10 17:01:26 COROPO %ETHPORT-5-IF_UP: Interface Ethernet1/27 is up in mode access
2024 Jan 10 17:27:19 COROPO %VSHD-5-VSHD_SYSLOG_CONFIG_I: Configured from vty by admin on 192.168.1.30@pts/0
2024 Jan 10 17:33:37 COROPO %DAEMON-2-SYSTEM_MSG: fatal: Write failed: Broken pipe .Client is 192.168.1.30,length of packet causing error -1 120 - dcos_sshd[8861]
2024 Jan 11 01:41:52 COROPO %DAEMON-2-SYSTEM_MSG: fatal: Write failed: Broken pipe .Client is 192.168.1.30,length of packet causing error -1 120 - dcos_sshd[20868]
2024 Jan 11 04:19:09 COROPO %DAEMON-2-SYSTEM_MSG: fatal: Write failed: Broken pipe .Client is 192.168.1.30,length of packet causing error -1 68 - dcos_sshd[10045]
2024 Jan 11 12:15:54 COROPO %DAEMON-2-SYSTEM_MSG: fatal: Write failed: Broken pipe .Client is 192.168.1.30,length of packet causing error -1 68 - dcos_sshd[14400]
2024 Jan 11 17:27:19 COROPO %VSHD-5-VSHD_SYSLOG_CONFIG_I: Configured from vty by admin on 192.168.1.30@pts/0
2024 Jan 11 22:55:13 COROPO %DAEMON-2-SYSTEM_MSG: fatal: Write failed: Broken pipe .Client is 192.168.1.31,length of packet causing error -1 68 - dcos_sshd[12942]

Please can you give me somme recommandation to resolv this issue .

Thank you in advanced 

[anpetit]

Hello @saidpro2021 ,

Hope you are doing well. 
Following the logs, eth 1/27 and 1/29 are flapping. 
Maybe there is a speed issue.
As well, I would have a look at ethpm/ethpc and asic log. 
Best way to treat this might be to open a TAC case to have all necessary log to RCA properly this behavior.
Let me know if it helps.
Kind Regards,

Antoine

[saidpro2021]

for the détail i have System version: 7.0(3)I7(6) NXOS

[anpetit]

Hello @saidpro2021 ,

Thanks, but the logs you are providing are general logs and issue can be complex to troubleshoot, hence a TAC case would be the best way. 
Regarding 7.0(3)I7(6) NXOS, it's an old release. I would recommend to upgrade to newer code release.
Hope it helps. 
Kind Regards,

Antoine

[saidpro2021]

Hello ,

Thank you for reply .

In other side , the node behind the port flapping is the InfiniBand Switch .

[anpetit]

Hello @saidpro2021 , 
Yes this could come as well from the Infini Band switch, some configurations needed maybe. 
SR Tac case with logs would help to understands and troubleshoot this issue. 
Hope it helps you.
Please do not hesitate to approve as a solution to close this thread. 
Kind Regards,
Antoine

[f00z]

Looks like bad cabling to me.