Cisco Catalyst 4500 Series experiences High CPU when VMware servers are connected with redundant links.
High CPU on Catalyst 4500 due to mac address flapping
When a Ethernet frame enters the catalyst 4500 Series switch, the switch will learn the source mac address if that mac address is not there on the mac address table. In order to learn the mac address, the first frame will be sent to switch CPU. Once the mac address is learned, the remaining frames from that source mac address will be forwarded in the hardware.
If a host has multiple links to the Catalyst 4500 series switch, but these links on the switch are not bundled using port channel and the host load balances the traffic using both links with the same source mac address, the switch has to learn the mac address continuously. If the host does a per packet load balancing, the switch will learn the mac address for every frame it receives alternatively from these two ports. This will result in sending all the packets to the switch CPU. You will see High CPU on the switch because of the frames sent to the Switch CPU.
How to verify the High CPU due to mac address flapping?
The below URL will help you to identify whether the High CPU is due to mac address flapping
Switch#show mac address-table notification mac-move
MAC Move Notification:enabled
Switch# show log
%C4K_EBM-4-HOSTFLAPPING: Host 00:50:56:XX:XX:XX in vlan 28 is flapping between port Gi 2/3 and port Gi 3/3
You can connect a single virtual switch to multiple physical Ethernet adapters using the VMware Infrastructure feature called NIC teaming.
VMware’s NIC teaming allows a single virtual switch to connect to multiple physical Ethernet adapters. VMware provides the following load balancing options on the vSwitch.
Route based on the originating virtual switch port ID
Route based on source MAC hash
Route based on IP hash
Route based on the originating virtual switch port ID is the default load balancing method.When you use this setting, traffic from a given virtual Ethernet adapter is consistently sent to the same physical adapter. If the Virtual servers were using one Virtual Ethernet interface to connect to the network, you will not see the mac address flapping on the Catalyst switches. But the problem arises when the Virtual servers teaming multiple Virtual Ethernet adapters.This scenario is depicted as below
Select “Route based on IP hash” on the vSwitch. Configure Port channel on the Catalyst switches to bundle the links to the physical adapters.
Select “Route based on source MAC hash” as the load balancing method on the vSwitch. Do not configure port channel on the Cisco Catalyst Switches.
If “Route based on the originating virtual switch port ID” is used on the vSwitch, do not team the Virtual Ethernet Adapters as Active/Active on the virtual servers. You may use as Active/Standby on the Virtual Servers. Do not configure port channel on the Cisco Catalyst Switches.
Hello, I want to install RV325 to use dual wan with Bell home hub 3000, I plan to use Bell home hub 3000 like DHCP server and wifi, and use RV 325 like a switch. Bell Hub has 192.168.2.1 ip adress 192.168.2.1 I tried to install RV325, chang...
I am a networking newbie, and am attempting to assist my church with something that is far above my understanding. My experience lays more in development/programming, not so much networking.I know I need to setup vlans for some things (internet, private s...
Hi Team,I need some advice: I plan to replace the inter-vlan routing from firewall and implement it to the switch.I'm a Security Engineer and I have some skill to NetworkI have the following infra:- a stack of 3 switch of SG350- a SMB firewall that handle...
Hi,In a multi area like this where if we have a direct link from R5 to R7 and R6, we will have a shorter faster path to those routers, how should we fit it in with ospf protocol definition?I can't come up with any solution other than merging area 1 and 2?...
Hello, If I use Nexus 6ks and 5ks with 2k FEX, and SFP-10G x2 Port-channels, how should I find out how much bandwidth I am gonna lose from my links for hello intervals? and how low I can go for hello intervals for the fastest convergence? thanks...