%SW_MATM-4-MACFLAP_NOTIF

susim · ‎09-14-2015

Hi ,

i have a vss enabled switch (6800) as uplink wi th multiple vlan

I just connected a 3650x to the 6800 using trunk , there was some vlans creted on the switch already . ( it's not same as the uplink switch )

Then connected one device to the one of the port and assigned vlan . Everything was ok . after some time i did a shut and no shut the interface where the device connected .From that moment i was getting the following flap error

%SW_MATM-4-MACFLAP_NOTIF: Host 00eb in vlan 20 is flapping between port Te1/1 and port Gi0/1

%SW_MATM-4-MACFLAP_NOTIF: Host 00e6 in vlan 20 is flapping between port Gi0/1 and port Te1/1

NOTIF: Host .fef0 in vlan 20 is flapping between port Gi0/1 and port Te1/1
W_MATM-4-MACFLAP_NOTIF: Host .00e5 in vlan 20 is flapping between port Gi0/1 and port Te1/1

Uplink switch running rstp and downlink running pvst

Thanks

InayathUlla Sharieff · ‎09-14-2015

Is the mac address constant which is flapping between the ports?

if not then could you please provide me the config of the ports connecting between the switches?

Is there only one link from 3560 to VSS or you have two links?

Is there any other way the 3560 is connecting to VSS(I mean third switch)?

HTH

Regards

Inayath

susim · ‎09-14-2015

Hi,

Is the mac address constant which is flapping between the ports?

6 mac address flapping , which is in another switch
3650 switch all port are in vlan 1 except gi0/1 assigned to vlan 20

vss
interface TenGigabitEthernet2/6/1
switchport
switchport mode trunk
storm-control multicast level 1.00
storm-control action trap
!

interface TenGigabitEthernet1/1
switchport mode trunk
sw trunk encapsulation dot 1q

Is there only one link from 3560 to VSS or you have two links?

yes

Is there any other way the 3560 is connecting to VSS(I mean third switch)?

there are multipl switches conneted layer2

Thanks

InayathUlla Sharieff · ‎09-15-2015

Is there any other way the 3560 is connecting to VSS(I mean third switch)?

there are multipl switches conneted layer2

Answer: Now you have to trace switch by switch to see if there is any STP loop. Usually the mac flap occurs due to STP loop(Exception for mac address flapping for wireless clients who are in roaming profile you expect to see the mac flap) but other than that if you are seeing it then its clear indication of loop.

ost 00eb in vlan 20 is flapping between port Te1/1 and port Gi0/1

1- Take one mac address and check with the ports g0/1 & t1/1

2- Go to the switch which is connected to g0/1 - check for this mac address?

Check for high cpu/logs- enable mac move and see if you are seeing any mac flap on this box.

3- Same followed to the device T1/1 and go on further to the port/switch were you are seeing the mac address.

REgards

Inayath

****Please do not forget to rate all usefull posts.

susim · ‎09-15-2015

Hi ,

1- Take one mac address and check with the ports g0/1 & t1/1

You mean to check mac address learning from gi0/1 and t1/1 ?

I am attaching a rough topology

InayathUlla Sharieff · ‎09-15-2015

Hi,

Yes you are right go ahead and verify the mac address via the ports and then follow the procedure to same ton th other switch and see if you are learning it in different way.

HTH

Regards

Inayath

susim · ‎09-26-2015

Hi
Actually the flap started the moment i gave sh and no sh command on the interface gi0/1

1- Take one mac address and check with the ports g0/1 & t1/1

taken from the switch where flap happens
0006.7601.fef0

Switch#sh mac address-table | in fef0
20 0006.7601.fef0 DYNAMIC Te1/1

sh mac address-table interface gi0/1
Mac Address Table
-------------------------------------------

Vlan Mac Address Type Ports
---- ----------- -------- -----
19 0006.7601.fede DYNAMIC Gi0/1
19 0006.ba41.1e00 DYNAMIC Gi0/1

i did not see any flap where the mac address '0006.7601.fede ' involved .

taken from the switch where the device is conneted
2- Go to the switch which is connected to g0/1 - check for this mac address?

sw2#sh mac address-table | in fef0
20 0006.7601.fef0 dynamic ip,ipx,assigned,other GigabitEthernet10/29

Check for high cpu/logs- enable mac move and see if you are seeing any mac flap on this box.

you mean "mac-address-table notification mac-move" ?

cpu seems to be ok , logs from the switch where flap happens

: %SW_MATM-4-MACFLAP_NOTIF: Host 0006.7601.fef0 in vlan 20 is flapping between port Gi0/1 and port Te1/1
CPU utilization for five seconds: 29%/0%; one minute: 24%; five minutes: 23%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
1 0 4 0 0.00% 0.00% 0.00% 0 Chunk Manager
2 5209 206060 25 0.00% 0.00% 0.00% 0 Load Meter
3 91 8893 10 0.00% 0.00% 0.00% 0 DHCPD Timer
4 12931546 586111 22063 6.22% 1.52% 1.23% 0 Check heaps
5 49 208 235 0.00% 0.00% 0.00% 0 Pool Manager
6 0 2 0 0.00% 0.00% 0.00% 0 Timers
7 0 2 0 0.00% 0.00% 0.00% 0 License Client N
8 2489278 17173 144953 0.00% 0.21% 0.20% 0 Licensing Auto U
9 76 3 25333 0.00% 0.00% 0.00% 0 Image License br
10 817 17920 45 0.00% 0.00% 0.00% 0 ARP Input
11 0 1 0 0.00% 0.00% 0.00% 0 CEF MIB API
12 0 1 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT
13 0 2 0 0.00% 0.00% 0.00% 0 AAA high-capacit
14 8 1 8000 0.00% 0.00% 0.00% 0 Policy Manager
15 34 5 6800 0.00% 0.00% 0.00% 0 Entity MIB API
16 0 1 0 0.00% 0.00% 0.00% 0 IFS Agent Manage
17 850 17173 49 0.00% 0.00% 0.00% 0 IPC Dynamic Cach
18 0 1 0 0.00% 0.00% 0.00% 0 IPC Zone Manager
19 2337 1005713 2 0.00% 0.00% 0.00% 0 IPC Periodic Tim
20 0 1 0 0.00% 0.00% 0.00% 0 IPC Managed Time
21 1955 1005713 1 0.00% 0.00% 0.00% 0 IPC Deferred Por
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
22 2501 68688 36 0.00% 0.00% 0.00% 0 IPC Seat Manager
23 0 1 0 0.00% 0.00% 0.00% 0 IPC Session Serv
24 0 3 0 0.00% 0.00% 0.00% 0 PrstVbl
25 0 1 0 0.00% 0.00% 0.00% 0 Crash writer
26 1262 1005668 1 0.00% 0.00% 0.00% 0 GraphIt
27 0 2 0 0.00% 0.00% 0.00% 0 SMART
28 0 2 0 0.00% 0.00% 0.00% 0 XML Proxy Client
29 0 1 0 0.00% 0.00% 0.00% 0 ARP Snoop
30 3574 1005714 3 0.00% 0.00% 0.00% 0 Dynamic ARP Insp
31 0 1 0 0.00% 0.00% 0.00% 0 Critical Bkgnd
32 107141 1119688 95 0.00% 0.01% 0.00% 0 Net Background
33 0 1 0 0.00% 0.00% 0.00% 0 IDB Work
34 18 101 178 0.00% 0.00% 0.00% 0 Logger
35 1908 1005666 1 0.00% 0.00% 0.00% 0 TTY Background
36 70513 1005717 70 0.00% 0.05% 0.01% 0 Per-Second Jobs
37 467357 17381 26888 0.00% 0.03% 0.00% 0 Per-minute Jobs
38 8 4 2000 0.00% 0.00% 0.00% 0 IF-MGR control p
39 0 16 0 0.00% 0.00% 0.00% 0 IF-MGR event pro
40 0 1 0 0.00% 0.00% 0.00% 0 Inode Table Dest
41 0 1 0 0.00% 0.00% 0.00% 0 AggMgr Process
42 0 1 0 0.00% 0.00% 0.00% 0 Transport Port A
43 53952 304209 177 0.00% 0.00% 0.00% 0 HC Counter Timer
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
44 105077 1724 60949 0.00% 0.00% 0.00% 0 SFF8472
45 8 42 190 0.00% 0.00% 0.00% 0 EEM ED Identity
46 0 83 0 0.00% 0.00% 0.00% 0 EEM ED MAT
47 26 107 242 0.00% 0.00% 0.00% 0 EEM ED ND
48 50 81 617 0.00% 0.00% 0.00% 0 USB Startup
49 36351 20271981 1 0.00% 0.01% 0.00% 0 DownWhenLooped
50 0 1 0 0.00% 0.00% 0.00% 0 HULC PBR Tcam Me
51 0 1 0 0.00% 0.00% 0.00% 0 HULC ACL Tcam Me
52 0 1 0 0.00% 0.00% 0.00% 0 Hulc Warm Upgrad
53 0 1 0 0.00% 0.00% 0.00% 0 HRPC lpip reques
54 0 2 0 0.00% 0.00% 0.00% 0 HLPIP Sync Proce
55 0 1 0 0.00% 0.00% 0.00% 0 HRPC EnergyWise
56 0 1 0 0.00% 0.00% 0.00% 0 HRPC actual powe
57 44708 4022660 11 0.00% 0.01% 0.00% 0 HUSB Console
58 0 2 0 0.00% 0.00% 0.00% 0 SM RBCP Monitor
59 0 1 0 0.00% 0.00% 0.00% 0 HULC QM Tcam Mem
60 4823 16 301437 0.00% 0.00% 0.00% 0 X2 HAMM detect p
61 100 1033 96 0.00% 0.00% 0.00% 0 Net Input
62 36354 205615 176 0.00% 0.00% 0.00% 0 Compute load avg
63 0 1 0 0.00% 0.00% 0.00% 0 Madmax Process
64 0 1 0 0.00% 0.00% 0.00% 0 HRPC asic-stats
65 24453459 11432449 2138 1.75% 2.19% 2.21% 0 RedEarth I2C dri
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
66 44641275 6879748 6488 3.67% 3.92% 4.02% 0 RedEarth Tx Mana
67 35838 5716218 6 0.00% 0.00% 0.00% 0 RedEarth Rx Mana
68 30169 206061 146 0.00% 0.00% 0.00% 0 HULC Thermal Pro
69 0 1 0 0.00% 0.00% 0.00% 0 HRPC hsm request
70 0 7 0 0.00% 0.00% 0.00% 0 Stack Mgr
71 268 11 24363 0.00% 0.00% 0.00% 0 Stack Mgr Notifi
72 8 135 59 0.00% 0.00% 0.00% 0 Adjust Regions
73 5316 1005704 5 0.00% 0.00% 0.00% 0 hrpc -> response
74 10320 205626 50 0.00% 0.00% 0.00% 0 hrpc -> request
75 8040 205636 39 0.00% 0.00% 0.00% 0 hrpc <- response
76 0 1 0 0.00% 0.00% 0.00% 0 HRPC hcomp reque
77 2421987 5028279 481 0.15% 0.27% 0.22% 0 yeti2_emac_proce
78 0 3 0 0.00% 0.00% 0.00% 0 HULC Device Mana
79 0 3 0 0.00% 0.00% 0.00% 0 HRPC hdm non blo
80 0 2 0 0.00% 0.00% 0.00% 0 HRPC hdm blockin
81 1412 205616 6 0.00% 0.00% 0.00% 0 HIPC bkgrd proce
82 0 24 0 0.00% 0.00% 0.00% 0 Hulc Port-Securi
83 0 1 0 0.00% 0.00% 0.00% 0 HRPC hpsecure re
84 0 1 0 0.00% 0.00% 0.00% 0 HRPC hfbm reques
85 394 17178 22 0.00% 0.00% 0.00% 0 DHCPD Database
86 0 1 0 0.00% 0.00% 0.00% 0 HRPC hlfm reques
87 1210685 29710601 40 1.11% 0.49% 0.30% 0 HLFM address lea
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
88 3455 1005677 3 0.00% 0.01% 0.00% 0 HLFM aging proce
89 652663 29710609 21 0.63% 0.22% 0.12% 0 HLFM address ret
90 16 8 2000 0.00% 0.00% 0.00% 0 HRPC emac reques
91 0 1 0 0.00% 0.00% 0.00% 0 HRPC hulc misc r
92 6078 343435 17 0.00% 0.00% 0.00% 0 HVLAN main bkgrd
93 0 2 0 0.00% 0.00% 0.00% 0 HVLAN Mapped Vla
94 8 2 4000 0.00% 0.00% 0.00% 0 Vlan shutdown Pr
95 0 3 0 0.00% 0.00% 0.00% 0 HRPC vlan reques
96 0 1 0 0.00% 0.00% 0.00% 0 HULC VLAN REF Ba
97 494 17174 28 0.00% 0.00% 0.00% 0 hulc_xps_process
98 0 1 0 0.00% 0.00% 0.00% 0 HRPC ilp request
99 19613 1005683 19 0.00% 0.00% 0.00% 0 Hulc ILP Alchemy
100 0 1 0 0.00% 0.00% 0.00% 0 HULC PM Vector P
101 0 1 0 0.00% 0.00% 0.00% 0 HPM Msg Retry Pr
102 4215 943 4469 0.31% 0.25% 0.18% 0 Exec
103 7342839 15889693 462 0.31% 0.95% 0.91% 0 hpm main process
104
*Mar 12 22:55:32.651: %SW_MATM-4-MACFLAP_NOTIF: Host 0006.7603.00e9 in vlan 20 is flapping between port Gi0/1 and port Te1/1 0 36 0 0.00% 0.00% 0.00% 0 HPM Stack Sync P
105 0 1 0 0.00% 0.00% 0.00% 0 HRPC pm request
106 19456863 1005675 19347 1.59% 1.67% 1.70% 0 hpm counter proc
107 0 1 0 0.00% 0.00% 0.00% 0 HRPC pm-counters
108 0 1 0 0.00% 0.00% 0.00% 0 hpm vp events ca
109 0 1 0 0.00% 0.00% 0.00% 0 HRPC hcmp reques
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
110 25 492 50 0.00% 0.00% 0.00% 0 HCEF ADJ Refresh
111 0 1 0 0.00% 0.00% 0.00% 0 HRPC hl3mm reque
112 0 1 0 0.00% 0.00% 0.00% 0 hl3md_rpfq_thrl_
113 7759 716675 10 0.00% 0.00% 0.00% 0 hl3mm
114 3792 514856 7 0.00% 0.00% 0.00% 0 hl3mm_rp
115 0 1 0 0.00% 0.00% 0.00% 0 HACL Queue Proce
116 0 1 0 0.00% 0.00% 0.00% 0 HRPC acl request
117 0 14 0 0.00% 0.00% 0.00% 0 HACL Acl Manager
118 0 1 0 0.00% 0.00% 0.00% 0 HRPC aim request
119 0 1 0 0.00% 0.00% 0.00% 0 HRPC backup inte
120 1057 3448 306 0.00% 0.00% 0.00% 0 OBFL TEMP obfl0
121 0 1 0 0.00% 0.00% 0.00% 0 HRPC cdp request
122 0 1 0 0.00% 0.00% 0.00% 0 HULC CISP Proces
123 0 1 0 0.00% 0.00% 0.00% 0 HRPC dot1x reque
124 0 3 0 0.00% 0.00% 0.00% 0 HULC DOT1X Proce
125 0 1 0 0.00% 0.00% 0.00% 0 HRPC lldp reques
126 0 2 0 0.00% 0.00% 0.00% 0 MACsec Process
127 0 1 0 0.00% 0.00% 0.00% 0 HRPC macsec requ
128 0 1 0 0.00% 0.00% 0.00% 0 HRPC system mtu
129 0 1 0 0.00% 0.00% 0.00% 0 HRPC rep request
130 0 4 0 0.00% 0.00% 0.00% 0 REP Helper Proc
131 0 1 0 0.00% 0.00% 0.00% 0 HRPC sdm request
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
132 0 1 0 0.00% 0.00%
*Mar 12 22:55:36.342: %SW_MATM-4-MACFLAP_NOTIF: Host 0006.7601.fef0 in vlan 20 is flapping between port Gi0/1 and port Te1/10.00% 0 SMI MSG Retry Pr
133 0 1 0 0.00% 0.00% 0.00% 0 HRPC Smart Insta
134 2243362 5028316 446 0.31% 0.17% 0.21% 0 Hulc Storm Contr
135 0 2 0 0.00% 0.00% 0.00% 0 HSTP Sync Proces
136 0 1 0 0.00% 0.00% 0.00% 0 HRPC stp_cli req
137 0 1 0 0.00% 0.00% 0.00% 0 HRPC stp_state_s
138 0 2 0 0.00% 0.00% 0.00% 0 S/W Bridge Proce
139 0 1 0 0.00% 0.00% 0.00% 0 HRPC hudld reque
140 0 1 0 0.00% 0.00% 0.00% 0 HRPC vqpc reques
141 0 1 0 0.00% 0.00% 0.00% 0 HRPC iec_load_ba
142 1687 1005687 1 0.00% 0.00% 0.00% 0 IEC Load balance
143 0 1 0 0.00% 0.00% 0.00% 0 HRPC l2pt qnq rp
144 0 1 0 0.00% 0.00% 0.00% 0 HRPC hled reques
145 35231905 23626061 1491 3.35% 4.90% 4.70% 0 Hulc LED Process
146 659877 754678 874 0.00% 0.07% 0.05% 0 HL3U bkgrd proce
147 0 1 0 0.00% 0.00% 0.00% 0 HRPC hl3u reques
148 3263 235700 13 0.00% 0.00% 0.00% 0 HL3U PBR bkgrd p
149 299 8607 34 0.00% 0.00% 0.00% 0 HL3U PBR n-h res
151 0 1 0 0.00% 0.00% 0.00% 0 HRPC dtp request
152 0 1 0 0.00% 0.00% 0.00% 0 HRPC show_forwar
153 0 1 0 0.00% 0.00% 0.00% 0 HRPC snmp reques
154 0 1 0 0.00% 0.00% 0.00% 0 HULC SNMP Proces
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
155 3730636 205623 18143 0.31% 0.33% 0.31% 0 HQM Stack Proces
156 341588 411228 830 0.00% 0.05% 0.01% 0 HRPC qos request
157 0 1 0 0.00% 0.00% 0.00% 0 HRPC span reques
158 0 1 0 0.00% 0.00% 0.00% 0 HRPC system post
159 0 1 0 0.00% 0.00% 0.00% 0 Hulc Reload Mana
160 0 1 0 0.00% 0.00% 0.00% 0 HRPC hrcli-event
161 460654 25509 18058 0.00% 0.00% 0.00% 0 crypto sw pk pro
162 0 2 0 0.00% 0.00% 0.00% 0 image mgr
163 0 5 0 0.00% 0.00% 0.00% 0 HL2MCM
164 9 5 1800 0.00% 0.00% 0.00% 0 HL2MCM
165 0 2 0 0.00% 0.00% 0.00% 0 AAA Server
166 0 1 0 0.00% 0.00% 0.00% 0 AAA ACCT Proc
167 0 1 0 0.00% 0.00% 0.00% 0 ACCT Periodic Pr
168 0 1 0 0.00% 0.00% 0.00% 0 AAA System Acct
169 0 1 0 0.00% 0.00% 0.00% 0 AUTH POLICY Fram
170 0 12 0 0.00% 0.00% 0.00% 0 Auth Manager
171 0 1 0 0.00% 0.00% 0.00% 0 Auth-proxy AAA B
172 25 3443 7 0.00% 0.00% 0.00% 0 IP Admin SM Proc
173 118933 103699 1146 0.00% 0.01% 0.00% 0 CDP Protocol
174 3095 68687 45 0.00% 0.00% 0.00% 0 MDFS LC Download
175 0 2 0 0.00% 0.00% 0.00% 0 ENABLE AAA
176 0 1 0 0.00% 0.00% 0.00% 0 CMD HANDLER
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
177 0 2 0 0.00% 0.00% 0.00% 0 AAA Dictionary R
178 0 5 0 0.00% 0.00% 0.00% 0 SXP CORE
179 193 8608 22 0.00% 0.00% 0.00% 0 DHCP Snooping
180 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Mgr Proces
181 0 1 0 0.00% 0.00% 0.00% 0 EAP Framework
182 0 1 0 0.00% 0.00% 0.00% 0 EAP Test
183 0 2 0 0.00% 0.00% 0.00% 0 EAPoUDP Process
184 0 3 0 0.00% 0.00% 0.00% 0 CEF switching ba
185 159 17215 9 0.00% 0.00% 0.00% 0 IP Input
186 0 1 0 0.00% 0.00% 0.00% 0 ICMP event handl
187 21551 1991912 10 0.00% 0.00% 0.00% 0 IP ARP Track
188 1339 1025542 1 0.00% 0.00% 0.00% 0 fnvRootHubPortSt
189 0 1 0 0.00% 0.00% 0.00% 0 tHUB
190 48746 10190423 4 0.00% 0.04% 0.00% 0 MDFS MFIB Proces
191 0 3 0 0.00% 0.00% 0.00% 0 ADJ resolve proc
192 0 2 0 0.00% 0.00% 0.00% 0 ADJ NSF process
193 0 1 0 0.00% 0.00% 0.00% 0 IPv6 ping proces
194 0 2 0 0.00% 0.00% 0.00% 0 KRB5 AAA
195 0 1 0 0.00% 0.00% 0.00% 0 MAB Framework
196 9 2 4500 0.00% 0.00% 0.00% 0 MKA
197 25 13 1923 0.00% 0.00% 0.00% 0 SpanTree Helper
198 0 2 0 0.00% 0.00% 0.00% 0 REP Topology cha
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
199 0 1 0 0.00% 0.00% 0.00% 0 SMI Director DB
200 0 1 0 0.00% 0.00% 0.00% 0 SMI CDP Update H
201 0 1 0 0.00% 0.00% 0.00% 0 SMI Backup Proce
202 0 2 0 0.00% 0.00% 0.00% 0 SMI IBC server p
203 0 1 0 0.00% 0.00% 0.00% 0 SMI IBC client p
204 9 2 4500

3- Same followed to the device T1/1 and go on further to the port/switch were you are seeing the mac address.

This is the uplink switch (vss) , it says the mac address from 'sw2'

VSS#sh mac address-table | in fef0
19 0006.7601.fef0 dynamic Yes 0 Te1/3/2
cpu log from vss has attached since it is long list .

Thanks