Infra VALN on APIC and VLAN on swtich

[chart-lee]

HI, all I got a question; The infra vlan i configure on the APIC is 3967, and the ip pool is 20.0.0.0/16, however, the interface vlan on Leaf switch is 13, OMG, everything works seems OK, but i want to know the reason FABRIC-POD1-LEAF01-CHASSIS-Protocols-ARP-overlay-1 address AGE MAC ADDRESS INTERFACE PHYS INTERFACE STATUS 20.0.0.1 2016.xxx 70:E4:xxxx vlan13 eth1/1 Resolved Thank you in advance

[Tomas de Leon · Accepted solution]

The vlanID “13” is the vlan associated to the front panel port of the leaf. This vlan has a relationship to other vlans associated to that port. For example, HW Vlans, Access Enc Vlans, Fabric enc vlans, and BD Vlans. I have included an example showing the relationship of my fabric where APIC1 & APIC3 are attached to Leaf1 ports 1/1 & 1/2 and the TEP address pool is 10.0.0.0/16 with INFRA VLAN of 4094.

I hope this clears things up a bit.

Cheers

T.

== Example ==

fab1-p1-leaf1# show vlan extended

VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
13 infra:default active Eth1/1, Eth1/2

VLAN Type Vlan-mode Encap
---- ----- ---------- -------------------------------
13 enet CE vxlan-16777209, vlan-4094

fab1-p1-leaf1# vsh_lc
vsh_lc

module-1# show system internal eltmc info vlan brief
VLAN-Info
VlanId HW_VlanId Type Access_enc Access_enc Fabric_enc Fabric_enc BDVlan
Type Type
==================================================================================
13 14 BD_CTRL_VLAN 802.1q 4094 VXLAN 16777209 0

Note: BD_CTRL_VLAN: The infrastructure vlan which was configured during the APIC setup script.

fab1-p1-leaf1# show lldp neighbors
Capability codes:
(R) Router, (B) Bridge, (T) Telephone, (C) DOCSIS Cable Device
(W) WLAN Access Point, (P) Repeater, (S) Station, (O) Other
Device ID Local Intf Hold-time Capability Port ID
fab1-apic1-pod1 Eth1/1 120 eth2-1
fab1-apic3-pod1 Eth1/2 120 eth2-1

fab1-p1-leaf1# show ip interface brief vrf overlay-1
IP Interface Status for VRF "overlay-1"(4)
Interface Address Interface Status
vlan13 10.0.0.30/27 protocol-up/link-up/admin-up
lo0 10.0.32.95/32 protocol-up/link-up/admin-up
lo1 10.0.24.64/32 protocol-up/link-up/admin-up
lo1023 10.0.0.32/32 protocol-up/link-up/admin-up

APIC1:
fab1-p1-apic1# ifconfig
bond0 Link encap:Ethernet HWaddr 90:E2:BA:4B:FC:78
inet6 addr: fe80::92e2:baff:fe4b:fc78/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:122705578 errors:0 dropped:135477 overruns:0 frame:0
TX packets:128919596 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:34381651703 (32.0 GiB) TX bytes:49577366323 (46.1 GiB)

bond0.4094 Link encap:Ethernet HWaddr 90:E2:BA:4B:FC:78
inet addr:10.0.0.1 Bcast:10.0.0.1 Mask:255.255.255.255
inet6 addr: fe80::92e2:baff:fe4b:fc78/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1496 Metric:1
RX packets:115976603 errors:0 dropped:0 overruns:0 frame:0
TX packets:112122145 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:32076972482 (29.8 GiB) TX bytes:48419431499 (45.0 GiB)

eth2-1 Link encap:Ethernet HWaddr 90:E2:BA:4B:FC:78
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:120139995 errors:0 dropped:9831 overruns:0 frame:0
TX packets:126459094 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:33792443976 (31.4 GiB) TX bytes:48560648151 (45.2 GiB)

eth2-2 Link encap:Ethernet HWaddr 90:E2:BA:4B:FC:78
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:2565583 errors:0 dropped:125646 overruns:0 frame:0
TX packets:2460502 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:589207727 (561.9 MiB) TX bytes:1016718172 (969.6 MiB)

APIC3:
fab1-p1-apic3# ifconfig
bond0 Link encap:Ethernet HWaddr 90:E2:BA:5A:9F:30
inet6 addr: fe80::92e2:baff:fe5a:9f30/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:115403649 errors:0 dropped:135521 overruns:0 frame:0
TX packets:123824971 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:32270996712 (30.0 GiB) TX bytes:48941378446 (45.5 GiB)

bond0.4094 Link encap:Ethernet HWaddr 90:E2:BA:5A:9F:30
inet addr:10.0.0.3 Bcast:10.0.0.3 Mask:255.255.255.255
inet6 addr: fe80::92e2:baff:fe5a:9f30/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1496 Metric:1
RX packets:108388810 errors:0 dropped:0 overruns:0 frame:0
TX packets:107060053 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:30056239022 (27.9 GiB) TX bytes:47788292366 (44.5 GiB)

eth2-1 Link encap:Ethernet HWaddr 90:E2:BA:5A:9F:30
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:113265659 errors:0 dropped:9830 overruns:0 frame:0
TX packets:121433453 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:31743277320 (29.5 GiB) TX bytes:47906648798 (44.6 GiB)

eth2-2 Link encap:Ethernet HWaddr 90:E2:BA:5A:9F:30
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:2137996 errors:0 dropped:125691 overruns:0 frame:0
TX packets:2391522 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:527724544 (503.2 MiB) TX bytes:1034729912 (986.7 MiB)

From Leaf1:

module-1# show system internal epmc endpoint vrf overlay-1

VRF : overlay-1 ::: Context id : 4 ::: Vnid : 16777199

MAC : 90e2.ba5a.9f30 ::: Num IPs : 0
Vlan id : 13 ::: Vlan vnid : 16777209 ::: BD vnid : 16777209
VRF name : overlay-1 ::: VRF vnid : 16777199
phy if : 0x1a001000 ::: tunnel if : 0 ::: Interface : Ethernet1/2
Flags : 0x4804
Ref count : 5 ::: sclass : 0
Timestamp : 12/31/1969 19:03:22.877832
last mv timestamp 12/31/1969 19:00:00.000000 ::: ep move count : 0
last loop_detection_ts 12/31/1969 19:00:00.000000
previous if : 0 ::: loop detection count : 0
Learn Src: BCM
EP Flags : local|MAC|timer|
Aging: Timer-type : HT ::: Timeout-left : 642 ::: Hit-bit : Yes ::: Timer-reset count : 1868

PD handles:
Bcm l2 hit-bit : Yes
[L2]: Asic : NS ::: BCM : Yes
<detail> SDB Data:
mod 0 ::: port 2
::::

MAC : 90e2.ba4b.fc78 ::: Num IPs : 0
Vlan id : 13 ::: Vlan vnid : 16777209 ::: BD vnid : 16777209
VRF name : overlay-1 ::: VRF vnid : 16777199
phy if : 0x1a000000 ::: tunnel if : 0 ::: Interface : Ethernet1/1
Flags : 0x4804
Ref count : 5 ::: sclass : 0
Timestamp : 12/31/1969 19:03:20.877678
last mv timestamp 12/31/1969 19:00:00.000000 ::: ep move count : 0
last loop_detection_ts 12/31/1969 19:00:00.000000
previous if : 0 ::: loop detection count : 0
Learn Src: BCM
EP Flags : local|MAC|timer|
Aging: Timer-type : HT ::: Timeout-left : 640 ::: Hit-bit : Yes ::: Timer-reset count : 1868

PD handles:
Bcm l2 hit-bit : Yes
[L2]: Asic : NS ::: BCM : Yes
<detail> SDB Data:
mod 0 ::: port 1
::::

fab1-p1-leaf1# show ip arp

Flags: * - Adjacencies learnt on non-active FHRP router
+ - Adjacencies synced via CFSoE
# - Adjacencies Throttled for Glean
D - Static Adjacencies attached to down interface

IP ARP Table for all contexts
Total number of entries: 7
Address Age MAC Address Interface
10.0.0.1 - 90e2.ba4b.fc78 vlan13
10.0.0.3 - 90e2.ba5a.9f30 vlan13

For more information, take a look at:

Unicast Data Plane Forwarding and Reachability
http://aci-troubleshooting-book.readthedocs.io/en/latest/unicast.html

BRKACI-1002 - Introduction to ACI for Network Admins
https://www.ciscolive.com/online/connect/sessionDetail.ww?SESSION_ID=89996&tclass=popup
http://d2zmdbbm9feqrf.cloudfront.net/2016/anz/pdf/BRKACI-1002.pdf

Cisco Application Centric Infrastructure Fundamentals
http://www.cisco.com/c/en/us/td/docs/switches/datacenter/aci/apic/sw/1-x/aci-fundamentals/b_ACI-Fundamentals.html

ACI Fabric Fundamentals
http://www.cisco.com/c/en/us/td/docs/switches/datacenter/aci/apic/sw/1-x/aci-fundamentals/b_ACI-Fundamentals/b_ACI_Fundamentals_BigBook_chapter_0100.html