EIGRP down (P2P)

[ohforce55]

Hi,

I had the EIGRP interface was down for about 5 hours.

I thought the outage was related with the ISP which usually happen, but they said they couldn't find any issue from their side.

I have a router that is pointing to the other router in the other site. (P2P connection)

But if I see the log on the other router, I don't see anything. I just see the log that EIGRP was down on router in my local area.

Can you please help me to find the reason why it was down?

The log on the router in the local site.

It was down at 3:16 am and came back up at 8:36am.

Jun  1 03:16:31.332 EDT: %DUAL-5-NBRCHANGE: EIGRP-IPv4 100: Neighbor 172.30.0.18 (GigabitEthernet0/1) is down: holding time expired
Jun  1 08:36:02.969 EDT: %DUAL-5-NBRCHANGE: EIGRP-IPv4 100: Neighbor 172.30.0.18 (GigabitEthernet0/1) is up: new adjacency

10.128.x.x (The local site)

10.86.x.x (The other site)

Sh ip eigrp events

127  08:36:03.307 Ignored route, dup routerid int: 10.128.22.15
128  08:36:03.233 Poison squashed: 10.86.0.0/16 reverse
129  08:36:03.233 Poison squashed: 10.86.122.0/24 reverse
130  08:36:03.223 Poison squashed: 10.86.0.0/16 reverse
131  08:36:03.223 Poison squashed: 10.86.122.0/24 reverse
132  08:36:03.197 Change queue emptied, entries: 2
133  08:36:03.197 Metric set: 10.86.0.0/16 metric(51456)
134  08:36:03.197 Update reason, delay: new if delay(Infinity)
135  08:36:03.197 Update sent, RD: 10.86.0.0/16 metric(Infinity)
136  08:36:03.197 Update reason, delay: metric chg delay(Infinity)
137  08:36:03.197 Update sent, RD: 10.86.0.0/16 metric(Infinity)
138  08:36:03.197 Route installed: 10.86.0.0/16 172.30.0.18
139  08:36:03.197 Route installing: 10.86.0.0/16 172.30.0.18
140  08:36:03.197 Find FS: 10.86.0.0/16 metric(Infinity)
141  08:36:03.197 Rcv update met/succmet: metric(51456) metric(2816)
142  08:36:03.197 Rcv update dest/nh: 10.86.0.0/16 172.30.0.18
143  08:36:03.197 Metric set: 10.86.0.0/16 metric(Infinity)
144  08:36:03.197 Metric set: 10.86.122.0/24 metric(51456)
145  08:36:03.197 Update reason, delay: new if delay(Infinity)
146  08:36:03.197 Update sent, RD: 10.86.122.0/24 metric(Infinity)
147  08:36:03.197 Update reason, delay: metric chg delay(Infinity)
148  08:36:03.197 Update sent, RD: 10.86.122.0/24 metric(Infinity)
149  08:36:03.197 Route installed: 10.86.122.0/24 172.30.0.18
150  08:36:03.197 Route installing: 10.86.122.0/24 172.30.0.18
151  08:36:03.197 Find FS: 10.86.122.0/24 metric(Infinity)
152  08:36:03.197 Rcv update met/succmet: metric(51456) metric(2816)
153  08:36:03.197 Rcv update dest/nh: 10.86.122.0/24 172.30.0.18
154  08:36:03.197 Metric set: 10.86.122.0/24 metric(Infinity)
155  08:36:03.085 Rcv peer INIT: 172.30.0.18 GigabitEthernet0/1
156  03:16:31.564 NDB delete: 10.86.0.0/16 1
157  03:16:31.564 Poison squashed: 10.86.0.0/16 rt net gone
158  03:16:31.564 RDB delete: 10.86.0.0/16 10.128.22.6
159  03:16:31.564 RDB delete: 10.86.0.0/16 172.30.0.18
160  03:16:31.564 Find FS: 10.86.0.0/16 metric(Infinity)
161  03:16:31.564 Free reply status: 10.86.0.0/16
162  03:16:31.564 Clr handle num/bits: 0 0x0
163  03:16:31.564 Clr handle dest/cnt: 10.86.0.0/16 0
164  03:16:31.564 Rcv reply met/succ met: metric(Infinity) metric(Infinity)
165  03:16:31.564 Rcv reply dest/nh: 10.86.0.0/16 10.128.22.6
166  03:16:31.564 NDB delete: 10.86.122.0/24 1
167  03:16:31.564 Poison squashed: 10.86.122.0/24 rt net gone
168  03:16:31.564 RDB delete: 10.86.122.0/24 10.128.22.6
169  03:16:31.564 RDB delete: 10.86.122.0/24 172.30.0.18
170  03:16:31.564 Find FS: 10.86.122.0/24 metric(Infinity)
171  03:16:31.564 Free reply status: 10.86.122.0/24
172  03:16:31.564 Clr handle num/bits: 0 0x0
173  03:16:31.564 Clr handle dest/cnt: 10.86.122.0/24 0
174  03:16:31.564 Rcv reply met/succ met: metric(Infinity) metric(Infinity)
175  03:16:31.564 Rcv reply dest/nh: 10.86.122.0/24 10.128.22.6
176  03:16:31.370 RDB delete: 10.86.0.0/16 172.30.0.6
177  03:16:31.370 Clr handle num/bits: 2 0x1
178  03:16:31.370 Clr handle dest/cnt: 10.86.0.0/16 1
179  03:16:31.370 Rcv reply met/succ met: metric(Infinity) metric(Infinity)
180  03:16:31.370 Rcv reply dest/nh: 10.86.0.0/16 172.30.0.6
181  03:16:31.370 RDB delete: 10.86.122.0/24 172.30.0.6
182  03:16:31.370 Clr handle num/bits: 2 0x1
183  03:16:31.370 Clr handle dest/cnt: 10.86.122.0/24 1
184  03:16:31.370 Rcv reply met/succ met: metric(Infinity) metric(Infinity)
185  03:16:31.370 Rcv reply dest/nh: 10.86.122.0/24 172.30.0.6
186  03:16:31.332 Metric set: 10.86.0.0/16 metric(Infinity)
187  03:16:31.332 Active net/peers: 10.86.0.0/16 2
188  03:16:31.332 FC not sat Dmin/met: metric(Infinity) metric(51456)
189  03:16:31.332 Find FS: 10.86.0.0/16 metric(51456)
190  03:16:31.332 Metric set: 10.86.122.0/24 metric(Infinity)
191  03:16:31.332 Active net/peers: 10.86.122.0/24 2
192  03:16:31.332 FC not sat Dmin/met: metric(Infinity) metric(51456)
193  03:16:31.332 Find FS: 10.86.122.0/24 metric(51456)
194  01:26:53.482 Poison squashed: 10.86.0.0/16 reverse
195  01:26:53.482 Poison squashed: 10.86.122.0/24 reverse
196  01:26:53.482 Poison squashed: 10.1.20.0/24 reverse
197  01:26:53.482 Poison squashed: 10.6.0.0/16 reverse
198  01:26:53.482 Poison squashed: 172.27.130.0/24 reverse
199  01:26:53.482 Poison squashed: 172.27.150.0/24 reverse
200  01:26:53.482 Poison squashed: 172.27.151.0/24 reverse
201  01:26:53.482 Poison squashed: 192.168.125.0/24 reverse
202  01:26:53.482 Poison squashed: 208.88.149.0/24 reverse
203  01:26:53.482 Poison squashed: 10.0.0.0/24 reverse
204  01:26:53.480 Metric set: 10.130.22.0/24 metric(5888)
205  01:26:53.480 Route installed: 10.130.22.0/24 10.128.22.6
206  01:26:53.480 Route installing: 10.130.22.0/24 10.128.22.6
207  01:26:53.480 RDB delete: 10.130.22.0/24 172.30.0.6
208  01:26:53.480 FC sat rdbmet/succmet: metric(5888) metric(5632)
209  01:26:53.480 FC sat nh/ndbmet: 10.128.22.6 metric(5888)
210  01:26:53.480 Find FS: 10.130.22.0/24 metric(5888)

Thank you!

[Georg Pauwen]

Hello,

what else does the log show ? Did you lose connectivity to the remote site altogether ?

Can you post your (P2P) configuration ?

[ohforce55]

Thanks for your reply!

Just the logs I posted.

Only the local router lost the connectivity and it only shows the log but the other router doesn't.

Please see the config that I replied to the other user.

[Julio E. Moisa]

Hi

I have had similar situations were the ISP does not see anything hehehe, if you have not made any change on both ends it should a problem over the link.

May I see the EIGRP configuration on both ends and of the links? Is it a dedicated link or it is passing through a MPLS network? Is there any redistribution?

[ohforce55]

Thank you for your reply!

It is p2p link not MPLS.

Here are the configs 

Local Site
!
interface GigabitEthernet0/1
description XO 50MB to Other_Ste
bandwidth 52400
ip address 172.30.0.17 255.255.255.252
duplex full
speed 100
crypto map SoToNo
!
crypto map SoToNo 10 ipsec-isakmp
set peer 172.30.0.18
set transform-set AES256
match address 115

!
router eigrp 100
network 10.128.22.0 0.0.0.255
network 172.30.0.4 0.0.0.3
network 172.30.0.16 0.0.0.3
redistribute static route-map S2EIGRP
redistribute connected route-map Connected2EIGRP
eigrp router-id 10.128.22.15
!
access-list 10 remark EIGRP Static router redist
access-list 10 permit 10.128.0.0 0.0.255.255
access-list 10 permit 192.168.22.0 0.0.0.255
access-list 10 permit 192.168.24.0 0.0.0.255
access-list 10 permit 192.168.25.0 0.0.0.255
access-list 10 permit 192.168.30.0 0.0.0.255
access-list 10 permit 192.168.31.0 0.0.0.255
access-list 10 permit 192.168.32.0 0.0.0.255
access-list 10 permit 192.168.33.0 0.0.0.255
access-list 10 permit 192.168.50.0 0.0.0.255
access-list 10 permit 192.168.51.0 0.0.0.255
access-list 10 permit 192.168.52.0 0.0.0.255
access-list 10 permit 192.168.53.0 0.0.0.255
access-list 10 permit 192.168.54.0 0.0.0.255
access-list 10 permit 192.168.55.0 0.0.0.255
access-list 10 permit 192.168.56.0 0.0.0.255
access-list 10 permit 192.168.186.0 0.0.0.255
access-list 10 permit 199.38.140.0 0.0.0.255
access-list 10 permit 172.20.10.0 0.0.0.255
access-list 10 permit any
access-list 11 remark EIGRP Connected router redist
access-list 11 permit 192.168.25.80 0.0.0.7
access-list 11 permit 10.128.20.0 0.0.0.255
access-list 115 permit ip any any
!
route-map S2EIGRP permit 10
match ip address 10
!
route-map Connected2EIGRP permit 11
match ip address 11
!

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

The other site

!
interface GigabitEthernet0/1
description XO 50MB to Local_Site
bandwidth 52400
ip address 172.30.0.18 255.255.255.252
duplex full
speed 100
crypto map SoToNo
!
!
router eigrp 100
network 172.30.0.16 0.0.0.3
redistribute connected route-map Connected2EIGRP
redistribute static route-map S2EIGRP
eigrp router-id 10.86.122.10
!

!
crypto map SoToNo 10 ipsec-isakmp
set peer 172.30.0.17
set transform-set AES256
match address 115
!

access-list 10 remark EIGRP Static router redist
access-list 10 permit 10.86.0.0 0.0.255.255
access-list 11 remark EIGRP Connected router redist
access-list 11 permit 10.86.122.0 0.0.0.255
access-list 115 permit ip any any
!
route-map Connected2EIGRP permit 11
match ip address 11
!
route-map S2EIGRP permit 10
match ip address 10
!

[Julio E. Moisa]

Thank you,

It looks fine, also I see you have a VPN, 

Could you please provide this info from both ends:

sh eigrp protocols

On the logs i saw it dup routerid int, but on the config they are different. 

[ohforce55]

Thank you!

here are sh ip protocols

Local:

*** IP Routing is NSF aware ***

Routing Protocol is "eigrp 100"
Outgoing update filter list for all interfaces is not set
Incoming update filter list for all interfaces is not set
Default networks flagged in outgoing updates
Default networks accepted from incoming updates
Redistributing: connected, static
EIGRP-IPv4 Protocol for AS(100)
Metric weight K1=1, K2=0, K3=1, K4=0, K5=0
NSF-aware route hold timer is 240
Router-ID: 10.128.22.15
Topology : 0 (base)
Active Timer: 3 min
Distance: internal 90 external 170
Maximum path: 4
Maximum hopcount 100
Maximum metric variance 1

Automatic Summarization: disabled
Maximum path: 4
Routing for Networks:
10.128.22.0/24
172.30.0.4/30
172.30.0.16/30
Routing Information Sources:
Gateway Distance Last Update
10.128.22.6 90 4d03h
172.30.0.18 90 4d03h
172.30.0.6 90 4d03h
Distance: internal 90 external 170

Other:

*** IP Routing is NSF aware ***

Routing Protocol is "eigrp 100"
Outgoing update filter list for all interfaces is not set
Incoming update filter list for all interfaces is not set
Default networks flagged in outgoing updates
Default networks accepted from incoming updates
Redistributing: connected, static
EIGRP-IPv4 Protocol for AS(100)
Metric weight K1=1, K2=0, K3=1, K4=0, K5=0
NSF-aware route hold timer is 240
Router-ID: 10.86.122.10
Topology : 0 (base)
Active Timer: 3 min
Distance: internal 90 external 170
Maximum path: 4
Maximum hopcount 100
Maximum metric variance 1

Automatic Summarization: disabled
Maximum path: 4
Routing for Networks:
172.30.0.16/30
Routing Information Sources:
Gateway Distance Last Update
172.30.0.17 90 4d03h
Distance: internal 90 external 170

[Julio E. Moisa]

Thank you so much, everything looks fine, no duplicated router-ids, was it fixed by it self? have you experienced the same situation before?

[ohforce55]

Thank you Julio!

It was fixed by itself.

No, this is the first time.

Any idea?

[Julio E. Moisa]

Did you receive any log saying interface g0/1 is down (not EIGRP message)? Could you please share the show interface g0/1 from both ends?.

Thank you in advance. 

[ohforce55]

Thanks!

I just received the logs related EIGRP nothing else..

Again, I received the logs only on the local router and nothing on the other router.

Local:

xxx#sh int g0/1
GigabitEthernet0/1 is up, line protocol is up
Hardware is iGbE, address is bc16.651f.4c81 (bia bc16.651f.4c81)
Description: XO 50MB to Other
Internet address is 172.30.0.17/30
MTU 1500 bytes, BW 52400 Kbit/sec, DLY 100 usec,
reliability 255/255, txload 4/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full Duplex, 100Mbps, media type is RJ45
output flow-control is unsupported, input flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:04, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 226495
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 131000 bits/sec, 73 packets/sec
5 minute output rate 868000 bits/sec, 100 packets/sec
1759636176 packets input, 1967249897 bytes, 0 no buffer
Received 787131 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 787130 multicast, 0 pause input
2493586639 packets output, 1144936927 bytes, 0 underruns
0 output errors, 0 collisions, 3 interface resets
525607 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
4 lost carrier, 0 no carrier, 0 pause output

Other:

xxx# sh int g0/1
GigabitEthernet0/1 is up, line protocol is up
Hardware is CN Gigabit Ethernet, address is 0006.f6fb.2721 (bia 0006.f6fb.2721)
Description: XO 50MB to Local
Internet address is 172.30.0.18/30
MTU 1500 bytes, BW 52400 Kbit/sec, DLY 100 usec,
reliability 255/255, txload 1/255, rxload 4/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full Duplex, 100Mbps, media type is RJ45
output flow-control is unsupported, input flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 184327
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 873000 bits/sec, 98 packets/sec
5 minute output rate 130000 bits/sec, 73 packets/sec
1551996531 packets input, 159149498 bytes, 184274 no buffer
Received 2 broadcasts (1999663 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 0 multicast, 0 pause input
1082724067 packets output, 2766921040 bytes, 0 underruns
0 output errors, 0 collisions, 2 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
1 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out

[Julio E. Moisa]

Hi

Thank you so much

4 lost carrier, 0 no carrier, 0 pause output

1 lost carrier, 0 no carrier, 0 pause output

My friend, everything is pointing that the problem is on the ISP side. Everything looks good on your network.  There are no input/output errors on your interfaces. 

You can clean the counters and be monitoring the interfaces.

router# clear counters g0/1

Hope it is useful

:-)

[ohforce55]

Thank you very much for your help.

Why was only one side down?

What main things do I have to look when something goes down about OSPF and BGP besides metric ?

Thanks

[Julio E. Moisa]

Hi

It could be a problem on one device on the ISP side or a misconfiguration. 

Mmm in order to verify OSPF and BGP you could execute:

show bgp ipv4 unicast all summary
show bgp neighbors <neighbor IP>

Also you can execute debug 

debug ip ospf adj
debug ip ospf packets
debug ip bgp updates
debug ip bgp events

This link could be useful

http://www.cisco.com/c/en/us/support/docs/ip/open-shortest-path-first-ospf/13699-29.html

[ohforce55]

Thank you!