ADSL interface flaps

[Juliet]

I have a customer issue with the ATM and Di1 interfaces keep flapping and when I looked at the log it says Configured from console by mypwd on vty0 

I have attached the log below:

.Apr 8 16:03:20.055 AEST: %LINK-5-CHANGED: Interface Dialer1, changed state to administratively down
.Apr 8 16:03:20.079 AEST: %LINK-5-CHANGED: Interface ATM0/2/0, changed state to administratively down
.Apr 8 16:03:21.079 AEST: %LINEPROTO-5-UPDOWN: Line protocol on Interface ATM0/2/0, changed state to down
.Apr 8 16:03:27.999 AEST: %TRACKING-5-STATE: 2 interface Di1 ip routing Up->Down
.Apr 8 16:03:28.707 AEST: %SYS-5-CONFIG_I: Configured from console by mypwd on vty0 (EEM:bounce_interface_no_shut)

I have checked the upstream provider and they do not see any issues over the link. Please help

[Mark Malone]

Hi
is there a script running (EEM:bounce_interface_no_shut) ?
it will be at the bottom of the show run config usually

can you post the EEM section please

Apr 8 16:03:28.707 AEST: %SYS-5-CONFIG_I: Configured from console by mypwd on vty0 (EEM:bounce_interface_no_shut)

[Juliet]

Hi Mark,

I could see some details under the NTP server:

ntp server 
event manager session cli username "mypwd"
event manager applet bounce_interface_shut
event track 1 state down
action 1.0 cli command "enable"
action 1.5 cli command "config t"
action 2.0 cli command "interface dialer 1"
action 2.5 cli command "shutdown"
action 3.0 cli command "interface atm 0/2/0"
action 3.5 cli command "shutdown"
action 4.0 cli command "end"
event manager applet bounce_interface_no_shut
event track 2 state down
action 1.0 cli command "enable"
action 1.5 cli command "config t"
action 2.0 cli command "interface dialer 1"
action 2.5 cli command "no shutdown"
action 3.0 cli command "interface atm 0/2/0"
action 3.5 cli command "no shutdown"
action 4.0 cli command "end"
event manager applet Router-Reload
event track 3 state down
action 1.0 cli command "enable"
action 1.5 wait 2
action 2.0 reload
action 2.5 wait 2
action 3.0 cli command ""
action 3.5 cli command "no"
!
end

[Mark Malone]

so the script is tracking something and then telling it to shut down the ADSL link , you can just remove the config or check what its tracking first

To know is it tracking, please post the command output below

show track 1

############


To remove

no event manager session cli username "mypwd"
no event manager applet bounce_interface_shut
no event manager applet bounce_interface_no_shut
no event manager applet Router-Reload

[Juliet]

Hi Mark,

I suspect that script is tracking our third-party provider NTD device.

Here are the outcome of track 1

Track 1
Interface Dialer1 ip routing
IP routing is Up
14 changes, last change 02:00:18
Delay down 30 secs
Tracked by:
EEM applet bounce_interface_shut

I haven't implemented the mentioned commands since if the carrier NTD goes down service will drop off if the tracker is to no shut the carrier NTD. Please let me know 

"

no event manager session cli username "mypwd"
no event manager applet bounce_interface_shut
no event manager applet bounce_interface_no_shut
no event manager applet Router-Reload

[Mark Malone]

its tracking routing ,is there multiple links on the router too?

you could try remove the EEM temporarily see if it stabilizes the route is being list constantly causing interface to shutdown
14 changes, last change 02:00:18

[Juliet]

Thanks,

I have removed the EEM temp

no event manager session cli username "mypwd"
no event manager applet bounce_interface_shut
no event manager applet bounce_interface_no_shut
no event manager applet Router-Reload

will monitor now

[Mark Malone]

cool let us know if it stabilizes , looking at the amount of flaps shouldn't take long to see

if it flaps again please post --- sh int ATM0/2/0 and show int dialer 1

[Juliet]

Hi Mark,

Strangely, it happened again even after I have removed the following commands.

Recent logs

.Apr 10 15:03:18.384 : %TRACKING-5-STATE: 1 interface Di1 ip routing Up->Down
.Apr 10 15:03:19.824 : %LINEPROTO-5-UPDOWN: Line protocol on Interface Virtual-Access1, changed state to up
.Apr 10 15:03:19.900 : %TRACKING-5-STATE: 1 interface Di1 ip routing Down->Up
.Apr 10 15:03:19.940 : %DUAL-5-NBRCHANGE: EIGRP-IPv4 5512: Neighbor 11.12.5.2 (Dialer1) is up: new adjacency

track 1 

Track 1
Interface Dialer1 ip routing
IP routing is Up
26 changes, last change 02:07:50
Delay down 30 secs

Regards,

Julie

[Juliet]

---

@Mark Malone wrote:
cool let us know if it stabilizes , looking at the amount of flaps shouldn't take long to see

if it flaps again please post --- sh int ATM0/2/0 and show int dialer 1

---

Track 1
Interface Dialer1 ip routing
IP routing is Up
26 changes, last change 02:07:50
Delay down 30 secs

[Mark Malone]

Hi
is the tracking still in place ? remvove it with no track
can you post the show int amt 0/2/0 and show interface dialer 1 and we will see if there are issues on the interface itself
when did this start failing ?

[Juliet]

Hi Mark,

It was up for 19 hours and it happened. I have attached the interface details

show int atm

MTU 4470 bytes, sub MTU 4470, BW 785 Kbit/sec, DLY 650 usec,
reliability 255/255, txload 1/255, rxload 5/255
Encapsulation ATM, loopback not set
Keepalive not supported
Encapsulation(s): AAL5
23 maximum active VCs, 256 VCs per VP, 1 current VCCs
VC Auto Creation Disabled.
VC idle disconnect time: 300 seconds
Last input 06:10:35, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 7056
Queueing strategy: Per VC Queueing
5 minute input rate 18000 bits/sec, 7 packets/sec
5 minute output rate 5000 bits/sec, 6 packets/sec
6779907 packets input, 1220384871 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
5514917 packets output, 1013334790 bytes, 0 underruns
0 output errors, 0 collisions, 6 interface resets
0 unknown protocol drops
0 output buffer failures, 0 output buffers swapped out
-------------------------------------------------

Show track 1

Track 1
Interface Dialer1 ip routing
IP routing is Up
26 changes, last change 06:11:04
Delay down 30 secs
------------------------------------------------------------------ logs
.Apr 10 09:41:31.749: %DUAL-5-NBRCHANGE: EIGRP-IPv4 52351: Neighbor (Dialer1) is up: new adjacency
.Apr 10 09:42:23.951 : %DUAL-5-NBRCHANGE: EIGRP-IPv4 52351: Neighbor (Dialer1) is down: holding time expired

Regards,
Julie

[Mark Malone]

ok so tracking is still in place and its tracking a route upstream , when this route islost its forcing a failover as per the config design on the router
the local atm interface is clean which is good no issues

,we need to see eactly what route its tracking

can you post - sh run | i track

[Juliet]

Hi Mark,

Tracking details:

track 1 interface Dialer1 ip routing
track 2 interface Dialer1 ip routing
track 3 interface Dialer1 ip routing

Regards,
Julie

[Mark Malone]

Hi is there static routes in place too matching these tracks

sh run | i ip route