02-13-2015 02:09 AM - edited 03-07-2019 10:38 PM
Hi fols,
We got ASR 1002 for use as LNS and move VPDN settings from 7204 to ASR1002... Looks like PPPoE interfaces (customers works pefect) but MLP Bundle cant establish :(
Cisco Console Log:
Feb 13 05:00:13 104.234.254.1 21010: Feb 13 10:00:12.732: %CPPOSLIB-3-ERROR_NOTIFY: SIP0: cpp_cp: cpp_cp encountered an error -Traceback= 1#adfdffd320bd4b50a075756a85bafaca errmsg:7FB80973B000+121D cpp_common_os:7FB80C74C000+D8D5 cpp_common_os:7FB80C74C000+D7D4 cpp_common_os:7FB80C74C000+19A3E cpp_ifm:7FB81F747000+A158 cpp_mlppp_svr_lib:7FB815BBB000+C2F1 cpp_mlppp_svr_lib:7FB815BBB000+1CCA8 cpp_mlppp_svr_smc_lib:7FB815DF9000+2D28 cpp_common_os:7FB80C74C000+11E6E cpp_common_os:7FB80C74C000+118AA cpp_common_os:7FB80C74C000+116EB evlib:7FB80B72C0
Feb 13 05:00:13 104.234.254.1 21011: Feb 13 10:00:12.733: %FMFP-3-OBJ_DWNLD_TO_CPP_FAILED: SIP0: fman_fp_image: MLP bundle 174, link 170 download to CPP failed
Radius Log (look as well):
Fri Feb 13 04:59:41 2015 : Auth: Login OK: [username@xxxx.com] (from client asr-lns1.xxxxx.com port 3445 cli BHVLPQ1004W lag-39:53)
Fri Feb 13 04:59:41 2015 : Info: Existing IP: x.x.x.x (did cli BHVLPQ1004W lag-39:53 port 3445 user username@xxxx.com)
Fri Feb 13 05:00:12 2015 : Auth: Login OK: [username@xxxx.com] (from client asr-lns1.xxxxx.com port 3009 cli BHVLPQ1004W lag-39:53)
Fri Feb 13 05:00:12 2015 : Info: Existing IP: x.x.x.x (did cli BHVLPQ1004W lag-39:53 port 3009 user username@xxxx.com)
My Debug settings:
2# sh debug
PPPoE:
PPPoE protocol events debugging is on
PPPoE data packets debugging is on
PPPoE control packets debugging is on
PPPoE protocol errors debugging is on
MLP:
Multilink fragments debugging is on
Multilink events debugging is on
First bytes of multilink packet debugging is on
VTEMPLATE:
Virtual Template errors debugging is on
Virtual Template subinterface debugging is on
#sh log | in MLP
:01:13.742: Vi109 MLP: Dropped link Vi110 from bundle username@xxxx.com
Feb 13 10:01:13.742: Vi109 MLP: Dropped last link, removing bundle username@xxxx.com
Feb 13 10:01:13.742: Vi109 MLP: Removing bundle 'username@xxxx.com'
Feb 13 10:01:15.392: Vi111 MLP: Request add link to bundle
Feb 13 10:01:15.392: Vi111 MLP: Adding link to bundle
Feb 13 10:01:15.392: Vi111 MLP: Requested bundle vaccess creation
Feb 13 10:01:15.392: Vi111 MLP: Determine clone source for SSS
Feb 13 10:01:15.392: Vi111 MLP: Link is Virtual-Access, clone from Virtual-Template 1
Feb 13 10:01:15.395: Vi111 MLP: Determine clone source for SSS
Feb 13 10:01:15.395: Vi111 MLP: Link is Virtual-Access, clone from Virtual-Template 1
Feb 13 10:01:15.396: Vi111 MLP: SSS connect, bundle interface Vi112
Feb 13 10:01:15.396: Vi112 MLP: Changing bundle bandwidth from 100000 to 2000000
Feb 13 10:01:15.396: Vi112 MLP: Interleaving disabled
Feb 13 10:01:15.396: Vi112 MLP: Ready to finish adding link Vi111 to bundle
Feb 13 10:01:15.396: Vi111 MLP: Computed frag size 7499992 exceeds MTU, changed to 1496
Feb 13 10:01:15.396: Vi112 MLP: Update bundle bandwidth 2000000 set 2000000
Feb 13 10:01:15.396: Vi111 MLP: Change transmit status from Init to Enabled, transmit links 1
Feb 13 10:01:15.397: Vi112 MLP: Added first link Vi111 to bundle username@xxxx.com
Feb 13 10:01:15.397: Vi111 MLP: Updating bundle's PPP handle[0xCE000105] in SSS context
Feb 13 10:01:15.398: Vi112 MLP: Received segment updated message for bundle
Feb 13 10:01:15.402: %FMFP-3-OBJ_DWNLD_TO_CPP_FAILED: SIP0: fman_fp_image: MLP bundle 179, link 178 download to CPP failed
Feb 13 10:01:17.694: Vi112: MLP: Bundle has 1/2 desired links, requesting another
Feb 13 10:01:43.097: Vi111 MLP: Change transmit status from Enabled to Idle, transmit links 0
Feb 13 10:01:43.097: Vi112 MLP: No previous member for idle link in 'username@xxxx.com'
Feb 13 10:01:43.097: Vi112 MLP: Update bundle bandwidth 2000000 set 2000000
Feb 13 10:01:45.102: Vi111 MLP: Request drop link from bundle Vi112
Feb 13 10:01:45.103: Vi112 MLP: Removing link Vi111 from bundle username@xxxx.com
Feb 13 10:01:45.103: Vi111 MLP: Change transmit status from Idle to Init, transmit links 0
Feb 13 10:01:45.103: Vi112 MLP: Bundle bandwidth 2000000 unchanged
Feb 13 10:01:45.103: Vi112 MLP: Dropped link Vi111 from bundle username@xxxx.com
Feb 13 10:01:45.103: Vi112 MLP: Dropped last link, removing bundle username@xxxx.com
Feb 13 10:01:45.103: Vi112 MLP: Removing bundle 'username@xxxx.com'
2# sh ppp multilink
Virtual-Access126
Bundle name: username@xxxx.com
Remote Username: username@xxxx.com
Remote Endpoint Discriminator: [3] 4c60.de51.dd67
Local Endpoint Discriminator: [1] asr1002
Bundle up for 00:00:25, total bandwidth 2000000, load 1/255
Receive buffer limit 12192 bytes, frag timeout 1000 ms
Bundle is Distributed
Using relaxed lost fragment detection algorithm.
0/0 fragments/bytes in reassembly list
0 lost fragments, 0 reordered
0/0 discarded fragments/bytes, 0 lost received
0x0 received sequence, 0x0 sent sequence
Platform Specific Multilink PPP info
NOTE: internal keyword not applicable on this platform
Interleaving: Enabled, Fragmentation: Enabled
Member links: 1 (max 16, min 2)
BHVLPQ1004W:Vi125 (x.x.x.x), since 00:00:25, 7500000 weight, 1496 frag size, unsequenced
No inactive multilink interfaces
Border-ASR1002#sh users | in xxxxx
Vi129 username@xxxx.com PPPoVPDN never
Vi130 username@xxxx.com MLP Bundle 00:00:06
NO IP ASSIGNED and this SESSIONs will be close in 30-50 sec. Then start again by circle.
interface Virtual-Template1
ip unnumbered Loopback100
no ip redirects
no ip proxy-arp
ip mtu 1460
ip tcp adjust-mss 1420
load-interval 60
no peer default ip address
keepalive 30
ppp mru match
ppp authentication pap chap xxx-netwrok.com
ppp authorization xxx-netwrok.com
ppp accounting xxx-netwrok.com
ppp ipcp dns 8.8.8.8
ppp multilink
ppp multilink links minimum 2
ppp multilink interleave
ppp multilink endpoint string asr1002
end
interface Loopback100
ip address x.x.x.x 255.255.255.255
end
#sh ppp statistics
Type PPP Statistic TOTAL SINCE CLEARED
---- ----------------------------------------- ---------- -------------
4 Transition Packet Drop 2 2
5 Interrupt Transition Packet Drop 5 5
14 PPP Handles Allocated 16620 16620
15 PPP Handles Freed 13971 13971
16 LCP Renegotiations 17 17
17 NCP Renegotiations 3 3
18 NCP Negotiations Failed 348 348
19 PPP Encapped Interfaces 4583 4583
24 LCP Timeout+ 2892 2892
25 NCP Timeout+ 89257 89257
26 LCP Timeout- 793 793
27 NCP Timeout- 9542 9542
28 Authentication Timeout 1984 1984
29 Configure-Ack Id mismatch 9 9
30 Configure-Nak/Reject Id mismatch 21 21
Type PPP MIB Counters PEAK CURRENT
---- ----------------------------------------- ---------- -------------
1 Links at LCP Stage 13 2
2 Links at Unauthenticated Name Stage 240 0
3 Links at Authenticated Name Stage 4 0
7 Links at Local Termination Stage 2650 2647
8 MLP Links at LCP Stage 1 0
9 MLP Links at Unauthenticated Name Stage 1 0
10 MLP Links at Authenticated Name Stage 1 0
14 MLP Links at Local Termination Stage 3 0
20 Successful LCP neogtiations 14497 14497
22 Entered Authentication Stage 14497 14497
28 IPCP UP Sessions 2650 2647
48 CHAP authentication attempts 2 2
49 CHAP authentication successes 1 1
51 PAP authentication attempts 14495 14495
52 PAP authentication successes 7397 7397
53 PAP authentication failures 6141 6141
95 Total Sessions 2651 2647
96 Non-MLP Sessions 2650 2647
97 MLP Sessions 1 0
98 Total Links 2654 2649
99 Non-MLP Links 2653 2649
100 MLP Links 2 0
Type PPP Disconnect Reason TOTAL SINCE CLEARED
---- ----------------------------------------- ---------- -------------
11 Missed too many keepalives 177 177
12 PPP Renegotiating 18 18
15 LCP failed to negotiate 1694 1694
17 Received LCP TERMREQ from peer 1465 1465
18 Received LCP TERMACK from peer while OPEN 2 2
24 Removing MLP Bundle 412 412
27 MLP Kill Link 4 4
29 Lower Layer disconnected 3187 3187
37 Received disconnect from Session Manager 174 174
54 User failed PAP authentication 6141 6141
55 AAA Server did not respond 695 695
57 Authentication timeouts exceeded 2 2
If i try look show interface for two interface in bundle i see like this:
Border-ASR1002#sh int Vi24
Virtual-Access24 is up, line protocol is up
Hardware is Virtual Access interface
Interface is unnumbered. Using address of Loopback100 (x.x.x.x)
MTU 1442 bytes, BW 2000000 Kbit/sec, DLY 100000 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation PPP, LCP Open, multilink Open
REQsent: IPCP
MLP Bundle vaccess, cloned from Virtual-Template1
Vaccess status 0x44, loopback not set
Keepalive set (30 sec)
DTR is pulsed for 5 seconds on reset
Border-ASR1002#sh int Vi28
Virtual-Access28 is up, line protocol is up
Hardware is Virtual Access interface
MTU 1500 bytes, BW 2000000 Kbit/sec, DLY 100000 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation PPP, LCP Open, multilink Open
Link is a member of Multilink bundle Virtual-Access24
PPPoVPDN vaccess, cloned from Virtual-Template1
Vaccess status 0x44
Protocol l2tp, tunnel id 64648, session id 34181, loopback not set
Keepalive set (30 sec)
DTR is pulsed for 5 seconds on reset
Looks like normal. but in 30-60 sec this crashed... and sure we have not one customers with MLP... i hope we have around 20-30... so should be tonns MLP :)
Sure i lose few hours for find solutions but without luck. Nobody have exacly answer to this question.
I got abolutely working configuration from working NAS (7201 and 7204) and move it to ASR... thats what i have with MLP :((((
Can someone try help me investigate in figure our this....
I found same thread on ciscoforums where guys tell "need update ios" but someone update it and have same issue, so i hope issue not in IOS version.
Cisco IOS Software, IOS-XE Software (X86_64_LINUX_IOSD-UNIVERSAL-M), Version 15.3(2)S1, RELEASE SOFTWARE (fc1)
IOS XE Version: 03.09.01.S
System image file is "bootflash:/asr1002x-universal.03.09.01.S.153-2.S1.SPA.bin"
If you need anything else, like more debug or more info ... just ask me... i will wait there for your questions.
Thanks a lot.!
/// Update
Little bit more debug from bootflash:/tracelogs/cpp_cp_F0-0.log.7749.20150213111013
02/13 11:09:07.734 [errmsg]: (ERR): %CPPOSLIB-3-ERROR_NOTIFY: cpp_cp encountered an error -Traceback= 1#adfdffd320bd4b50a075756a85bafaca errmsg:7FB80973B000+121D cpp_common_os:7FB80C74C000+D8D5 cpp_common_os:7FB80C74C000+D7D4 cpp_common_os:7FB80C74C000+19A3E cpp_ifm:7FB81F747000+A158 cpp_mlppp_svr_lib:7FB815BBB000+C2F1 cpp_mlppp_svr_lib:7FB815BBB000+1CCA8 cpp_mlppp_svr_smc_lib:7FB815DF9000+2D28 cpp_common_os:7FB80C74C000+11E6E cpp_common_os:7FB80C74C000+118AA cpp_common_os:7FB80C74C000+116EB evlib:7FB80B72C000+B8E7 evlib:7FB80B72C000+E1B0
02/13 11:09:07.735 [buginf]: (debug):
-Traceback=1#adfdffd320bd4b50a075756a85bafaca cpp_common_os:7FB80C74C000+11445 cpp_common_os:7FB80C74C000+D7D9 cpp_common_os:7FB80C74C000+19A3E cpp_ifm:7FB81F747000+A158 cpp_mlppp_svr_lib:7FB815BBB000+C2F1 cpp_mlppp_svr_lib:7FB815BBB000+1CCA8 cpp_mlppp_svr_smc_lib:7FB815DF9000+2D28 cpp_common_os:7FB80C74C000+11E6E cpp_common_os:7FB80C74C000+118AA cpp_common_os:7FB80C74C000+116EB evlib:7FB80B72C000+B8E7 evlib:7FB80B72C000+E1B0 cpp_common_os:7FB80C74C000+13B43 :400000+6061 c:7FB7FC394000+1E514 :400000+5CC9
02/13 11:09:07.735 [cpp-mlppp]: (warn): [cpp_mlp_tx_link_create:3260] cpp_ifm_tx_chan_create_on_if failed link=1563 (retval='CPP Interface Database' detected the 'warning' condition 'IFDB detected error in API': No such file or directory)
02/13 11:09:07.735 [cpp-mlppp]: (warn): [cpp_mlp_svr_bundle_add_link_cmn:5035] cpp_mlp_tx_link_create failed link=1563 (retval='CPP Interface Database' detected the 'warning' condition 'IFDB detected error in API': No such file or directory)
02/13 11:09:41.978 [cpp-ifm]: (ERR): cpp_ifm_tx_chan_create_on_if.806: failed to find channel for parent if_h 100-'CPP Interface Database' detected the 'warning' condition 'IFDB detected error in API': No such file or directory
02/13 11:09:41.980 [errmsg]: (ERR): %CPPOSLIB-3-ERROR_NOTIFY: cpp_cp encountered an error -Traceback= 1#adfdffd320bd4b50a075756a85bafaca errmsg:7FB80973B000+121D cpp_common_os:7FB80C74C000+D8D5 cpp_common_os:7FB80C74C000+D7D4 cpp_common_os:7FB80C74C000+19A3E cpp_ifm:7FB81F747000+A158 cpp_mlppp_svr_lib:7FB815BBB000+C2F1 cpp_mlppp_svr_lib:7FB815BBB000+1CCA8 cpp_mlppp_svr_smc_lib:7FB815DF9000+2D28 cpp_common_os:7FB80C74C000+11E6E cpp_common_os:7FB80C74C000+118AA cpp_common_os:7FB80C74C000+116EB evlib:7FB80B72C000+B8E7 evlib:7FB80B72C000+E1B0
02/13 11:09:41.981 [buginf]: (debug):
-Traceback=1#adfdffd320bd4b50a075756a85bafaca cpp_common_os:7FB80C74C000+11445 cpp_common_os:7FB80C74C000+D7D9 cpp_common_os:7FB80C74C000+19A3E cpp_ifm:7FB81F747000+A158 cpp_mlppp_svr_lib:7FB815BBB000+C2F1 cpp_mlppp_svr_lib:7FB815BBB000+1CCA8 cpp_mlppp_svr_smc_lib:7FB815DF9000+2D28 cpp_common_os:7FB80C74C000+11E6E cpp_common_os:7FB80C74C000+118AA cpp_common_os:7FB80C74C000+116EB evlib:7FB80B72C000+B8E7 evlib:7FB80B72C000+E1B0 cpp_common_os:7FB80C74C000+13B43 :400000+6061 c:7FB7FC394000+1E514 :400000+5CC9
02/13 11:09:41.981 [cpp-mlppp]: (warn): [cpp_mlp_tx_link_create:3260] cpp_ifm_tx_chan_create_on_if failed link=1563 (retval='CPP Interface Database' detected the 'warning' condition 'IFDB detected error in API': No such file or directory)
02/13 11:09:41.981 [cpp-mlppp]: (warn): [cpp_mlp_svr_bundle_add_link_cmn:5035] cpp_mlp_tx_link_create failed link=1563 (retval='CPP Interface Database' detected the 'warning' condition 'IFDB detected error in API': No such file or directory)
02/13 11:10:13.049 [cpp-ifm]: (ERR): cpp_ifm_tx_chan_create_on_if.806: failed to find channel for parent if_h 100-'CPP Interface Database' detected the 'warning' condition 'IFDB detected error in API': No such file or directory
Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: