ASR9000v with gigabit ICL

jerome.gomez · ‎09-24-2015

Hi,

i have a lab with an ASR9006 and 2 ASR9000v (find below part list).

Both Satellites work well on 10G bundle ICL (find below configuation). So they are up to date regarding the 9006 (IOS XR 5.3.1)

When i try to use one of them with Giga ICL (support confirmed by Cisco) i have a strange behavior. Is there something special for Gig ICL wich i forgot ?

Port on Sat is coming up

LC:Satellite# sh int ten 1/46
TenGigabitEthernet1/46 is up, line protocol is up

but not on ASR 9006

RP/0/RSP0/CPU0:ios#sh int gig 0/2/0/0
Thu Sep 24 01:57:38.021 UTC
GigabitEthernet0/2/0/0 is up, line protocol is down

so bundle don't come up

Bundle-Ether200
Status: Down

as a consequence sat discovery is stalled

RP/0/RSP0/CPU0:ios#sh nv satellite status
Thu Sep 24 01:54:29.668 UTC
Satellite 100
-------------
Status: Connected (Stable)
Type: asr9000v2
Description: test 1
MAC address: removed
IPv4 address: 192.168.0.100 (VRF: default)
Serial Number: removed
Remote version: Compatible (latest version)
    ROMMON: 127.1 (Latest)
    FPGA: 1.13 (Latest)
    IOS: 531.101 (Latest)
Configured satellite fabric links:
    Bundle-Ether100
    ---------------
      Status: Satellite Ready
      Remote ports: GigabitEthernet0/0/0-43
      Discovered satellite fabric links:
        TenGigE0/1/0/1: Satellite Ready; No conflict

Satellite 200
-------------
Status: Discovery Stalled; Conflict: interface is down
Type: asr9000v2
Description: test 2
IPv4 address: 192.168.0.200 (VRF: default)
Configured satellite fabric links:
    Bundle-Ether200
    ---------------
      Status: Discovery Stalled; Conflict: interface is down
      Remote ports: GigabitEthernet0/0/0-43
      Discovered satellite fabric links:
        GigabitEthernet0/2/0/0: Discovery Stalled; interface is down
RP/0/RSP0/CPU0:ios#

note : i tried several changes without improvment

patchcord
SFPs
Ports and cards on ASR 9006
ICL port on Sat (from 45 to 48 even if 47 and 48 are not supported for Gig ICL)
Sat
remove bundle config to use a single link

Thanks for your help :)

appendices

sh inventory extract

Thu Sep 24 02:15:13.030 UTC
NAME: "module 0/RSP0/CPU0", DESCR: "ASR9K Route Switch Processor with 440G/slot Fabric and 12GB"
NAME: "module 0/RSP1/CPU0", DESCR: "ASR9K Route Switch Processor with 440G/slot Fabric and 12GB"
NAME: "module 0/0/CPU0", DESCR: "80G Modular Linecard, Service Edge Optimized"
NAME: "module 0/0/0", DESCR: "ASR 9000 20-port 1GE Modular Port Adapter"
NAME: "module 0/1/CPU0", DESCR: "80G Modular Linecard, Packet Transport Optimized"
NAME: "module 0/1/0", DESCR: "ASR 9000 4-port 10GE Modular Port Adapter"
NAME: "module mau 0/1/0/0", DESCR: "Multirate 10GBASE-LR and OC-192/STM-64 SR-1 XFP, SMF"
NAME: "module mau 0/1/0/1", DESCR: "Multirate 10GBASE-LR and OC-192/STM-64 SR-1 XFP, SMF"
NAME: "module mau 0/1/0/3", DESCR: "DWDM Tunable Wavelength XFP, Channel 1 to 82"
NAME: "module 0/2/CPU0", DESCR: "80G Modular Linecard, Service Edge Optimized"
NAME: "module 0/2/0", DESCR: "ASR 9000 20-port 1GE Modular Port Adapter"
NAME: "module mau 0/2/0/0", DESCR: "1000BASE-LX/LH SFP transceiver module, MMF/SMF, 1310nm, DOM"
NAME: "module mau 0/2/0/7", DESCR: "10GBASE-SR SFP+ Module for MMF"
NAME: "module mau 0/2/0/8", DESCR: "GE T"
NAME: "module mau 0/2/0/18", DESCR: "1000BASE-SX SFP transceiver module, MMF, 850nm, DOM"
NAME: "module mau 0/2/0/19", DESCR: "1000BASE-SX SFP transceiver module, MMF, 850nm, DOM"
NAME: "module 0/2/1", DESCR: "ASR 9000 20-port 1GE Modular Port Adapter"
NAME: "module mau 0/2/1/0", DESCR: "1000BASE-BX SFP, 1490NM"
NAME: "module mau 0/2/1/2", DESCR: "1000BASE-BX SFP, 1310NM"
NAME: "module mau 0/2/1/6", DESCR: "1000BASE-LX/LH SFP transceiver module, MMF/SMF, 1310nm, DOM"

sh run extract

nv
satellite 100
type asr9000v2
ip address 192.168.0.100
description test 1
!
satellite 200
type asr9000v2
ip address 192.168.0.200
description test 2

interface Bundle-Ether100
ipv4 point-to-point
ipv4 unnumbered Loopback1000
nv
satellite-fabric-link satellite 100
remote-ports GigabitEthernet 0/0/0-43
!
!
!
interface Bundle-Ether200
ipv4 point-to-point
ipv4 unnumbered Loopback1000
nv
satellite-fabric-link satellite 200
remote-ports GigabitEthernet 0/0/0-43
!
!
!
interface Loopback1000
ipv4 address 192.168.0.1 255.255.255.255

....

interface GigabitEthernet0/2/0/0
bundle id 200 mode on

...

interface TenGigE0/1/0/1
bundle id 100 mode on

...

smilstea · ‎09-24-2015

Do you have both bundles configured at the same time?

Sounds like you are trying to do a L1 topology, which supports partitioning, but your config has both bundles trying to get all the access ports.

Can you try changing the port assignment or only having one of the bundles configured?

Thanks,

Sam

jerome.gomez · ‎09-24-2015

Hi Sam, thanks for your quick answer

not sure to well understand what you mean

yes i try to use both bundles at the same time (with two different ASR 9000v)

To be clear on my config, i try to have 2 bundles (1 for each Satelite).

Bundle 100 for Sat 100 whitch is a first 9000V

Bundle 200 for Sat 200 whitch is a second 9000V

This conf is working when i use 10Gig ICL for both sat

When use the bundle 200 with Giga ports (no more 10G in this one) i have the depicted behavior.

smilstea · ‎09-24-2015

Ahh, I see that now.

Can you connect the 10G back to satellite 200 and make sure the satellite is updated to the latest revision?

Also having the show im database interface gig 0/2/0/0 and debug nv satellite internal dpm all interface gig 0/2/0/0 verbose will help from both the working and non-working conditions.

Sam

jerome.gomez · ‎09-24-2015

Hi,

Sat 200 was connected in 10 and was working well with remote version [Compatible (latest version)]

I done it to be sure that the version in SAT is compliant with Gig ICL :)

RP/0/RSP0/CPU0:ios#show im database interface gig 0/2/0/0
Thu Sep 24 06:13:16.242 UTC

View: OWN - Owner, L3P - Local 3rd Party, G3P - Global 3rd Party, LDP - Local Data Plane
GDP - Global Data Plane, RED - Redundancy, UL - UL

Node 0/2/CPU0 (0x841)

Protocol        Caps (state, mtu)
--------        -----------------
None            spio (up, 9228)
None            sat_info (up, 9228)
None            ether (down, 9228)
link_jump_target link_jump_target (down, 9214)
ether_sock      ether_sock (down, 9214)

debug is attached

Thanks one more time

smilstea · ‎09-25-2015

The discovery packets are being generated, need to verify if they are leaving out the interface. They are sent 1/sec, only real way to verify is with show interface <icl>.

I would recommend opening up a TAC SR, I have seen this once or twice before and it takes a bit more digging. As an aside I have used The gig SFPs in my lab since 5.1.1 so I know they work.

Sam

jerome.gomez · ‎09-25-2015

Hi

anyway thanks for your help. I was trying to open a SR :)

Kind regards