[SOLVED] Cisco 4506 w/WS-X4748-SFP-E with Crestron NVX Series 4k Video Encoder/Decoder, Links don't stay up.

[benjammin1001]

I have a working C4506 with 2 UPOE Line cards and just added the X4748-SFP-E line card.

The system shows the line card -- and I go configure it -- but the ports don't stay up.

Normally, they are all populated with 48 GLC-MM-SX modules. 

sh interface for any port shows the 1000Base-SX module accordingly.

We put a copper module in one port (to test with a laptop with Windows) and that port doesn't stay up either...

(even after trying various items like speed nonegotiate for the copper module.)

I see the link come up (if I keep showing that interface) but then it goes back down.

I could use a little help...

C4506#sh version
Cisco IOS Software, IOS-XE Software, Catalyst 4500 L3 Switch Software (cat4500es8-UNIVERSAL-M), Version 03.06.04.E RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2016 by Cisco Systems, Inc.
Compiled Sat 13-Feb-16 13:31 by prod_rel_team

Cisco IOS-XE software, Copyright (c) 2005-2015 by cisco Systems, Inc.
All rights reserved. Certain components of Cisco IOS-XE software are
licensed under the GNU General Public License ("GPL") Version 2.0. The
software code licensed under GPL Version 2.0 is free software that comes
with ABSOLUTELY NO WARRANTY. You can redistribute and/or modify such
GPL code under the terms of GPL Version 2.0.
(http://www.gnu.org/licenses/gpl-2.0.html) For more details, see the
documentation or "License Notice" file accompanying the IOS-XE software,
or the applicable URL provided on the flyer accompanying the IOS-XE
software.

ROM: 15.1(1r)SG5
C4506 uptime is 8 weeks, 1 day, 6 hours, 55 minutes
System returned to ROM by power-on
System restarted at 12:39:46 UTC Tue May 30 2017
Running default software
Jawa Revision 3, RadTrooper Revision 0x0.0x41, Conan Revision 0x1449

Last reload reason: power-on

License Information for 'WS-X45-SUP8-E'
License Level: lanbase Type: Default. No valid license found.
Next reboot license Level: lanbase

cisco WS-C4506-E (P5040) processor (revision 2) with 4194304K bytes of physical memory.
Processor board ID FXS1926Q2N3
P5040 CPU at 2.2GHz, Supervisor 8-E
Last reset from PowerUp
4 Virtual Ethernet interfaces
144 Gigabit Ethernet interfaces
8 Ten Gigabit Ethernet interfaces
511K bytes of non-volatile configuration memory.

Configuration register is 0x2101

C4506#sh module
Chassis Type : WS-C4506-E

Power consumed by backplane : 0 Watts

Mod  Ports Card Type                             Model              Serial No.
---+-----+--------------------------------------+------------------+-----------
1     8    Sup 8-E 10GE (SFP+), 1000BaseX (SFP)  WS-X45-SUP8-E      CAT1944L5VL
2    48    10/100/1000BaseT UPOE E Series        WS-X4748-UPOE+E    CAT1946L354
3    48    10/100/1000BaseT UPOE E Series        WS-X4748-UPOE+E    CAT1918L0PK
6    48    1000BaseX SFP                         WS-X4748-SFP-E     CAT1931L5GA

M   MAC addresses                    Hw  Fw           Sw               Status
--+--------------------------------+---+------------+----------------+---------
1  d8b1.90e5.6600 to d8b1.90e5.6607 1.3 15.1(1r)SG5   03.06.04.E      Ok
2  58ac.78da.d6c0 to 58ac.78da.d6ef 1.1                               Ok
3  54a2.7478.e980 to 54a2.7478.e9af 1.1                               Ok
6  a03d.6f41.bb1c to a03d.6f41.bb4b 1.0                               Ok

Thanks, 

    -Ben

[Leo Laohoo]

Fiber in Supervisor doesn't work at all (unless hooking to another Cisco Switch like the SG-200 we're playing with.)

This doesn't make any logical sense.  

This description bears the hallmark of a software bug.  I am trawling through my emails and I can't find any known bug with this behaviour.  

I'd recommend creating a TAC case.  

[benjammin1001]

yea... it's looking like that's going to be the situation.

I makes no sense to me either.

(did you see the grid of variations I tried?)

this is just really weird.

The NVX network interfaces are somehow bridged.

(there's 2 copper and one SFP) If you plug the copper into a working switch (we did the SG200) then plug in another NVX to THAT NVX via SFP/Fiber, you can connect to the second NVX through the first. Weeeeiiirrrddd...

SO that gives me willies too.

What I'm really worried about is that Cisco will just point blame at Crestron and Crestron will point blame at Cisco. 

I'm not looking forward to this. :(

[benjammin1001]

And as a side-note, I tried the varies DOM commands and found this link:

https://www.cisco.com/c/en/us/td/docs/interfaces_modules/transceiver_modules/compatibility/matrix/GE_Tx_Matrix.html

As per my question below (about version), I get DOM with 3.8.x....

There's 3.8.4 that has an (MD) status and would get me some more debugging.

The Cisco SFP modiles are in fact the GLC-SX-MMD type. :(

Would it be wise to update to at least that?  (This has a 4500-E w/SUP 8-E)

[benjammin1001]

I updated to 03.08.04 and now have DOM available...

it's showing me that the SFPs I've been working with are receiving a reasonable value level (about -5dB to -6dB) while transmitting about -6dB

So that's something.. (sanity check!)

[benjammin1001]

I found a 3rd party (supposedly Cisco Compatible and seems to be) copper module.

When I plug it into a port on the SFP card, the link is forced up -- then when I plug in my laptop, the link goes down. (according to the console link status messages)

this is confirmed by sh int <port> that shows this goofy state.

When I put this same module into the SFP+ 1/1 of supervisor and plug in my laptop, this works. (even get my DHCP assigned address). I see all the transceiver plug/unplug messages.

BTW, the SX-MM modules show no status changes with plugging stuff around. Silence. (I do see module plug messages, just not link up/down messages)


It also occurred to me to at least ask, am I missing a license for this system or something?
Do the cards have to be in order (I put SFP in slot 6 skipping 4 and 5 -- I wouldn't think so)

I can see the lasers come up even. (and loop-back fibers bring up a link as well at BOTH ends)

[benjammin1001]

As another update,

 Today we tried this Crestron NVX  module plugged into an SG200-50P both with Cisco SFP GLC-MM-SX modules and third party brands. Both work.

So something between the new (and I mean "new" as in recently released to market) Crestron product and the 4500 specifically don't like each other.

I'll post more when I'm on-site next week.

[benjammin1001]

UPDATE:

Here's a current grid of everything that's been tried....

[benjammin1001 · Accepted solution]

After working with Crestron: It turns out their SFP interface does not support auto-negotiation.

Even though the X4748 doesn't really do auto-negotiate, the way to make things happy is to set any interface connecting to the Crestron NVX series encoder/decoder cards is to add the config command:

speed nonegotiate

Poof! - it works.

Enjoy.