Catalyst 4948-10GE and Mikrotik CRS306-1G-4S

[Rktartari]

Hi dear community

I'm trying to connect two Mikrotik switches to my 4948 at 10Gb/s using the X2 optics in the 4948. There I have two X2-10GB-SR that are connected via fiber to two cisco-finisar ftlx8570d3bcl-c1 SFP+ modules in the Mikrotiks. The link comes up, the power of the signal looks fine:

cisco#show interface transceiver detail
mA: milliamperes, dBm: decibels (milliwatts), NA or N/A: not applicable.
++ : high alarm, + : high warning, - : low warning, -- : low alarm.
A2D readouts (if they differ), are reported in parentheses.
The threshold values are calibrated.

High Alarm High Warn Low Warn Low Alarm
Temperature Threshold Threshold Threshold Threshold
Port (Celsius) (Celsius) (Celsius) (Celsius) (Celsius)
--------- ------------------ ---------- --------- --------- ---------
Te1/49 29.2 74.0 70.0 0.0 -4.0
Te1/50 28.0 74.0 70.0 0.0 -4.0

High Alarm High Warn Low Warn Low Alarm
Voltage Threshold Threshold Threshold Threshold
Port (Volts) (Volts) (Volts) (Volts) (Volts)
--------- --------------- ---------- --------- --------- ---------
Te1/49 3.23 N/A N/A N/A N/A
Te1/50 0.00 N/A N/A N/A N/A

Optical High Alarm High Warn Low Warn Low Alarm
Transmit Power Threshold Threshold Threshold Threshold
Port (dBm) (dBm) (dBm) (dBm) (dBm)
--------- ----------------- ---------- --------- --------- ---------
Te1/49 -2.2 2.9 -1.0 -7.3 -11.3
Te1/50 -2.1 2.9 -1.0 -7.3 -11.3

Optical High Alarm High Warn Low Warn Low Alarm
Receive Power Threshold Threshold Threshold Threshold
Port (dBm) (dBm) (dBm) (dBm) (dBm)
------- ----------------- ---------- --------- --------- ---------
Te1/49 -2.4 2.9 -1.0 -9.9 -13.9
Te1/50 -2.2 2.9 -1.0 -9.9 -13.9

From Mikrotik side everything looks fine but no traffic is received.

TenGigabitEthernet1/49 is up, line protocol is up (connected)
Hardware is Ten Gigabit Ethernet Port, address is 001e.f7ad.3370 (bia 001e.f7ad.3370)
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 10Gb/s, link type is auto, media type is 10GBase-SR
input flow-control is on, output flow-control is off
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts (0 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 input packets with dribble condition detected
503 packets output, 51419 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier
0 output buffer failures, 0 output buffers swapped out

Any idea on what's going on and why there is no traffic going through?

Thank you!

Best,

R

[Kasun Bandara]

seems like connectivity is OK. but check STP status of ports to make sure its not blocking. what kind of traffic are you sending? PC to PC in same network? or between different networks? 

[Rktartari]

Hi Kasun

I set the STP prio high enough and the whole STP root setting process works perfectly well when I use one of the gigabit interfaces, the switch shows that the stp negotiation is happening and everything works. It doesn't work using the X2 optics. There from the 4948 perspective we sned data and we never receive anything back, 

TenGigabitEthernet1/50 is up, line protocol is up (connected)
Hardware is Ten Gigabit Ethernet Port, address is 001e.f7ad.3371 (bia 001e.f7ad.3371)
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 10Gb/s, link type is auto, media type is 10GBase-SR
input flow-control is on, output flow-control is off
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts (0 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 input packets with dribble condition detected
3103 packets output, 454267 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier
0 output buffer failures, 0 output buffers swapped out

And I see similar metrics from the Mikrotik switch... the MK switch sends data and never receives anything back.

[Leo Laohoo]

Is the port meant to be a Trunk or Access port?

[Rktartari]

Hi Leo

The port is supposed to be a trunk port but should not make any difference due to the fact that I'm using only one single vlan. 

Thank you!

Best,

R

[Leo Laohoo]

If trunk port is  not working, flip to an Access port (VLAN 1) and see if it makes any difference.

[amikat]

Hi,

To my knowledge the FTLX8570D3BCL transceiver has been used as FET-10G module for Nexus family switches. As such it may have slightly different characterictics for different optical cables to the regular 10GBASE-SR SFP+. I would suggest to try another SFP+ module with the Mikrotik box.

Best regards,

Antonin