10-17-2015 10:57 AM - edited 03-01-2019 12:24 PM
Hi All,
Before I put down my weird problem, I would like to ask if direct attaching storage using twinax cables with VIC1227 or 1225 (10GbE) is supported or not?
We are trying to "Direct Attach" NetApp FAS3240 (cdot 8.3.1) with cisco UCS c240-m4 VIC1227 (mlom, slot 7) and 1225 (slot 4) using twinax SFP-H10GB-CU3M. We have installed xenserver 6.5 on the server and given ip addresses to one port on xenserver (xenbr3) and one port on FAS3240 (node 1 port e1b)
Even though the links are up we cannot reach either side. Pinging from NetApp shows network unreachable and looking at packet traces from Xen side we do see communications of this sort:
19:56:21.618481 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 192.168.25.140 tell 192.168.25.130, length 46
19:56:21.618505 ARP, Ethernet (len 6), IPv4 (len 4), Reply 192.168.25.140 is-at e8:65:49:73:93:b9 (oui Unknown), length 28
19:56:22.619069 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 192.168.25.140 tell 192.168.25.130, length 46
19:56:22.619090 ARP, Ethernet (len 6), IPv4 (len 4), Reply 192.168.25.140 is-at e8:65:49:73:93:b9 (oui Unknown), length 28
19:56:23.620037 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 192.168.25.140 tell 192.168.25.130, length 46
19:56:23.620048 ARP, Ethernet (len 6), IPv4 (len 4), Reply 192.168.25.140 is-at e8:65:49:73:93:b9 (oui Unknown), length 28
19:56:24.621109 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 192.168.25.140 tell 192.168.25.130, length 46
19:56:24.621136 ARP, Ethernet (len 6), IPv4 (len 4), Reply 192.168.25.140 is-at e8:65:49:73:93:b9 (oui Unknown), length 28
019:56:25.621729 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 192.168.25.140 tell 192.168.25.130, length 46
19:56:25.621749 ARP, Ethernet (len 6), IPv4 (len 4), Reply 192.168.25.140 is-at e8:65:49:73:93:b9 (oui Unknown), length 28
192.168.25.130 is NetApp
192.168.25.140 is cisco ucs
ifconfig on ucs:
xenbr0 Link encap:Ethernet HWaddr 78:BA:F9:CB:4E:B9
UP BROADCAST RUNNING MTU:1500 Metric:1
RX packets:711 errors:0 dropped:566 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:39816 (38.8 KiB) TX bytes:0 (0.0
xenbr1 Link encap:Ethernet HWaddr 78:BA:F9:CB:4E:BA
UP BROADCAST RUNNING MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 TX bytes:0 (0.0
xenbr3 Link encap:Ethernet HWaddr E8:65:49:73:93:B9
inet addr:192.168.25.140 Bcast:192.168.25.255 Mask:255.255.255.0
UP BROADCAST RUNNING MTU:1500 Metric:1
RX packets:774 errors:0 dropped:396 overruns:0 frame:0
TX packets:1654 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:43600 (42.5 KiB) TX bytes:73276 (71.5 KiB)
On Storage:
node1> ifconfig e1b
e1b: flags=0x1f0c867<UP,BROADCAST,
inet 192.168.25.130 netmask 0xffffff00 broadcast 192.168.25.255 noddns DATA
ether 90:e2:ba:2f:9e:21 (auto-10g_twinax-fd-up) flowcontrol full
node1> ifstat e1b
-- interface e1b (1 hour, 47 minutes, 39 seconds) --
RECEIVE
Frames/second: 0 | Bytes/second: 0 | Errors/minute: 0
Discards/minute: 0 | Total frames: 1997 | Total bytes: 963k
Total errors: 0 | Total discards: 0 | Multi/broadcast: 1232
No buffers: 0 | Non-primary u/c: 0 | L2 terminate: 0
Tag drop: 1997 | Vlan tag drop: 0 | Vlan untag drop: 0
Vlan forwards: 0 | CRC errors: 0 | Runt frames: 0
Fragment: 0 | Long frames: 0 | Jabber: 0
Error symbol: 0 | Illegal symbol: 0 | Bus overruns: 0
Queue drop: 0 | Xon: 0 | Xoff: 0
Jumbo: 0 | JMBuf RxFrames: 0 | JMBuf DrvCopy: 0
TRANSMIT
Frames/second: 0 | Bytes/second: 0 | Errors/minute: 0
Discards/minute: 0 | Total frames: 136 | Total bytes: 5712
Total errors: 0 | Total discards: 0 | Multi/broadcast: 136
Queue overflows: 0 | No buffers: 0 | Xon: 0
Xoff: 0 | Jumbo: 0 | TSO non-TCP drop: 0
Split hdr drop: 0 | Pktlen: 0 | Timeout: 0
Timeout1: 0 | Stray Cluster Pk: 0
DEVICE
Rx MBuf Sz: Large (3k)
LINK_INFO
Current state: up | Up to downs: 2 | Speed: 10000m
Duplex: full | Flowcontrol: full
Looks like the server and the filer initiate the communication and exchange the MAC addresses but then stop, ICMP is not blocked and we have also tried to access the ip addresses through other protocols. We can see from interface statistics on both sides that the bytes (probably broadcast arp requests only) are flowing in.
Any help would be appreciated.
Regards,
Azfar
11-30-2016 12:05 PM
You could configure or solve this problem ?, I have the same problem, help me please
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide