Hi
First thing I think of is the fiber link.
I am wondering where it goes or connects to?
What type of SFP are you using in my switch ?
What type of fiber cable are you using, 9um, 50um or 62.5um ?
How long is the fiber cable and how many patches are in the cable ?
Throughput within the switch should be fast, it's been a while since we produced a blocking switch fabric. The switching fabric as you also alluded to is non blocking within the switch.

Next I'm thinking all the IP hosts autonegotiate ethernet speed and duplex.
Is there a loop, a wireshark capture on a port could indicate if a broadcast storm is occuring.
Still a lot we don't know about what is heppening , but also looking forward to other folks input that may be useful for your problem determination.
regards Dave