VSOM 7.7.0 Showing load average is critical

[gauravrana]

This is the error message of the server. Can anyone help in this regard.

Date Time : March 31, 2017 4:59:43 AM

Type :

Device : VsomServer01

Server : VsomServer01

Description : Load Average MAX limit: [150] state: [183]

top - 08:50:16 up 15:09, 1 user, load average: 21.04, 36.01, 44.04
Tasks: 825 total, 1 running, 824 sleeping, 0 stopped, 0 zombie
Cpu(s): 5.4%us, 2.2%sy, 0.0%ni, 91.4%id, 0.4%wa, 0.1%hi, 0.4%si, 0.0%st
Mem: 16410272k total, 15665816k used, 744456k free, 20812k buffers
Swap: 8391672k total, 820k used, 8390852k free, 10163184k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
5528 root 34 19 0 0 0 S 15.1 0.0 105:30.72 kipmi0
6458 root 20 0 552m 285m 9072 S 10.5 1.8 93:17.21 mysqld
7660 root 15 0 822m 448m 67m S 9.9 2.8 349:41.05 xvcrman
7359 mysql 15 0 1996m 1.4g 9192 S 7.9 8.6 102:39.52 mysqld
6516 root 18 0 1728m 1.3g 9264 S 6.2 8.1 51:20.42 java
7508 root 15 0 145m 23m 15m S 3.9 0.1 31:17.99 HttpServer
8868 nobody 18 0 132m 33m 26m S 1.6 0.2 9:58.65 umsdevice
8923 nobody 18 0 141m 33m 26m S 1.6 0.2 9:33.71 umsdevice
7808 nobody 15 0 171m 32m 25m S 1.3 0.2 6:01.38 umsdevice
8231 nobody 15 0 167m 30m 25m S 1.3 0.2 5:55.93 umsdevice
9924 nobody 18 0 142m 34m 26m S 1.3 0.2 9:48.61 umsdevice
10720 nobody 18 0 180m 31m 27m S 1.3 0.2 10:29.62 umsdevice
10764 nobody 18 0 157m 56m 33m S 1.3 0.4 8:12.65 umsdevice
11775 root 18 0 120m 36m 19m S 1.3 0.2 28:28.61 MediaOut
21405 root 15 0 0 0 0 S 1.3 0.0 0:00.09 pdflush
26810 root 16 0 2848 1532 824 R 1.3 0.0 0:04.86 top
7441 root 16 0 276m 29m 23m S 1.0 0.2 9:00.70 EventEngineDaem
7725 nobody 15 0 169m 32m 25m S 1.0 0.2 5:58.83 umsdevice
7752 nobody 15 0 168m 31m 25m S 1.0 0.2 4:57.34 umsdevice
7819 nobody 15 0 170m 32m 25m S 1.0 0.2 6:07.67 umsdevice
7837 nobody 15 0 169m 31m 25m S 1.0 0.2 6:05.42 umsdevice
7923 nobody 15 0 169m 31m 25m S 1.0 0.2 6:10.53 umsdevice
7995 nobody 15 0 169m 31m 25m S 1.0 0.2 6:16.79 umsdevice
8026 nobody 15 0 169m 32m 25m S 1.0 0.2 6:03.64 umsdevice
8052 nobody 15 0 168m 31m 25m S 1.0 0.2 6:06.31 umsdevice
8061 nobody 15 0 170m 31m 25m S 1.0 0.2 6:08.59 umsdevice
8098 nobody 15 0 168m 30m 25m S 1.0 0.2 6:11.84 umsdevice
8129 nobody 15 0 169m 31m 25m S 1.0 0.2 6:07.04 umsdevice
8191 nobody 15 0 170m 32m 25m S 1.0 0.2 6:04.77 umsdevice
8209 nobody 15 0 169m 31m 25m S 1.0 0.2 6:01.41 umsdevice
8361 nobody 15 0 169m 31m 25m S 1.0 0.2 6:10.36 umsdevice
8416 nobody 15 0 169m 31m 25m S 1.0 0.2 6:12.59 umsdevice
8426 nobody 15 0 168m 30m 25m S 1.0 0.2 6:14.50 umsdevice
8443 nobody 15 0 169m 30m 25m S 1.0 0.2 6:11.06 umsdevice
8472 nobody 15 0 168m 31m 25m S 1.0 0.2 6:02.29 umsdevice
8518 nobody 15 0 168m 31m 25m S 1.0 0.2 6:06.14 umsdevice
8551 nobody 15 0 168m 31m 25m S 1.0 0.2 6:07.66 umsdevice

[Scott Olsen]

What else can you share?

What server platform is this running on?  How many cameras/streams is the server responsible for?  What's the total aggregate I/O of the server?

[gauravrana]

Server PID is CPS-UCS-2RU-K9

VSOM Version is 7.7.0

Cameras connected to the server are 150

Please let me know how can i check I\O of the server?

[Scott Olsen]

Well, as far as I'm aware, there's no direct way to do so anymore in 7.X..., but you should be able to get an idea of the ingress throughput by summing up all the bitrates (units are KiloBITS/s) on the Streams page of the VSMC console.

All of the egress throughput could be calculated by summing up all the average throughput values (units are BYTES/s apparently) on the Mediaout page of the VSMC console. 

These two values combined would be the approximate total I/O of the VSM server.  If memory serves, this really should not exceed 200Mbps (megabits/s) for any one VSMS server instance.  I believe it's also actually lower than that if the server is a co-located VSM suite (running both VSOM and VSMS roles).

All the technical specifics for performance can be found here, if you want to check them out:

http://www.cisco.com/c/en/us/td/docs/security/physical_security/video_surveillance/network/vsm/performance/vsm_7_performance.html

All the best!