Slow running system

[elad]

Here's the gist of the setup.
Server: Dell R230, quad 2.8 proc, 8gb ram.
Zoneminder 1.30.4 Ubuntu 14.04 from "easy" setup guide
installed on raid1 260gb sas
events/images on raid5 5 1tb drives and 1 hs
Camera's - All are hikvision 3mp or higher
Monitors are setup as ffmpeg as per the wiki, I have lowered the FPS and buffer to attempt to get more cameras to show online.

I have 61 cameras that are running on a hikvision nvr. This factory is growing again and wants to add another 35 cameras so I looked towards ZoneMinder from a reference on a blog I was reading. It appears as though I've either configured something terribly wrong or ZoneMinder wasn't the right solution for this. I'm open to either suggestion. My /dev/shm is always pegged at 100% unless I delete my monitors down to 3 or 4 cameras.

I have modified the /etc/fstab with mount -t tmpfs -o size=4096m tmpfs /mnt/ramdisk then added the mnt/ramdisk to /dev/shm, but still no better on performance.

Log below, can anyone give me a thought which way I should look to fix this. Thanks in Advance. This system is not publicly facing yet so any modifications will be made in about 12 hours from post.

2018-06-11 20:48:24.059598 zmc_m15[4118].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 6, image 2131, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:22.823676 zmc_m15[4118].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 22, image 2122, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:22.257267 zmc_m14[4352].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 2, image 1377, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:22.218616 zma_m14[4280].WAR-zm_monitor.cpp/1324 [Approaching buffer overrun, consider slowing capture, simplifying analysis or increasing ring buffer size]
2018-06-11 20:48:20.789111 zmc_m14[4352].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 20, image 1370, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:20.343513 zmc_m2[4027].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 13, image 3838, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:20.063336 zmc_m13[4085].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 9, image 2609, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:19.683545 zmc_m13[4085].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 7, image 2607, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:19.566502 zmc_m16[4278].ERR-zm_ffmpeg_camera.cpp/269 [Unable to open input rtsp://admin:xxxxxx@192.168.64.62:554//Streaming/Channels/1 due to: Operation now in progress]
2018-06-11 20:48:18.925495 zmc_m14[4352].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 4, image 1354, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:18.576673 zmc_m4[4050].WAR-zm_monitor.cpp/3100 [Last image read from shared memory 9 seconds ago, zma may have gone away]
2018-06-11 20:48:18.314245 zmc_m4[4050].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 12, image 3162, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:17.697663 zmc_m14[4352].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 17, image 1342, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:16.245186 zmc_m14[4352].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 0, image 1325, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:15.406822 zmc_m14[4352].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 16, image 1316, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:14.198408 zmc_m14[4352].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 9, image 1309, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:13.097606 zmc_m14[4352].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 2, image 1302, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:12.808480 zmc_m4[4050].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 12, image 3112, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:11.612174 zmc_m14[4352].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 10, image 1285, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:11.567852 zmc_m15[4118].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 14, image 1964, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:10.929933 zma_m4[4271].WAR-zm_monitor.cpp/1429 [Signal: Reacquired]
2018-06-11 20:48:10.131447 zmc_m14[4352].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 1, image 1276, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:09.135274 zmc_m16[4278].ERR-zm_ffmpeg_camera.cpp/269 [Unable to open input rtsp://admin:xxxxxxx@192.168.64.62:554//Streaming/Channels/1 due to: Operation now in progress]
2018-06-11 20:48:07.027009 zmc_m15[4118].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 0, image 1900, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:06.495198 zma_m4[4271].WAR-zm_monitor.cpp/1429 [Signal: Lost]
2018-06-11 20:48:06.258662 zmc_m14[4352].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 3, image 1228, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:04.359240 zmc_m13[4085].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 20, image 2395, slow down capture, speed up analysis or increase ring buffer size]
2018-06-11 20:48:04.212180 zmc_m15[4118].WAR-zm_monitor.cpp/3100 [Last image read from shared memory 9 seconds ago, zma may have gone away]
2018-06-11 20:48:04.036961 zmc_m4[4050].ERR-zm_ffmpeg_camera.cpp/167 [Unable to read packet from stream 0: error -1606004923 "End of file".]
2018-06-11 20:48:04.007051 zmc_m15[4118].WAR-zm_monitor.cpp/3094 [Buffer overrun at index 20, image 1870, slow down capture, speed up analysis or increase ring buffer size]

[bbunge]

Add more RAM! Most Linux distros will use half of the installed ram for tmpfs. /dev/shm is in the tmpfs area.
Lower the resolution of the cameras. 640x480 should be good enough for a security system
Run mysqltuner to find where you need to tweak the database settings. The more events you have the more resources you have to give the database server.
As you are running server hardware it should have hardware RAID that will not rob system processor resources. RAID 1 should be good for the OS and database.
Consider reinstalling the system with Ubuntu 16.04 or 18.04. Upgrading from 14.04 might cause some problems as 16.04 has ZM 1.29.0 and there is no ZM in the 18.04 repro (Yes, you can run 18.04 with ZM 1.30.4. Instructions in the WIKI). With 16.04 or 18.04 you can use systemd to mount the RAID 5 array.

[elad]

Thanks for the response, I will try these in a few hours and report. I'm not to committed to 14.04 so ill wipe and throw 16.04 on there. I'm no Linux guru so I'll wait for more kb to troubleshoot 18.04.