Zoneminder 1.30 is randomly stopping

Forum for questions and support relating to the 1.30.x releases only.
Locked
calduil
Posts: 3
Joined: Sun Aug 21, 2016 6:26 pm

Zoneminder 1.30 is randomly stopping

Post by calduil »

Hello.

I have a big problem with my Zoneminder server. We have a server with Ubuntu 16.04 server and Zoneminder 1.30.0 and recently he is randomly stopping. Zoneminder can run for several days and stop just like that or can just stop an hour after i start him.
I was using Ubuntu Server 16.04 64-bit with Zoneminder 1.30.0 the easy way installation guide.
We got 24 cameras in RTSP or HTTP with record or modect.

Server: 24 gb RAM
Xeon e5410


Logs (second in file):

Code: Select all

Feb 14 10:51:49 ubuntu systemd[1]: zoneminder.service: Main process exited, code=exited, status=4/NOPERMISSION
Feb 14 10:51:49 ubuntu zma_m6[1954]: INF [dzieci_zdr_poczek: 386527 - Gone into alarm state]
Feb 14 10:51:49 ubuntu zma_m6[1954]: INF [dzieci_zdr_poczek: 386527 - Opening new event 1371874, alarm start]
Feb 14 10:51:50 ubuntu zmc_m20[2948]: INF [szatnia: 438000 - Capturing at 4.95 fps]
Feb 14 10:51:50 ubuntu zmpkg[1538]: INF [Sanity checking States table...]
Feb 14 10:51:50 ubuntu zmc_m8[1979]: WAR [Buffer overrun at index 19, image 493419, slow down capture, speed up analysis or increase ring buffer size]
Feb 14 10:51:50 ubuntu zmpkg[1538]: INF [Command: stop]
Feb 14 10:51:50 ubuntu zmc_m18[2504]: WAR [Buffer overrun at index 44, image 487594, slow down capture, speed up analysis or increase ring buffer size]
Feb 14 10:51:50 ubuntu zma_m18[3129]: INF [3p_korytarz_2: 384187 - Gone into alert state]
Feb 14 10:51:51 ubuntu zmc_m6[1952]: INF [dzieci_zdr_poczek: 486000 - Capturing at 9.01 fps]
Feb 14 10:51:51 ubuntu zma_m7[3088]: INF [dzieci_zdr_poczek1: 383108 - Left alarm state (1371871) - 87(30) images]
Feb 14 10:51:51 ubuntu zma_m7[3088]: INF [dzieci_zdr_poczek1: 383108 - Closing event 1371871, alarm end]
Feb 14 10:51:52 ubuntu zma_m4[3213]: INF [dzieci_ch_rejestr: 382793 - Gone into alert state]
Feb 14 10:51:52 ubuntu zma_m4[3213]: INF [dzieci_ch_rejestr: 382794 - Gone back into alarm state]
Feb 14 10:51:52 ubuntu systemd[1]: zoneminder.service: Control process exited, code=exited status=1
Feb 14 10:51:52 ubuntu zmc_m11[2035]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:52 ubuntu zmc_m28[3149]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:52 ubuntu zmc_m21[31601]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:52 ubuntu zmc_m13[31657]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:52 ubuntu zma_m6[1954]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m19[3023]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m11[2037]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m1[1863]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m15[19918]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m6[1952]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m7[3088]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m8[1979]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m12[3144]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m10[3146]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m5[1879]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m14[3066]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m1[3419]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m23[31904]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m3[1927]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m9[1992]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m2[3422]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m22[3061]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m17[3425]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m4[3213]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m19[2789]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m10[2008]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m5[2974]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m27[3131]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m14[32173]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m27[19945]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m3[3315]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m2[1938]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m6[1954]: ERR [Can't insert log entry: Lost connection to MySQL server during query]
Feb 14 10:51:53 ubuntu zma_m6[1954]: INF [dzieci_zdr_poczek: 386536 - Gone into alert state]
Feb 14 10:51:53 ubuntu zma_m21[2994]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m13[2959]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m7[1966]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m4[1924]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m23[5728]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m17[2365]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m18[2504]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m22[3071]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m28[3159]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m8[3062]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m20[2990]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zmc_m20[2948]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m18[3129]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m9[1993]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m15[2341]: INF [Got signal 15 (Terminated), exiting]
Feb 14 10:51:53 ubuntu zma_m14[3066]: INF [bok_parking: 374430 - Closing event 1371843, shutting down]
Feb 14 10:51:53 ubuntu zma_m1[3419]: INF [winda: 380852 - Closing event 1371845, shutting down]
Feb 14 10:51:53 ubuntu zma_m2[3422]: INF [winda_2pietro: 383735 - Closing event 1371846, shutting down]
Feb 14 10:51:53 ubuntu zmc_m6[1952]: ERR [Select error: Interrupted system call]
Feb 14 10:51:53 ubuntu zma_m3[3315]: INF [rejestracja_gl: 381157 - Closing event 1371842, shutting down]
Feb 14 10:51:53 ubuntu zma_m23[5728]: INF [parking_tyl2: 340829 - Closing event 1371840, shutting down]
Feb 14 10:51:53 ubuntu zma_m13[2959]: INF [parking_tyl: 371975 - Closing event 1371844, shutting down]
Feb 14 10:51:53 ubuntu zma_m22[3071]: INF [parking_przod: 461880 - Closing event 1371841, shutting down]
Feb 14 10:51:53 ubuntu zma_m18[3129]: INF [3p_korytarz_2: 384202 - Closing event 1371872, shutting down]
Feb 14 10:51:53 ubuntu zma_m8[3062]: INF [Monitor-7zarzad: 387192 - Closing event 1371867, shutting down]
Feb 14 10:51:53 ubuntu zmc_m6[1952]: ERR [Unable to read header]
Feb 14 10:51:53 ubuntu zma_m4[3213]: INF [dzieci_ch_rejestr: 382796 - Closing event 1371868, shutting down]
Feb 14 10:51:53 ubuntu zma_m6[1954]: INF [dzieci_zdr_poczek: 386537 - Closing event 1371874, shutting down]
Feb 14 10:51:53 ubuntu zmc_m6[1952]: ERR [Unable to get response, disconnecting]
Feb 14 10:51:54 ubuntu systemd[1]: zoneminder.service: Unit entered failed state.
Feb 14 10:51:54 ubuntu systemd[1]: zoneminder.service: Failed with result 'exit-code'.
Feb 14 10:55:01 ubuntu CRON[1589]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 14 11:01:54 ubuntu systemd[1]: Started CUPS Scheduler.
Feb 14 11:05:01 ubuntu CRON[1843]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 14 11:09:01 ubuntu CRON[1867]: (root) CMD (  [ -x /usr/lib/php/sessionclean ] && /usr/lib/php/sessionclean)
Feb 14 11:14:55 ubuntu systemd[1]: Started CUPS Scheduler.
Feb 14 11:15:01 ubuntu CRON[1949]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 14 11:17:01 ubuntu CRON[1960]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Feb 14 11:25:01 ubuntu CRON[2005]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 14 11:27:55 ubuntu systemd[1]: Started CUPS Scheduler.
Feb 14 11:35:01 ubuntu CRON[2329]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 14 11:39:01 ubuntu CRON[2357]: (root) CMD (  [ -x /usr/lib/php/sessionclean ] && /usr/lib/php/sessionclean)
Feb 14 11:40:56 ubuntu systemd[1]: Started CUPS Scheduler.
Feb 14 11:45:01 ubuntu CRON[2540]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 14 11:53:57 ubuntu systemd[1]: Started CUPS Scheduler.
Feb 14 11:55:01 ubuntu CRON[3471]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 14 12:05:01 ubuntu CRON[3837]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 14 12:06:57 ubuntu systemd[1]: Started CUPS Scheduler.
Feb 14 12:09:01 ubuntu CRON[3947]: (root) CMD (  [ -x /usr/lib/php/sessionclean ] && /usr/lib/php/sessionclean)
Attachments
syslog2.zip
(740.51 KiB) Downloaded 96 times
User avatar
knight-of-ni
Posts: 2404
Joined: Thu Oct 18, 2007 1:55 pm
Location: Shiloh, IL

Re: Zoneminder 1.30 is randomly stopping

Post by knight-of-ni »

Feb 14 10:51:50 ubuntu zmc_m18[2504]: WAR [Buffer overrun at index 44, image 487594, slow down capture, speed up analysis or increase ring buffer size]
You are overloading your system. To fix it, you need to do what the warning message is telling you.
Quad core cpu isn't going to cut it with 24 cameras unless you slow down the frame rate, and possibly the resolution too.

With 4 cores, your average system load should be no higher than 3. You have to allow wiggle room for normal operating system functions. Otherwise you get exactly what you reported.... a system that is not stable.

So lower your frame rate for all 24 cameras to 5 fps then watch your system load. Set the framerate in the camera, not in zoneminder. If the system load is still higher than 3, then you need to either reduce the frame rate further, lower the resolution, or get a faster machine.
Visit my blog for ZoneMinder related projects using the Raspberry Pi, Orange Pi, Odroid, and the ESP8266
All of these can be found at https://zoneminder.blogspot.com/
User avatar
iconnor
Posts: 2900
Joined: Fri Oct 29, 2010 1:43 am
Location: Toronto
Contact:

Re: Zoneminder 1.30 is randomly stopping

Post by iconnor »

Also, with that many cameras you are running out of mysql connections. I strongly suggest that you start tuning and monitoring your mysql logs.
Locked