Zoneminder Stops after approx 1:30hr

[itsalexjones]

Hi,

I'm having an issue with a ZM installation I look after. It's recording 22 Axis IP cameras at 5fps 1280x720.
The system runs fine, but after about an hour and a bit Zoneminder always just changes from running to stopped. The system is very beefy so I don't expect it to be a CPU/RAM utilisation issue.

A snippet of the log file that (i think) contains all the info relating to the crash is attached. Does anyone have any ideas of where to start?


Thanks
Alex

Code: Select all

2016-08-16 10:35:17.099888	zma_m27		11554	INF	3J: 1695 - Closing event 12777, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:17.072356	zmc_m1		30005	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.072291	zmc_m16		30076	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.072257	zmc_m29		30352	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.072252	zmc_m17		30088	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.072030	zmc_m21		16600	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071991	zmc_m34		30435	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071930	zmc_m35		30448	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071906	zmc_m33		30405	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071896	zmc_m32		30391	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071841	zmc_m30		30366	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071835	zmc_m20		30132	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071643	zmc_m28		30339	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071546	zmc_m27		30315	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071545	zmc_m3		30038	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071542	zmc_m25		30278	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071491	zmc_m2		30024	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071470	zmc_m23		30251	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071415	zmc_m26		30301	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071412	zmc_m24		30263	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071231	zmc_m22		30170	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.071146	zmc_m19		30119	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.054361	zmc_m15		30051	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 10:35:17.038138	zmc_m1		30005	ERR	Unable to read content	zm_remote_camera_http.cpp	1026
2016-08-16 10:35:17.037988	zmc_m16		30076	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037975	zmc_m29		30352	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037932	zmc_m21		16600	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037907	zmc_m35		30448	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037895	zmc_m17		30088	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037873	zmc_m34		30435	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037859	zmc_m32		30391	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037845	zmc_m33		30405	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037812	zmc_m20		30132	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037761	zmc_m30		30366	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037600	zmc_m27		30315	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037543	zmc_m28		30339	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037482	zmc_m3		30038	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037448	zmc_m2		30024	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037433	zmc_m25		30278	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037323	zmc_m26		30301	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037317	zmc_m24		30263	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037237	zmc_m23		30251	ERR	Unable to read content	zm_remote_camera_http.cpp	1026
2016-08-16 10:35:17.037170	zmc_m22		30170	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037102	zmc_m19		30119	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.037097	zmc_m15		30051	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 10:35:17.033460	zma_m20		30134	INF	2B: 7541 - Closing event 12757, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:17.031574	zma_m22		30177	INF	2F: 7553 - Closing event 12761, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:17.022391	zma_m29		30360	INF	3L: 7626 - Closing event 12762, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:17.021921	zma_m35		30456	INF	4C: 7767 - Closing event 12773, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:17.021265	zma_m19		30121	INF	2A: 7640 - Closing event 12766, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:17.021106	zma_m32		30393	INF	3U: 7654 - Closing event 12772, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:17.020150	zma_m33		30413	INF	4A: 7669 - Closing event 12767, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:17.015684	zma_m30		9635	INF	3M: 2323 - Closing event 12763, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:17.015640	zma_m21		15804	INF	2D: 655 - Closing event 12776, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:17.015467	zma_m34		30437	INF	4B: 7638 - Closing event 12755, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:17.014255	zma_m15		17316	INF	2E: 418 - Closing event 12778, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:16.996405	zma_m23		30258	INF	2H: 7719 - Closing event 12764, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:16.996057	zma_m25		30294	INF	3E: 6422 - Closing event 12756, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:16.993201	zmc_m1		30005	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.993189	zmc_m29		30352	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992742	zmc_m16		30076	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992697	zmc_m17		30088	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992652	zmc_m21		16600	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992633	zmc_m33		30405	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992633	zmc_m32		30391	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992596	zmc_m20		30132	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992591	zma_m24		30270	INF	2J: 7627 - Closing event 12765, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:16.992549	zmc_m30		30366	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992464	zmc_m35		30448	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992445	zmc_m28		30339	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992443	zma_m1		15287	INF	2G: 944 - Closing event 12775, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:16.992371	zmc_m34		30435	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992346	zma_m3		30040	INF	3B: 7646 - Closing event 12770, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:16.992341	zma_m28		30341	INF	3K: 7613 - Closing event 12771, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:16.992284	zmc_m27		30315	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992119	zmc_m3		30038	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992078	zmc_m2		30024	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992027	zmc_m26		30301	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992027	zmc_m25		30278	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.992018	zmc_m24		30263	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.991975	zmc_m23		30251	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.991830	zmc_m22		30170	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.991824	zma_m2		10350	INF	3A: 2145 - Closing event 12774, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:16.991586	zma_m17		30096	INF	2L: 7642 - Closing event 12760, shutting down	zm_monitor.cpp	625
2016-08-16 10:35:16.991575	zmc_m19		30119	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.991510	zmc_m15		30051	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 10:35:16.607881	zma_m35		30456	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.607878	zma_m34		30437	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.607788	zma_m32		30393	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.607764	zma_m27		11554	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.607736	zma_m21		15804	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.607717	zma_m15		17316	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.607710	zma_m20		30134	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.607708	zma_m30		9635	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.607695	zma_m33		30413	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.607669	zma_m19		30121	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.607661	zma_m29		30360	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.607643	zma_m22		30177	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.607635	zma_m25		30294	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.514017	zma_m24		30270	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.512180	zmc_m30		30366	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.512110	zmc_m20		30132	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.512009	zmc_m29		30352	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511991	zmc_m32		30391	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511940	zmc_m33		30405	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511861	zmc_m34		30435	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511801	zmc_m35		30448	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511768	zmc_m26		30301	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511744	zmc_m25		30278	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511716	zma_m28		30341	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511706	zmc_m28		30339	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511661	zmc_m27		30315	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511642	zma_m23		30258	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511636	zmc_m23		30251	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511634	zmc_m24		30263	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511617	zmc_m19		30119	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511612	zmc_m22		30170	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511610	zmc_m2		30024	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511584	zmc_m17		30088	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511584	zmc_m21		16600	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511582	zma_m2		10350	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511563	zma_m3		30040	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511561	zmc_m16		30076	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511560	zmc_m15		30051	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511559	zma_m17		30096	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511503	zmc_m1		30005	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511501	zmc_m3		30038	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511449	zma_m1		15287	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.511446	zma_m16		10994	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:35:16.436143	zma_m16		10994	INF	2K: 2000 - Analysing at 3.37 fps	zm_monitor.cpp	1287
2016-08-16 10:35:16.348720	zmaudit		30463	INF	Filesystem event '15/9939' does not exist in database	zmaudit.pl	
2016-08-16 10:35:16.204850	zmpkg		18906	INF	Command: stop	zmpkg.pl	
2016-08-16 10:35:16.171340	zmaudit		30463	INF	deleting	zmaudit.pl	
2016-08-16 10:35:15.680680	zmpkg		18906	INF	Sanity checking States table...	zmpkg.pl	
2016-08-16 10:35:15.641800	zmaudit		30463	INF	Filesystem event '15/10654' does not exist in database	zmaudit.pl	
2016-08-16 10:35:15.532780	zmaudit		30463	INF	deleting	zmaudit.pl	
2016-08-16 10:35:11.613890	zmaudit		30463	INF	Filesystem event '15/11475' does not exist in database	zmaudit.pl	
2016-08-16 10:35:10.116466	zmc_m22		30170	WAR	Buffer overrun at index 44, image 9144, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:09.810765	zmc_m16		30076	WAR	Buffer overrun at index 26, image 9266, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:09.806904	zmc_m19		30119	WAR	Buffer overrun at index 24, image 9264, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:09.751067	zmc_m1		30005	WAR	Buffer overrun at index 2, image 9082, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:09.516736	zmc_m3		30038	WAR	Buffer overrun at index 6, image 9326, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:08.970617	zmc_m28		30339	WAR	Buffer overrun at index 24, image 9224, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:08.931995	zmc_m2		30024	WAR	Buffer overrun at index 4, image 9204, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:08.868024	zmc_m29		30352	WAR	Buffer overrun at index 47, image 9247, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:08.664546	zmc_m24		30263	WAR	Buffer overrun at index 30, image 9180, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:08.212010	zmdc		29922	INF	'zma -m 26' exited normally	zmdc.pl	
2016-08-16 10:35:08.210770	zmaudit		30463	INF	deleting	zmaudit.pl	
2016-08-16 10:35:08.210719	zmc_m26		30301	WAR	Last image read from shared memory 1471340108 seconds ago, zma may have gone away	zm_monitor.cpp	3091
2016-08-16 10:35:08.101687	zmc_m17		30088	WAR	Buffer overrun at index 37, image 9277, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:07.396035	zmc_m32		30391	WAR	Buffer overrun at index 25, image 9175, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:07.289778	zmc_m21		16600	WAR	Buffer overrun at index 31, image 831, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:06.676169	zmc_m33		30405	WAR	Buffer overrun at index 42, image 9192, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:06.415455	zmc_m20		30132	WAR	Buffer overrun at index 13, image 9213, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:05.670009	zmc_m30		30366	WAR	Buffer overrun at index 18, image 9168, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:05.564541	zmc_m34		30435	WAR	Buffer overrun at index 21, image 9221, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:35:01.550670	zmdc		29922	WAR	'zma -m 26' has not stopped at 16/08/16 10:35:01. Sending KILL to pid 18378	zmdc.pl	
2016-08-16 10:34:59.093700	zmaudit		30463	INF	Filesystem event '15/10281' does not exist in database	zmaudit.pl	
2016-08-16 10:34:59.091159	zmc_m26		30301	WAR	Buffer overrun at index 37, image 6137, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:34:55.663654	zma_m26		18378	INF	3F: 031 - Closing event 12780, shutting down	zm_monitor.cpp	625
2016-08-16 10:34:55.618580	zmaudit		30463	INF	deleting	zmaudit.pl	
2016-08-16 10:34:55.550032	zma_m26		18378	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:34:55.429860	zmaudit		30463	INF	Filesystem event '15/11095' does not exist in database	zmaudit.pl	
2016-08-16 10:34:53.144428	zmc_m1		30005	INF	2G: 9000 - Capturing at 5.00 fps	zm_monitor.cpp	3116
2016-08-16 10:34:52.779670	zmdc		29922	INF	'zma -m 26' sending stop to pid 18378 at 16/08/16 10:34:52	zmdc.pl	
2016-08-16 10:34:52.578240	zmaudit		30463	INF	deleting	zmaudit.pl	
2016-08-16 10:34:50.919360	zmwatch		30479	INF	Restarting analysis daemon for 3F	zmwatch.pl	
2016-08-16 10:34:49.145220	zmaudit		30463	INF	Filesystem event '15/10151' does not exist in database	zmaudit.pl	
2016-08-16 10:34:47.186820	zmwatch		30479	INF	Analysis daemon for 3F needs restarting, time since last analysis 9 seconds (1471340087-1471340078)	zmwatch.pl	
2016-08-16 10:34:45.923130	zmaudit		30463	INF	deleting	zmaudit.pl	
2016-08-16 10:34:45.854584	zma_m26		18378	INF	3F: 026 - Opening new event 12780, section start	zm_monitor.cpp	1532
2016-08-16 10:34:40.558030	zmaudit		30463	INF	Filesystem event '15/11072' does not exist in database	zmaudit.pl	
2016-08-16 10:34:37.977991	zmc_m22		30170	INF	2F: 9000 - Capturing at 4.98 fps	zm_monitor.cpp	3116
2016-08-16 10:34:37.151540	zmaudit		30463	INF	deleting	zmaudit.pl	
2016-08-16 10:34:36.809220	zmaudit		30463	INF	Filesystem event '15/10144' does not exist in database	zmaudit.pl	
2016-08-16 10:34:34.228166	zmc_m15		30051	INF	2E: 9000 - Capturing at 4.72 fps	zm_monitor.cpp	3116
2016-08-16 10:34:33.919953	zma_m26		18378	INF	In mode 4/1, warming up	zma.cpp	142
2016-08-16 10:34:33.744920	zmdc		18378	INF	'zma -m 26' started at 16/08/16 10:34:33	zmdc.pl	
2016-08-16 10:34:33.744900	zmdc		29922	INF	'zma -m 26' starting at 16/08/16 10:34:33, pid = 18378	zmdc.pl	
2016-08-16 10:34:32.842460	zmaudit		30463	INF	deleting	zmaudit.pl	
2016-08-16 10:34:32.469489	zmc_m24		30263	INF	2J: 9000 - Capturing at 4.98 fps	zm_monitor.cpp	3116
2016-08-16 10:34:32.078110	zmdc		29922	INF	Starting pending process, zma -m 26	zmdc.pl	
2016-08-16 10:34:31.893394	zmc_m30		30366	INF	3M: 9000 - Capturing at 4.67 fps	zm_monitor.cpp	3116
2016-08-16 10:34:30.595153	zmc_m32		30391	INF	3U: 9000 - Capturing at 4.72 fps	zm_monitor.cpp	3116
2016-08-16 10:34:29.669040	zmaudit		30463	INF	Filesystem event '15/10902' does not exist in database	zmaudit.pl	
2016-08-16 10:34:28.195240	zmc_m35		30448	INF	4C: 9000 - Capturing at 4.81 fps	zm_monitor.cpp	3116
2016-08-16 10:34:28.080575	zmc_m33		30405	INF	4A: 9000 - Capturing at 4.69 fps	zm_monitor.cpp	3116
2016-08-16 10:34:27.934881	zmc_m2		30024	INF	3A: 9000 - Capturing at 4.85 fps	zm_monitor.cpp	3116
2016-08-16 10:34:27.271838	zmc_m26		30301	WAR	Buffer overrun at index 17, image 6017, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 10:34:27.100640	zmdc		29922	INF	'zma -m 26' crashed, signal 8	zmdc.pl	
2016-08-16 10:34:27.095720	zmaudit		30463	INF	deleting	zmaudit.pl	
2016-08-16 10:34:26.305470	zmdc		29922	WAR	'zma -m 26' has not stopped at 16/08/16 10:34:26. Sending KILL to pid 18038	zmdc.pl	
2016-08-16 10:34:25.100680	zmaudit		30463	INF	Filesystem event '15/11142' does not exist in database	zmaudit.pl	
2016-08-16 10:34:24.946344	zmc_m27		30315	INF	3J: 9000 - Capturing at 4.74 fps	zm_monitor.cpp	3116
2016-08-16 10:34:23.970409	zmc_m28		30339	INF	3K: 9000 - Capturing at 4.76 fps	zm_monitor.cpp	3116
2016-08-16 10:34:23.928478	zma_m2		10350	INF	3A: 2000 - Analysing at 3.12 fps	zm_monitor.cpp	1287
2016-08-16 10:34:23.846975	zma_m26		18038	INF	3F: 030 - Closing event 12779, shutting down	zm_monitor.cpp	625
2016-08-16 10:34:23.625159	zmc_m20		30132	INF	2B: 9000 - Capturing at 4.67 fps	zm_monitor.cpp	3116
2016-08-16 10:34:22.949058	zmc_m23		30251	INF	2H: 9000 - Capturing at 4.78 fps	zm_monitor.cpp	3116
2016-08-16 10:34:21.976920	zmc_m26		30301	INF	3F: 6000 - Capturing at 3.17 fps	zm_monitor.cpp	3116
2016-08-16 10:34:21.212300	zmaudit		30463	INF	deleting	zmaudit.pl	
2016-08-16 10:34:21.195572	zmc_m34		30435	INF	4B: 9000 - Capturing at 4.83 fps	zm_monitor.cpp	3116
2016-08-16 10:34:20.304677	zma_m26		18038	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 10:34:20.296840	zmaudit		30463	INF	Filesystem event '15/11185' does not exist in database	zmaudit.pl	
2016-08-16 10:34:19.769230	zmdc		29922	INF	'zma -m 26' sending stop to pid 18038 at 16/08/16 10:34:19	zmdc.pl	
2016-08-16 10:34:19.555010	zmaudit		30463	INF	deleting	zmaudit.pl	

[itsalexjones]

So I just caught another crash almost 1 hour and 20 minutes after the one below. Log included in case it helps:

Code: Select all

2016-08-16 11:53:12.578565	zmc_m26		40481	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577928	zmc_m29		40543	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577912	zmc_m15		26612	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577899	zmc_m17		40335	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577850	zmc_m22		40415	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577841	zmc_m30		40557	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577810	zmc_m19		40348	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577780	zmc_m28		40518	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577720	zmc_m32		40586	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577649	zmc_m24		40454	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577590	zmc_m27		40505	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577417	zmc_m35		40641	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577368	zmc_m33		40600	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577326	zmc_m20		40378	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577254	zmc_m3		40285	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577200	zmc_m21		40391	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577148	zmc_m1		17362	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577148	zmc_m16		21948	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577027	zmc_m34		40613	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.577010	zmc_m2		40260	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.576957	zmc_m25		40468	ERR	Unable to get response, disconnecting	zm_remote_camera_http.cpp	1141
2016-08-16 11:53:12.516057	zmc_m26		40481	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.515780	zmc_m29		40543	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.515662	zmc_m17		40335	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.515469	zmc_m15		26612	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.515469	zmc_m22		40415	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.515447	zmc_m19		40348	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.515444	zmc_m30		40557	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.515382	zmc_m32		40586	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.515375	zmc_m28		40518	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.515264	zmc_m24		40454	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.515082	zmc_m35		40641	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.515049	zmc_m27		40505	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.514998	zmc_m33		40600	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.514894	zmc_m20		40378	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.514887	zmc_m3		40285	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.514765	zmc_m21		40391	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.514662	zmc_m16		21948	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.514620	zmc_m1		17362	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.514435	zmc_m2		40260	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.514371	zmc_m34		40613	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.514318	zmc_m25		40468	ERR	Unable to read subheader	zm_remote_camera_http.cpp	977
2016-08-16 11:53:12.495923	zma_m29		40551	INF	3L: 11048 - Closing event 12923, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.494657	zma_m24		40461	INF	2J: 11065 - Closing event 12925, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.492465	zma_m28		40520	INF	3K: 11052 - Closing event 12917, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.466588	zma_m15		40300	INF	2E: 10893 - Closing event 12933, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.464711	zma_m17		11725	INF	2L: 4401 - Closing event 12920, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.464260	zma_m19		40367	INF	2A: 10956 - Closing event 12929, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.464130	zma_m1		21190	INF	2G: 2096 - Closing event 12934, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.463757	zma_m16		40324	INF	2K: 10989 - Closing event 12926, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.459242	zma_m35		40647	INF	4C: 11040 - Closing event 12930, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.452957	zma_m27		40507	INF	3J: 10954 - Closing event 12935, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.452885	zmc_m29		40543	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452797	zmc_m30		40557	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452725	zmc_m28		40518	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452718	zma_m32		40593	INF	3U: 11049 - Closing event 12918, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.452697	zmc_m24		40454	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452696	zmc_m26		40481	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452695	zmc_m19		40348	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452690	zma_m22		40422	INF	2F: 11078 - Closing event 12931, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.452541	zmc_m22		40415	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452532	zmc_m27		40505	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452531	zmc_m17		40335	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452457	zma_m30		40564	INF	3M: 11058 - Closing event 12928, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.452447	zmc_m20		40378	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452423	zmc_m33		40600	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452422	zmc_m15		26612	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452389	zma_m2		14351	INF	3A: 3695 - Closing event 12922, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.452378	zmc_m21		40391	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452374	zma_m33		40602	INF	4A: 11064 - Closing event 12924, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.452348	zma_m23		15035	INF	2H: 3510 - Closing event 12919, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.452319	zmc_m32		40586	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452228	zma_m20		25844	INF	2B: 985 - Closing event 12936, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.452199	zma_m21		22876	INF	2D: 1612 - Closing event 12932, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.452150	zmc_m34		40613	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452140	zmc_m25		40468	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452140	zma_m34		40634	INF	4B: 11118 - Closing event 12921, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.452124	zmc_m35		40641	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452085	zmc_m16		21948	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452084	zma_m25		23636	INF	3E: 1339 - Closing event 12916, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.452084	zmc_m2		40260	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452034	zmc_m3		40285	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452021	zmc_m1		17362	ERR	Select error: Interrupted system call	zm_remote_camera_http.cpp	175
2016-08-16 11:53:12.452014	zma_m26		27443	INF	3F: 380 - Closing event 12937, shutting down	zm_monitor.cpp	625
2016-08-16 11:53:12.234295	zma_m15		40300	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:12.234222	zma_m29		40551	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:12.234220	zma_m28		40520	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:12.234098	zma_m24		40461	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:12.234081	zma_m1		21190	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:12.234056	zma_m35		40647	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:12.234023	zma_m17		11725	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:12.234012	zma_m16		40324	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.817250	zmc_m28		40518	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.817209	zma_m27		40507	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.817129	zma_m32		40593	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.817057	zma_m22		40422	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816995	zmc_m24		40454	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816927	zmc_m26		40481	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816840	zmc_m29		40543	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816801	zmc_m22		40415	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816762	zmc_m19		40348	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816759	zmc_m17		40335	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816728	zmc_m23		40429	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816533	zmc_m15		26612	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816513	zma_m33		40602	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816458	zmc_m30		40557	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816280	zma_m34		40634	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816133	zmc_m35		40641	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816099	zmc_m34		40613	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816077	zmc_m33		40600	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816062	zmc_m32		40586	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816055	zma_m30		40564	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816041	zmc_m25		40468	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816030	zmc_m20		40378	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.816025	zmc_m27		40505	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.815992	zmc_m21		40391	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.815959	zma_m21		22876	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.815938	zmc_m3		40285	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.815928	zma_m19		40367	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.815906	zmc_m1		17362	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.815906	zma_m2		14351	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.815901	zma_m20		25844	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.815895	zma_m26		27443	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.815878	zmc_m2		40260	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.815874	zma_m25		23636	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.815842	zma_m23		15035	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.815833	zmc_m16		21948	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:53:11.723170	zmaudit		40655	INF	Filesystem event '35/10538' does not exist in database	zmaudit.pl	
2016-08-16 11:53:11.528090	zmpkg		29616	INF	Command: stop	zmpkg.pl	
2016-08-16 11:53:11.526230	zmaudit		40655	INF	deleting	zmaudit.pl	
2016-08-16 11:53:11.177100	zmpkg		29616	INF	Sanity checking States table...	zmpkg.pl	
2016-08-16 11:53:11.017500	zmaudit		40655	INF	Filesystem event '35/10176' does not exist in database	zmaudit.pl	
2016-08-16 11:53:10.873630	zmc_m15		26612	WAR	Buffer overrun at index 17, image 1097, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:10.779241	zmc_m27		40505	WAR	Buffer overrun at index 37, image 14087, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:10.777593	zmc_m30		40557	WAR	Buffer overrun at index 22, image 14272, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:10.777341	zmc_m19		40348	WAR	Buffer overrun at index 7, image 14287, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:10.775752	zmc_m28		40518	WAR	Buffer overrun at index 34, image 14284, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:10.775250	zmc_m35		40641	WAR	Buffer overrun at index 44, image 14144, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:10.773082	zmc_m34		40613	WAR	Buffer overrun at index 32, image 14282, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:10.772473	zmc_m22		40415	WAR	Buffer overrun at index 16, image 14166, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:10.769964	zmc_m32		40586	WAR	Buffer overrun at index 45, image 14145, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:10.765120	zma_m27		40507	WAR	Approaching buffer overrun, consider slowing capture, simplifying analysis or increasing ring buffer size	zm_monitor.cpp	1315
2016-08-16 11:53:10.764994	zma_m19		40367	WAR	Approaching buffer overrun, consider slowing capture, simplifying analysis or increasing ring buffer size	zm_monitor.cpp	1315
2016-08-16 11:53:10.764876	zma_m30		40564	WAR	Approaching buffer overrun, consider slowing capture, simplifying analysis or increasing ring buffer size	zm_monitor.cpp	1315
2016-08-16 11:53:10.762272	zma_m34		40634	WAR	Approaching buffer overrun, consider slowing capture, simplifying analysis or increasing ring buffer size	zm_monitor.cpp	1315
2016-08-16 11:53:10.762156	zma_m28		40520	WAR	Approaching buffer overrun, consider slowing capture, simplifying analysis or increasing ring buffer size	zm_monitor.cpp	1315
2016-08-16 11:53:10.760800	zmdc		40166	INF	'zma -m 3' exited normally	zmdc.pl	
2016-08-16 11:53:10.759800	zmc_m3		40285	WAR	Last image read from shared memory 1471344790 seconds ago, zma may have gone away	zm_monitor.cpp	3091
2016-08-16 11:53:09.964169	zmc_m29		40543	WAR	Buffer overrun at index 9, image 14209, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:09.872259	zmc_m20		40378	WAR	Buffer overrun at index 21, image 14341, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:09.247843	zmc_m33		40600	WAR	Buffer overrun at index 35, image 14235, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:09.067762	zmc_m2		40260	WAR	Buffer overrun at index 37, image 14157, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:08.766822	zmc_m15		26612	WAR	Buffer overrun at index 16, image 1096, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:08.567388	zmc_m30		40557	WAR	Buffer overrun at index 21, image 14271, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:08.325862	zmc_m17		40335	WAR	Buffer overrun at index 37, image 14277, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:08.153065	zmc_m28		40518	WAR	Buffer overrun at index 33, image 14283, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:07.955691	zmc_m16		21948	WAR	Buffer overrun at index 13, image 2893, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:07.856074	zmc_m3		40285	WAR	Buffer overrun at index 0, image 14200, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:07.698390	zmc_m23		40429	WAR	Buffer overrun at index 48, image 14148, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:07.300849	zmc_m32		40586	WAR	Buffer overrun at index 44, image 14144, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:07.107256	zmc_m34		40613	WAR	Buffer overrun at index 31, image 14281, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:07.086086	zmc_m27		40505	WAR	Buffer overrun at index 36, image 14086, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:06.820727	zmc_m22		40415	WAR	Buffer overrun at index 14, image 14164, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:05.925380	zmdc		40166	WAR	'zma -m 3' has not stopped at 16/08/16 11:53:05. Sending KILL to pid 29357	zmdc.pl	
2016-08-16 11:53:05.808452	zmc_m19		40348	WAR	Buffer overrun at index 6, image 14286, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:53:05.184611	zmc_m21		40391	INF	2D: 14000 - Capturing at 4.76 fps	zm_monitor.cpp	3116
2016-08-16 11:53:04.344583	zmc_m35		40641	WAR	Buffer overrun at index 43, image 14143, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:52:59.924790	zmaudit		40655	INF	deleting	zmaudit.pl	
2016-08-16 11:52:59.924686	zma_m3		29357	INF	Got signal 15 (Terminated), exiting	zm_signal.cpp	40
2016-08-16 11:52:57.144208	zmc_m25		40468	WAR	Buffer overrun at index 44, image 11744, slow down capture, speed up analysis or increase ring buffer size	zm_monitor.cpp	3085
2016-08-16 11:52:52.556410	zmdc		40166	INF	'zma -m 3' sending stop to pid 29357 at 16/08/16 11:52:52	zmdc.pl	
2016-08-16 11:52:52.480410	zmaudit		40655	INF	Filesystem event '35/10890' does not exist in database	zmaudit.pl	
2016-08-16 11:52:52.138231	zmc_m24		40454	INF	2J: 14000 - Capturing at 4.85 fps	zm_monitor.cpp	3116
2016-08-16 11:52:51.902034	zma_m3		29357	INF	In mode 4/1, warming up	zma.cpp	142
2016-08-16 11:52:51.818491	zma_m29		40551	INF	3L: 11000 - Analysing at 3.41 fps	zm_monitor.cpp	1287
2016-08-16 11:52:51.139010	zmwatch		40660	INF	Restarting analysis daemon for 3B	zmwatch.pl	
2016-08-16 11:52:50.171250	zmdc		29357	INF	'zma -m 3' started at 16/08/16 11:52:50	zmdc.pl	
2016-08-16 11:52:50.170230	zmdc		40166	INF	'zma -m 3' starting at 16/08/16 11:52:50, pid = 29357	zmdc.pl	
2016-08-16 11:52:50.161164	zma_m35		40647	INF	4C: 11000 - Analysing at 3.42 fps	zm_monitor.cpp	1287
2016-08-16 11:52:49.358181	zmc_m15		26612	INF	2E: 1000 - Capturing at 4.78 fps	zm_monitor.cpp	3116
2016-08-16 11:52:48.921957	zma_m32		40593	INF	3U: 11000 - Analysing at 3.45 fps	zm_monitor.cpp	1287
2016-08-16 11:52:48.358720	zma_m28		40520	INF	3K: 11000 - Analysing at 3.41 fps	zm_monitor.cpp	1287
2016-08-16 11:52:47.910573	zmc_m27		40505	INF	3J: 14000 - Capturing at 4.88 fps	zm_monitor.cpp	3116
2016-08-16 11:52:46.987249	zma_m1		21190	INF	2G: 2000 - Analysing at 3.28 fps	zm_monitor.cpp	1287
2016-08-16 11:52:46.937815	zma_m24		40461	INF	2J: 11000 - Analysing at 3.38 fps	zm_monitor.cpp	1287
2016-08-16 11:52:46.908738	zma_m30		40564	INF	3M: 11000 - Analysing at 3.41 fps	zm_monitor.cpp	1287
2016-08-16 11:52:46.897212	zma_m33		40602	INF	4A: 11000 - Analysing at 3.32 fps	zm_monitor.cpp	1287
2016-08-16 11:52:46.227820	zmwatch		40660	ERR	Error getting last capture time for 3B	zmwatch.pl	
2016-08-16 11:52:45.191390	zmaudit		40655	INF	deleting	zmaudit.pl	
2016-08-16 11:52:45.026940	zmdc		40166	INF	Starting pending process, zma -m 3	zmdc.pl	
2016-08-16 11:52:43.454170	zmaudit		40655	INF	Filesystem event '35/10015' does not exist in database	zmaudit.pl	
2016-08-16 11:52:43.162460	zmaudit		40655	INF	deleting	zmaudit.pl	
2016-08-16 11:52:43.135198	zma_m22		40422	INF	2F: 11000 - Analysing at 3.40 fps	zm_monitor.cpp	1287
2016-08-16 11:52:40.011790	zmaudit		40655	INF	Filesystem event '35/11040' does not exist in database	zmaudit.pl	
2016-08-16 11:52:38.300410	zmc_m32		40586	INF	3U: 14000 - Capturing at 4.76 fps	zm_monitor.cpp	3116
2016-08-16 11:52:37.497208	zmc_m2		40260	INF	3A: 14000 - Capturing at 4.74 fps	zm_monitor.cpp	3116
2016-08-16 11:52:37.476827	zmc_m23		40429	INF	2H: 14000 - Capturing at 4.76 fps	zm_monitor.cpp	3116
2016-08-16 11:52:35.765410	zmdc		40166	INF	'zma -m 3' exited normally	zmdc.pl	
2016-08-16 11:52:35.624410	zmaudit		40655	INF	deleting	zmaudit.pl	
2016-08-16 11:52:35.540925	zmc_m35		40641	INF	4C: 14000 - Capturing at 4.69 fps	zm_monitor.cpp	3116

[knight-of-ni]

Do you see all these messages in your logs?

Code: Select all

2016-08-16 11:53:10.873630   zmc_m15      26612   WAR   Buffer overrun at index 17, image 1097, slow down capture, speed up analysis or increase ring buffer size   zm_monitor.cpp   3085
2016-08-16 11:53:10.764876   zma_m30      40564   WAR   Approaching buffer overrun, consider slowing capture, simplifying analysis or increasing ring buffer size   zm_monitor.cpp   1315

This means exactly what it says. You are driving your system too hard, and it cannot keep up.
You need to monitor your system resources and try to determine where the bottle neck is. CPU, disk i/o, and shared memory (/dev/shm) are the usual suspects.

[the_mouse]

I have been having a similar issue as well. I have checked CPU usage, shared memory and disk I/O. Have set logging to debug level and cannot work out why the service's are terminating. I had set cron to reboot every 24 hrs and that worked for a little while but today I only got 30 min before it stopped. I am seeing the same errors as above. I have 12GB ram with shared set to 70% (9.3 GB) and it is as 62%. CPU Utilization sits at about 7% and disk I/O peaking about 8 MB/s so if its hardware being taxed I not sure where.

[the_mouse]

I rechecked and two new cameras I had added I had forgot to up the buffers from 50 to 300 frames (cameras run at 3fps). Hopefully that will let it run for 24 hrs again but still weird how I have to reboot every 24hrs. One thing I did notice was that if I didn't restart the run time got less and less down to 10 mins after a reboot back up to about 27 hrs. I am running Ubuntu server 16.04 with Zoneminder version 1.30, but I did have the same issue on 1.29

[itsalexjones]

Thanks for your help/thoughts. I've managed to get my run time up to about 9 hours by deleting all the analysis zones off my monitors, we weren't using them anyway.
I did increase the image buffer size for each monitor to 80 from 40 or 50 (newer cams were 50, cams that were left over from our old system were 40). This didnt seem to change much, but maybe thats not big enough going by your experience the_mouse.

I also cant see any potential bottlenecks. System load is sitting around 5 (on a 24 core CPU) with 12GB of the 32GB assigned to /dev/shm
The disks are 12K SAS drives in hardware backed RAID5, so I dont see too many issues there.

Maybe I'll try upping the buffer to something bigger and report back. I've also just set cron to restart the service every night as well, so just looking for 24 hours.

Interesting that you're having the same problem with the same distro and software version Mouse.

[the_mouse]

Definitely up the buffers the more the better especially for 720p streams you have the RAM for it. Mine are only 20 x 800x600 @ 3 fps and if I had the buffers lower I would often see the capture speed warning. As I started increasing the buffers the warning got less and less. Now I only see them briefly in the log before zoneminder stops itself, before that the log look really good

[itsalexjones]

Cool, I tried setting them to 500, but ZM didn't like that. So i'm going to try 200 and see how I get on. Interestingly I don't think i've seen a buffer warning aside from just before its crashed. So I need to take a closer look at that.

[the_mouse]

OK it crashed again, 20 mins after CRON did a reboot this morning. If I can't nail this soon will have to look for another software solution as I cant rely on it, would be a shame as I love the way zoneminder works. There were no errors in the log right up to where it crashed and I got the following. I'm getting desperate can anyone suggest anything?

Thanks

Aug 20 04:36:31 Surveillance zmwatch[3260]: INF [Analysis daemon for South-Car-Park needs restarting, time since last analysis 12 seconds (1471624591-1471624579)]
Aug 20 04:36:31 Surveillance zmwatch[3260]: INF [Restarting analysis daemon for South-Car-Park]
Aug 20 04:36:31 Surveillance zmdc[2952]: INF ['zma -m 2' sending stop to pid 6921 at 16/08/20 04:36:31]
Aug 20 04:36:31 Surveillance zma_m2[6921]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:36 Surveillance zma_m2[6921]: INF [South-Car-Park: 206 - Closing event 183850, shutting down]
Aug 20 04:36:37 Surveillance zmdc[2952]: WAR ['zma -m 2' has not stopped at 16/08/20 04:36:37. Sending KILL to pid 6921]
Aug 20 04:36:38 Surveillance zmdc[2952]: INF ['zma -m 2' exited normally]
Aug 20 04:36:38 Surveillance systemd[1]: zoneminder.service: Main process exited, code=exited, status=4/NOPERMISSION
Aug 20 04:36:38 Surveillance zma_m14[3169]: INF [Front-Centre: 5618 - Gone into alert state]
Aug 20 04:36:39 Surveillance zmpkg[6928]: INF [Sanity checking States table...]
Aug 20 04:36:39 Surveillance zmpkg[6928]: INF [Command: stop]
Aug 20 04:36:39 Surveillance systemd[1]: zoneminder.service: Control process exited, code=exited status=1
Aug 20 04:36:39 Surveillance zmc_m2[3106]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m9[3107]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m13[3108]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m6[3122]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m15[3178]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m14[3169]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m16[3183]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m4[6923]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m5[3128]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m8[3280]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m14[3158]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m8[3126]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m15[3168]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m17[3197]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m13[3157]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m3[3112]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m10[3125]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m6[3283]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m3[3290]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m7[3120]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m20[3246]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m9[3289]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m4[3115]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m1[3111]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m20[3239]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m19[3232]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m17[3205]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m10[3286]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m18[3218]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m16[3190]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m5[3288]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m18[3211]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zmc_m19[3225]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m7[6909]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m1[3291]: INF [Got signal 15 (Terminated), exiting]
Aug 20 04:36:39 Surveillance zma_m4[6923]: INF [Trucking-Area: 484 - Closing event 183856, shutting down]
Aug 20 04:36:43 Surveillance zmc_m9[3107]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m16[3183]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m13[3108]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m17[3197]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m5[3128]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m8[3126]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zma_m14[3169]: INF [Front-Centre: 5619 - Closing event 183819, shutting down]
Aug 20 04:36:43 Surveillance zmc_m6[3122]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m2[3106]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m3[3112]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m14[3158]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m15[3168]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m7[3120]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m18[3211]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m20[3239]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m19[3225]: ERR [Select error: Interrupted system call]
Aug 20 04:36:43 Surveillance zmc_m1[3111]: ERR [Select error: Interrupted system call]
Aug 20 04:36:44 Surveillance zmc_m13[3108]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m16[3183]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m17[3197]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m9[3107]: ERR [Unable to read content]
Aug 20 04:36:44 Surveillance zmc_m14[3158]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m8[3126]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m7[3120]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m18[3211]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m15[3168]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m19[3225]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m3[3112]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m5[3128]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m20[3239]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m2[3106]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m6[3122]: ERR [Unable to read subheader]
Aug 20 04:36:44 Surveillance zmc_m1[3111]: ERR [Unable to read subheader]
Aug 20 04:36:45 Surveillance zmc_m13[3108]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m9[3107]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m16[3183]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m18[3211]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m8[3126]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m15[3168]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m17[3197]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m7[3120]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m2[3106]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m1[3111]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m6[3122]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m14[3158]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m19[3225]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m3[3112]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m5[3128]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance zmc_m20[3239]: ERR [Unable to get response, disconnecting]
Aug 20 04:36:45 Surveillance systemd[1]: zoneminder.service: Unit entered failed state.
Aug 20 04:36:45 Surveillance systemd[1]: zoneminder.service: Failed with result 'exit-code'.

[the_mouse]

The only error I see seems to relate to systemd. Unless anyone can suggest anything else I might downgrade to ubuntu server 14.04 and see what happens

[the_mouse]

Reset-up machine with Ubuntu Server 14.04.4 and the issue has gone. Its been running for three days now with exactly the same setting and hardware as before. So there must be an issue running on 16.04.

[bbunge]

Did you by any chance try 16.04 with Mariadb instead of MySQL? Did you run mysqltuner to see what settings you needed to "adjust" in MySQL?