Disk quota exceeded

Forum for questions and support relating to the 1.25.x releases only.
Locked
rangerbob
Posts: 61
Joined: Sat Jun 06, 2009 3:40 am

Disk quota exceeded

Post by rangerbob »

I am running 1.25 on a debian 7 wheezy setup in a openvz container
Everything was fine

one day i could not log in. So I did this mysql trick that cleared the hash for the admin password. that does not seem to work.

I know if I enter a wrong password I just get the main login again.. if I enter the right password (with my othere account i made) it looks like its logging in then back to the login screen

i get these errors in the syslog

Code: Select all

Nov 21 18:05:13 hostname zmdc[22785]: FAT [Can't bind: Disk quota exceeded]
Nov 21 18:05:21 hostname zmdc[22783]: FAT [Can't connect: No such file or directory]
Nov 21 18:09:13 hostname zmdc[22822]: FAT [Can't bind: Disk quota exceeded]
Nov 21 18:09:21 hostname zmdc[22820]: FAT [Can't connect: No such file or directory]
Nov 21 18:13:50 hostname zmdc[22897]: FAT [Can't bind: Disk quota exceeded]
Nov 21 18:13:58 hostname zmdc[22895]: FAT [Can't connect: No such file or directory]
Nov 21 18:30:22 hostname zmdc[22982]: FAT [Can't bind: Disk quota exceeded]
Nov 21 18:30:30 hostname zmdc[22980]: FAT [Can't connect: No such file or directory]
Nov 22 16:30:09 hostname zma_m8[2188]: FAT [Can't mkdir events/8/13/11/22: Disk quota exceeded]
but I have plenty of space so i am unsure. Seems to be capturing fine still on the two cameras I have running.

Code: Select all

Nov 22 18:09:43 hostname zmc_m7[2195]: INF [foscam1: 52000 - Capturing at 5.24 fps]
Filesystem                                              Size  Used Avail Use% Mounted on

/vz/private/1420                                         100G  7.2G   93G   8% /vz/root/1420

It has been working great for a few weeks now or more. now I am locked out.. not sure what to do or what info you want.

please let me know what I should be giving you to help me.
rangerbob
Posts: 61
Joined: Sat Jun 06, 2009 3:40 am

Re: Disk quota exceeded

Post by rangerbob »

i also am getting this smtp error

Code: Select all

Nov 22 18:13:18 hostname nullmailer[1500]: Rescanning queue.
Nov 22 18:13:18 hostname nullmailer[1500]: Starting delivery: protocol: smtp host: mail.madeupnamedomain.com file: 1384324922.4393
Nov 22 18:13:18 hostname nullmailer[1500]: Starting delivery, 2 message(s) in queue.
Nov 22 18:13:18 hostname nullmailer[2638]: smtp: Failed: Connect failed
Nov 22 18:13:18 hostname nullmailer[1500]: Sending failed:  Host not found
Nov 22 18:13:18 hostname nullmailer[1500]: Starting delivery: protocol: smtp host: mail.madeupnamedomain.com file: 1384670524.20735
Nov 22 18:13:18 hostname nullmailer[1500]: Starting delivery, 2 message(s) in queue.
Nov 22 18:13:18 hostname nullmailer[2639]: smtp: Failed: Connect failed
Nov 22 18:13:18 hostname nullmailer[1500]: Sending failed:  Host not found
Nov 22 18:13:18 hostname nullmailer[1500]: Delivery complete, 2 message(s) remain.
so I looked that up

and noted the /var/spool/nullmailer and found a few numbered files so I deleted them and well all of a sudden I can login again.. if anyone can explain that That would be great!
rangerbob
Posts: 61
Joined: Sat Jun 06, 2009 3:40 am

Re: Disk quota exceeded

Post by rangerbob »

i replied too soon, I can login yes but still getting alot of weird errors..

Code: Select all

Nov 22 18:24:14 Hostname zma_m8[2644]: INF [foscam2: 2022 - Gone into alarm state]
Nov 22 18:24:14 Hostname zma_m8[2644]: FAT [Can't mkdir events/8/13/11/22: Disk quota exceeded]
Nov 22 18:24:14 Hostname zmdc[2158]: ERR ['zma -m 8' exited abnormally, exit status 255]
Nov 22 18:24:24 Hostname zmdc[2158]: INF [Starting pending process, zma -m 8]
Nov 22 18:24:24 Hostname zmdc[2158]: INF ['zma -m 8' starting at 13/11/22 18:24:24, pid = 2670]
Nov 22 18:24:24 Hostname zmdc[2670]: INF ['zma -m 8' started at 13/11/22 18:24:24]
Nov 22 18:24:24 Hostname zma_m8[2670]: INF [In mode 3/1, warming up]

Nov 22 18:26:06 Hostname zmaudit[2214]: INF [Database event '8/1873' does not exist in filesystem]
Nov 22 18:26:06 Hostname zmaudit[2214]: INF [deleting]
Nov 22 18:26:06 Hostname zmaudit[2214]: INF [Database event '8/1872' does not exist in filesystem]
Nov 22 18:26:06 Hostname zmaudit[2214]: INF [deleting]
Nov 22 18:26:06 Hostname zmaudit[2214]: INF [Deleted 16 log table entries by time]

2013-11-22 18:23:27.077948	web_php	2241	FAT	SQL-ERR 'Can't create/write to file '/tmp/#sql_78b_0.MYD' (Errcode: 122)', statement was 'select E.Id,E.MonitorId,M.Name As MonitorName,M.Width,M.Height,M.DefaultScale,E.Name,E.Cause,E.Notes,E.StartTime,E.Length,E.Frames,E.AlarmFrames,E.TotScore,E.AvgScor
Last edited by rangerbob on Fri Nov 22, 2013 11:37 pm, edited 2 times in total.
rangerbob
Posts: 61
Joined: Sat Jun 06, 2009 3:40 am

Re: Disk quota exceeded

Post by rangerbob »

I tired to click on events then when it opened up I ran my mouse over the monitor motion alarm lines but no pictures came up as normal.. urgh Anyone klnow what my permissions for things should be? maybe something to do with my mysql since I messed with one hash feild or maybe a restricktion with openvz container..

Code: Select all

Nov 22 18:28:47 Hostname zms[2692]: ERR [Unable to authenticate user]
Nov 22 18:28:47 Hostname zms[2695]: ERR [Unable to authenticate user]
Nov 22 18:28:47 Hostname zms[2697]: ERR [Unable to authenticate user]
Nov 22 18:28:48 Hostname zms[2699]: ERR [Unable to authenticate user]
Nov 22 18:28:48 Hostname zms[2701]: ERR [Unable to authenticate user]
Nov 22 18:28:51 Hostname web_php[1438]: ERR [socket_bind( /tmp/zm/zms-236852w.sock ) failed: Disk quota exceeded]
Nov 22 18:31:29 Hostname web_php[1439]: FAT [SQL-ERR 'Can't create/write to file '/tmp/#sql_78b_0.MYI' (Errcode: 122)', statement was 'select Events.Id as Id, MonitorId, Name, Cause, StartTime, date_format( StartTime, '%y/%m/%d %H:%i:%S' ) as StartTimeShort, EndTime, Width, Height, Length, Frames, AlarmFrames, TotScore, AvgScore, MaxScore, Archived, Videoed, Uploaded, Emailed, Messaged, Executed, Notes, min(Frames.FrameId) as MinFrameId, max(Frames.FrameId) as MaxFrameId, min(Frames.Delta) as MinFrameDelta, max(Frames.Delta) as MaxFrameDelta from Events left join Frames on Events.Id = Frames.EventId where Events.Id = 1812 group by Frames.EventId limit 1']
Nov 22 18:31:29 Hostname web_php[2688]: FAT [SQL-ERR 'Can't create/write to file '/tmp/#sql_78b_0.MYI' (Errcode: 122)', statement was 'select Events.Id as Id, MonitorId, Name, Cause, StartTime, date_format( StartTime, '%y/%m/%d %H:%i:%S' ) as StartTimeShort, EndTime, Width, Height, Length, Frames, AlarmFrames, TotScore, AvgScore, MaxScore, Archived, Videoed, Uploaded, Emailed, Messaged, Executed, Notes, min(Frames.FrameId) as MinFrameId, max(Frames.FrameId) as MaxFrameId, min(Frames.Delta) as MinFrameDelta, max(Frames.Delta) as MaxFrameDelta from Events left join Frames on Events.Id = Frames.EventId where Events.Id = 1815 group by Frames.EventId limit 1']
Nov 22 18:31:30 Hostname web_php[2691]: FAT [SQL-ERR 'Can't create/write to file '/tmp/#sql_78b_0.MYI' (Errcode: 122)', statement was 'select Events.Id as Id, MonitorId, Name, Cause, StartTime, date_format( StartTime, '%y/%m/%d %H:%i:%S' ) as StartTimeShort, EndTime, Width, Height, Length, Frames, AlarmFrames, TotScore, AvgScore, MaxScore, Archived, Videoed, Uploaded, Emailed, Messaged, Executed, Notes, min(Frames.FrameId) as MinFrameId, max(Frames.FrameId) as MaxFrameId, min(Frames.Delta) as MinFrameDelta, max(Frames.Delta) as MaxFrameDelta from Events left join Frames on Events.Id = Frames.EventId where Events.Id = 1817 group by Frames.EventId limit 1']
Nov 22 18:31:30 Hostname web_php[2240]: FAT [SQL-ERR 'Can't create/write to file '/tmp/#sql_78b_0.MYI' (Errcode: 122)', statement was 'select Events.Id as Id, MonitorId, Name, Cause, StartTime, date_format( StartTime, '%y/%m/%d %H:%i:%S' ) as StartTimeShort, EndTime, Width, Height, Length, Frames, AlarmFrames, TotScore, AvgScore, MaxScore, Archived, Videoed, Uploaded, Emailed, Messaged, Executed, Notes, min(Frames.FrameId) as MinFrameId, max(Frames.FrameId) as MaxFrameId, min(Frames.Delta) as MinFrameDelta, max(Frames.Delta) as MaxFrameDelta from Events left join Frames on Events.Id = Frames.EventId where Events.Id = 1818 group by Frames.EventId limit 1']
Nov 22 18:31:30 Hostname web_php[2240]: FAT [SQL-ERR 'Can't create/write to file '/tmp/#sql_78b_0.MYI' (Errcode: 122)', statement was 'select Events.Id as Id, MonitorId, Name, Cause, StartTime, date_format( StartTime, '%y/%m/%d %H:%i:%S' ) as StartTimeShort, EndTime, Width, Height, Length, Frames, AlarmFrames, TotScore, AvgScore, MaxScore, Archived, Videoed, Uploaded, Emailed, Messaged, Executed, Notes, min(Frames.FrameId) as MinFrameId, max(Frames.FrameId) as MaxFrameId, min(Frames.Delta) as MinFrameDelta, max(Frames.Delta) as MaxFrameDelta from Events left join Frames on Events.Id = Frames.EventId where Events.Id = 1819 group by Frames.EventId limit 1']
cat /proc/user_beancounters
shows I am fine nothing exceeding my container limits
rangerbob
Posts: 61
Joined: Sat Jun 06, 2009 3:40 am

Re: Disk quota exceeded

Post by rangerbob »

My mysql seems fine. nothing in mysql.err or mysql.log
a few more errors in syslog

Code: Select all


root@Hostname:/tmp# service zoneminder start
Starting ZoneMinder: failure

root@Hostname:/tmp# cat /var/log/syslog|tail 
Nov 22 23:40:47 Hostname zmdc[2156]: INF ['zmwatch.pl ' stopping at 13/11/22 23:40:47]
Nov 22 23:40:47 Hostname zmdc[2156]: INF ['zmwatch.pl ' exited, signal 14]
Nov 22 23:40:47 Hostname zmdc[2156]: INF ['zmaudit.pl -c' stopping at 13/11/22 23:40:47]
Nov 22 23:40:47 Hostname zmdc[2156]: INF ['zmaudit.pl -c' exited, signal 14]
Nov 22 23:40:57 Hostname zmdc[2156]: INF [Server shutdown at 13/11/22 23:40:57]
Nov 22 23:41:03 Hostname zmpkg[2401]: INF [Command: start]
Nov 22 23:41:04 Hostname zmdc[2419]: INF [Server starting at 13/11/22 23:41:04]
Nov 22 23:41:06 Hostname zmdc[2419]: FAT [Can't bind: Disk quota exceeded]
Nov 22 23:41:14 Hostname zmdc[2417]: FAT [Can't connect: No such file or directory]
Nov 22 23:41:14 Hostname zmpkg[2401]: ERR [Unable to run "su www-data --shell=/bin/sh --command='/usr/bin/zmdc.pl startup'", output is "Starting server"]



i did find some errors in /var/log/apache2/error.log

Code: Select all

[Fri Nov 22 18:45:23 2013] [error] [client 1xx.1x5.xx.x] FAT [SQL-ERR 'Can't create/write to file '/tmp/#sql_78b_0.MYI' (Errcode: 122)', statement was 'select Events.Id as Id, MonitorId, Name, Cause, StartTime, date_format( StartTime, '%y/%m/%d %H:%i:%S' ) as StartTimeShort, EndTime, Width, Height, Length, Frames, AlarmFrames, TotScore, AvgScore, MaxScore, Archived, Videoed, Uploaded, Emailed, Messaged, Executed, Notes, min(Frames.FrameId) as MinFrameId, max(Frames.FrameId) as MaxFrameId, min(Frames.Delta) as MinFrameDelta, max(Frames.Delta) as MaxFrameDelta from Events left join Frames on Events.Id = Frames.EventId where Events.Id = 1802 group by Frames.EventId limit 1'], referer: http://xx5.xx.xx.xx6:81/zm/index.php?view=timeline&filter[terms][0][attr]=DateTime&filter[terms][0][op]=%3E%3D&filter[terms][0][val]=-7+day&filter[terms][1][cnj]=and&filter[terms][1][attr]=MonitorId&filter[terms][1][op]=%3D&filter[terms][1][val]=8
[Fri Nov 22 19:03:59 2013] [notice] caught SIGTERM, shutting down
[Fri Nov 22 19:04:09 2013] [notice] Apache/2.2.22 (Debian) PHP/5.4.4-14+deb7u4 configured -- resuming normal operations
[Fri Nov 22 19:05:28 2013] [error] [client 1xx.1x5.xx.x] FAT [SQL-ERR 'Can't create/write to file '/tmp/#sql_789_0.MYD' (Errcode: 122)', statement was 'select E.Id,E.MonitorId,M.Name As MonitorName,M.Width,M.Height,M.DefaultScale,E.Name,E.Cause,E.Notes,E.StartTime,E.Length,E.Frames,E.AlarmFrames,E.TotScore,E.AvgScore,E.MaxScore,E.Archived from Monitors as M inner join Events as E on (M.Id = E.MonitorId) where 1 and ( E.StartTime >= '2013-11-15 19:05:28' ) order by E.StartTime asc limit 0, 25'], referer: http://xx5.xx.xx.xx6:81/zm/index.php
[Fri Nov 22 19:05:46 2013] [error] [client 1xx.1x5.xx.x] ERR [socket_bind( /tmp/zm/zms-153343w.sock ) failed: Disk quota exceeded], referer: http://xx5.xx.xx.xx6:81/zm/index.php?view=watch&mid=8
[Fri Nov 22 19:06:08 2013] [error] [client 1xx.1x5.xx.x] ERR [socket_bind( /tmp/zm/zms-739411w.sock ) failed: Disk quota exceeded], referer: http://xx5.xx.xx.xx6:81/zm/index.php?view=watch&mid=7

So how do i allow it to get access to the 100GB I have on the drive what the heck
rangerbob
Posts: 61
Joined: Sat Jun 06, 2009 3:40 am

Re: Disk quota exceeded

Post by rangerbob »

In openvz i ran out of inodes. So first I played with adding more space or the numbers because I had plenty. then figured out from openvz that it was openvz inodes.. here are some of the commands i typed hope this helps someone..

for thous of you folks playing with openvz like me

Code: Select all


vzctl set 1420 --diskspace 80000000000:95000000000 --save
vzctl set 1420 --diskinodes 400000:440000 --save


root@Hostname:~# vzctl set 1420 --diskspace 70000000000:80000000000 --save
CT configuration saved to /etc/vz/conf/1420.conf

learn more by going here
http://forum.openvz.org/index.php?t=msg&goto=37503&

root@Hostname:~# cat /proc/vz/vzquota
qid: path            usage      softlimit      hardlimit       time     expire
1420: /vz/private/1420
  1k-blocks        7527008    70000000000    80000000000          0          0
     inodes         200000         200000         1420000 1385168985          0
root@Hostname:~# vzctl set 1420 --diskinodes 400000:440000 --save
CT configuration saved to /etc/vz/conf/1420.conf
root@Hostname:~# cat /proc/vz/vzquota
qid: path            usage      softlimit      hardlimit       time     expire
1420: /vz/private/1420
  1k-blocks        7527008    70000000000    80000000000          0          0
     inodes         200000         400000         440000 1385168985          0
root@Hostname:~# vzctl set 1420 --diskspace 80G:95G --save
CT configuration saved to /etc/vz/conf/1420.conf


root@Hostname:/var/log/apache2# service zoneminder start
Starting ZoneMinder: success

root@Hostname:/var/log/apache2# cat /var/log/syslog|tail 
Nov 23 00:22:25 Hostname zmdc[2550]: INF ['zmaudit.pl -c' starting at 13/11/23 00:22:25, pid = 2603]
Nov 23 00:22:25 Hostname zmdc[2603]: INF ['zmaudit.pl -c' started at 13/11/23 00:22:25]
Nov 23 00:22:25 Hostname zmfilter[2598]: INF [Scanning for events]
Nov 23 00:22:25 Hostname zmdc[2550]: INF ['zmwatch.pl' starting at 13/11/23 00:22:25, pid = 2611]
Nov 23 00:22:25 Hostname zmdc[2611]: INF ['zmwatch.pl' started at 13/11/23 00:22:25]
Nov 23 00:22:25 Hostname zmaudit[2603]: INF [Deleted 58 log table entries by time]
Nov 23 00:22:25 Hostname zmwatch[2611]: INF [Watchdog starting]
Nov 23 00:22:25 Hostname zmwatch[2611]: INF [Watchdog pausing for 30 seconds]
Nov 23 00:22:25 Hostname zma_m8[2579]: INF [In mode 3/1, warming up]
Nov 23 00:22:26 Hostname zma_m7[2591]: INF [In mode 3/1, warming up]
root@Hostname:/var/log/apache2# df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/simfs      125G  7.2G  111G   7% /
tmpfs           196M   40K  196M   1% /run
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           1.2G   71M  1.2G   6% /run/shm
root@Hostname:/var/log/apache2# df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/simfs       80G  7.2G   73G   9% /
tmpfs           196M   40K  196M   1% /run
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           1.2G   71M  1.2G   6% /run/shm
root@Hostname:/var/log/apache2# 
Locked