mysqld error causing server hang

[coolemail]

Today httpd was not working, but I had root access. I did killall-9 httpd and then restarted httpd. That was OK but most websites would not display complete pages.

I could not get onto ASL:

Warning: mysql_connect() [function.mysql-connect]: Too many connections in /var/asl/www/index.php on line 23
Couldn't get a db connection. Sorry!

Looking at the status of other key programmes, I saw:

Starting SWsoft control panels server... stale pidfile. sta[FAILED]le.

so I tried to restart mysqld which failed:

service mysqld restart
Stopping MySQL: [ OK ]
Timeout error occurred trying to start MySQL Daemon.
Starting MySQL: [FAILED]

I then thought that the quickest and simplest thing to do would be to reboot the server. It had to be manually rebooted in the datacentre. I am now back on with SSH. Mailman was not running so I tried to restart that and got something very strange:

service mailman start
Starting mailman: Traceback (most recent call last):
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
File "/usr/lib/mailman/bin/mailmanctl", line 607, in ?
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
main()
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
File "/usr/lib/mailman/bin/mailmanctl", line 449, in main
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
lock = acquire_lock(force)
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
File "/usr/lib/mailman/bin/mailmanctl", line 263, in acquire_lock
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
lock = acquire_lock_1(force)
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
File "/usr/lib/mailman/bin/mailmanctl", line 248, in acquire_lock_1
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
lock.lock(0.1)
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
File "/usr/lib/mailman/Mailman/LockFile.py", line 243, in lock
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
self.__write()
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
File "/usr/lib/mailman/Mailman/LockFile.py", line 424, in __write
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
fp.close()
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
IOError: [Errno 28] No space left on device
Logging error: <StampedLogger to '/var/log/mailman/error'>
Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Logging/Logger.py", line 92, in write
f.write(msg)
File "/usr/lib64/python2.4/codecs.py", line 501, in write
return self.writer.write(data)
File "/usr/lib64/python2.4/codecs.py", line 179, in write
self.stream.write(data)
IOError: [Errno 28] No space left on device
Original log message:
[Errno 28] No space left on device
[FAILED]

top shows the following (does mysqld_safe help pinpoint the issue?):

top
top - 09:35:04 up 9 min, 1 user, load average: 1.08, 1.37, 0.92
Tasks: 199 total, 2 running, 185 sleeping, 0 stopped, 12 zombie
Cpu(s): 26.1%us, 11.7%sy, 0.0%ni, 57.6%id, 4.3%wa, 0.0%hi, 0.2%si, 0.0%st
Mem: 6121540k total, 1716428k used, 4405112k free, 180056k buffers
Swap: 2031608k total, 0k used, 2031608k free, 501236k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
26053 root 20 0 67140 2584 1168 S 29.6 0.0 1:00.50 mysqld_safe
9331 apache 20 0 505m 192m 3880 S 2.7 3.2 0:01.36 httpd
9993 apache 20 0 505m 192m 3816 S 2.3 3.2 0:01.26 httpd
27356 qscand 20 0 0 0 0 Z 2.0 0.0 0:00.06 perl5.8.8 <defunct>
25727 root 20 0 103m 8712 1108 S 1.3 0.1 0:00.26 psmon
21664 ossec 20 0 24412 2876 792 S 1.0 0.0 0:18.92 ossec-analysisd
9399 apache 20 0 504m 191m 4160 S 0.7 3.2 0:01.44 httpd
111 root 20 0 0 0 0 S 0.3 0.0 0:00.37 kjournald
2760 root 20 0 5956 632 504 S 0.3 0.0 0:00.13 syslogd
9327 apache 20 0 504m 191m 3844 S 0.3 3.2 0:01.47 httpd
9328 apache 20 0 504m 191m 4572 S 0.3 3.2 0:01.27 httpd
22549 root 20 0 171m 10m 6956 S 0.3 0.2 0:00.07 sw-engine
22550 root 20 0 83936 3176 2368 S 0.3 0.1 0:00.12 monit
25757 sw-cp-se 20 0 59564 2548 1324 S 0.3 0.0 0:00.02 sw-cp-serverd
25785 sso 20 0 121m 8116 5292 S 0.3 0.1 0:00.23 sw-engine-cgi
1 root 20 0 10364 760 632 S 0.0 0.0 0:00.69 init
2 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kthreadd
3 root RT 0 0 0 0 S 0.0 0.0 0:00.02 migration/0
4 root 20 0 0 0 0 S 0.0 0.0 0:00.20 ksoftirqd/0
5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 watchdog/0
6 root RT 0 0 0 0 S 0.0 0.0 0:00.04 migration/1
7 root 20 0 0 0 0 S 0.0 0.0 0:00.22 ksoftirqd/1
8 root RT 0 0 0 0 S 0.0 0.0 0:00.00 watchdog/1
9 root RT 0 0 0 0 S 0.0 0.0 0:00.02 migration/2
10 root 20 0 0 0 0 S 0.0 0.0 0:00.21 ksoftirqd/2
11 root RT 0 0 0 0 S 0.0 0.0 0:00.00 watchdog/2
12 root RT 0 0 0 0 S 0.0 0.0 0:00.04 migration/3
13 root 20 0 0 0 0 S 0.0 0.0 0:00.24 ksoftirqd/3
14 root RT 0 0 0 0 S 0.0 0.0 0:00.00 watchdog/3
15 root 20 0 0 0 0 S 0.0 0.0 0:00.20 events/0
16 root 20 0 0 0 0 S 0.0 0.0 0:00.00 events/1
17 root 20 0 0 0 0 S 0.0 0.0 0:00.00 events/2
18 root 20 0 0 0 0 S 0.0 0.0 0:00.00 events/3
19 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuset
20 root 20 0 0 0 0 S 0.0 0.0 0:00.00 khelper
21 root 20 0 0 0 0 S 0.0 0.0 0:00.00 netns
22 root 20 0 0 0 0 S 0.0 0.0 0:00.00 async/mgr
23 root 20 0 0 0 0 S 0.0 0.0 0:00.00 pm
24 root 20 0 0 0 0 S 0.0 0.0 0:00.00 sync_supers
25 root 20 0 0 0 0 S 0.0 0.0 0:00.00 bdi-default
[plesk2.expat-email.co.uk ~]#

Can someone help please? Many thanks, as ever, in advance.

[coolemail]

Could something have caused the disk to fill up? It looks like it from the df command below - can I easily find out what temp stuff can be deleted?

# df
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
235364944 232076352 0 100% /
/dev/sda1 101086 55846 40021 59% /boot
tmpfs 3060768 0 3060768 0% /dev/shm
tmpfs 3060768 0 3060768 0% /usr/local/psa/handlers/before-local
tmpfs 3060768 0 3060768 0% /usr/local/psa/handlers/before-queue
tmpfs 3060768 0 3060768 0% /usr/local/psa/handlers/before-remote
tmpfs 3060768 448 3060320 1% /usr/local/psa/handlers/info
tmpfs 3060768 0 3060768 0% /usr/local/psa/handlers/spool

can someone tell me where the web applications are stored on the server and this might help me to delete some of those and create space that way to see if it helps.

httpd error log has things like:

[Sun Oct 31 09:32:58 2010] [warn] Init: SSL server IP/port conflict: uploads.hosted-domain.com:443 (/var/www/vhosts/uploads.hosted-domain.com/conf/httpd.include:12) vs. default-82-197-79-6:443 (/etc/httpd/conf.d/zz010_psa_httpd.conf:190)
[Sun Oct 31 09:32:58 2010] [warn] Init: You should not use name-based virtual hosts in conjunction with SSL!!
[Sun Oct 31 09:32:58 2010] [notice] mod_python: Creating 4 session mutexes based on 60 max processes and 0 max threads.
[Sun Oct 31 09:32:59 2010] [notice] Apache configured -- resuming normal operations
qmail-inject: fatal: qq temporary problem (#4.3.0)
qmail-inject: fatal: qq temporary problem (#4.3.0)
qmail-inject: fatal: qq temporary problem (#4.3.0)

if that helps??

and maillog showing things like:

Oct 31 09:52:36 plesk2 X-Qmail-Scanner-2.08st: [plesk2.hostname.co.uk128851875679018492] /var/spool/qscan/tmp/plesk2.hostname.co.uk128851875679018492 access denied/file exists - try again later...
Oct 31 09:52:37 plesk2 qmail: 1288518757.899850 alert: unable to append to bounce message; HELP! sleeping...

[breun]

Yes, your disk has filled up, which will cause all kinds of services to fail. See grep HTTPD_VHOSTS_D /etc/psa/psa.conf for the location of the websites. I'd start running du -sh * in various places to find out what has eaten your disk usage. Usually it's not a website (it could be though), but a logfile or something. Could be anything really.

I guess you don't have ncdu installed? If not, you probably don't have the disk space to install it now, but if you can make a little space, you should be.

[coolemail]

thanks for the response breun.

On freeing up disc space, I was thinking of freeing up space by deleting some of the Plesk installed repository of web applications that are not being used by any wesbites but which are taking disc space. Do you know where they are? I do not want to go into each website individually because I guess it would only show there if they have installed it?

looks like I have ncdu - can you tell me what I should run to get the output needed?

grep HTTPD_VHOSTS_D /etc/psa/psa.conf
HTTPD_VHOSTS_D /var/www/vhosts
[plesk2.hostname.co.uk ~]# locate ncdu
/usr/bin/ncdu
/usr/share/doc/ncdu-1.5
/usr/share/doc/ncdu-1.5/AUTHORS
/usr/share/doc/ncdu-1.5/COPYING
/usr/share/doc/ncdu-1.5/ChangeLog
/usr/share/doc/ncdu-1.5/TODO
/usr/share/man/man1/ncdu.1.gz

On Friday we had 50GB of disc space free so something strange has happened since then. Any easy way to find out what?

EDIT. I think I found the web apps repository:

# ls /usr/local/psa/var/cgitory
AdvancedPoll-2.03-37 gtchat-0.93-30 moodle-1.8-29 phpmyvisites-2.3-28 TUTOS-1.88-38
anyinventory-2.0-28 Help Center Live-2.1.5-2 movabletype-4.0-15 PHProjekt-5.2-8 typo3-4.0-20
articlepublisher-1.0-9 H.H.G. multistore CE-4.1.4294-2 myorgbook-2.8-27 phpsurveyor-0.98-43 UebiMiau-2.7.8-37
AutoIndex-2.2.4-2 iScripts EasyBiller-1.0-1 noahclass-1.3-55 phpwebsite-0.10.2-35 vivvocms-4.0.0-7
avactis-1.8.1-8 iScripts EasySnaps-2.0-1 nucleus-3.21-32 phpWiki-1.3.11-43 WebCalendar-1.0.5-10
b2evolution-0.9.0.12-30 iScripts Eswap-1.0-2 OneBiz Suite-8.0-1 PinnacleCart-3.5.2-597 WebCalendar-1.2.0-4
BBClone-0.4.9-3 iScripts Multicart-2.0-1 openbiblio-0.5-47 pLog-1.0-36 WebShopmanager-2.0-31
BBClone-0.49-5 iScripts SocialWare-1.0-1 osCommerce-2.2ms2-61 pmachinefree-2.4-35 WordPress-2.3.3-5
brim-2.0.0-31 joomla-1.0.15-7 osCommerce-2.2rc2a-6 PostNuke-0.761a-56 WordPress-2.8.4-3
Coppermine-1.4.16-2 joomla-1.5.13-10 osTicket-1.3.0-33 ray-3.0.0-12 WordPress-2.9.1-1.2
CS-Cart-1.3.5-12 joomla-1.5.15-2 osTicket-1.6.4-6 serendipity-1.1.2-30 WordPress-2.9.2-6
CSLH-2.14.5-2 joomla-1.5.18-2 Owl-0.80-36 Siteframe-3.2.2-29 WordPress-3.0-3
cubecart-4.2.0-2 joomla-1.5.20-1 OXID eShop Professional Edition-4.4.3-1 smf-1.1.2-33 X-Cart-4.3.2-5
DocFAQ-1.71-37 KnowledgeTreeOSS-3.4.5-8 phpAds-2.0.8-35 SSM-1.0-37 xoops-2.2-48
dolphin-6.0.0-10 magento-1.4.1.1-4 phpBB-3.0.4-4 SugarCRM-5.0.0-12 xrms-1.19-31
Drupal-6.1-3 mailer-6.3-4 phpBook-1.50-32 SugarCRMPro-5.0.0-2 xtcommerce-3.0.4-10
eGroupWare-1.4.002-12 Mambo-4.6.2-15 phpBugTracker-1.19-38 supportcenter-2.5.2-8 Zen Cart-1.3.9d-9
EmuWebMail-7.0.1-7 mantis-1.1.1-3 phpDig-1.85-31 SupportPRO SupportDesk-3.0-1
gallery-2.2-17 mediawiki-1.11.0-9 phpMoney-1.3-43 Tellme-1.2-27
geeklog-1.4.1-3 merchant-5.3-30 phpMyFamily-1.4.1-34 tikiwiki-1.9.7-39

which would you delete frist?

[breun]

thanks for the response breun.

On freeing up disc space, I was thinking of freeing up space by deleting some of the Plesk installed repository of web applications that are not being used by any wesbites but which are taking disc space. Do you know where they are? I do not want to go into each website individually because I guess it would only show there if they have installed it?

looks like I have ncdu - can you tell me what I should run to get the output needed?

On Friday we had 50GB of disc space free so something strange has happened since then. Any easy way to find out what?

Ideally you'd want to run ncdu on / so you can browse the full filesystem looking for the culprit, but it'll likely take ncdu a pretty long time to index all of your files, so it might make sense to start with a few more specific directories. ncdu takes a directory as an argument (or indexes the current working directory if you specify no directory).

If you suspect a website has filled up your disk, check if there are exceptionally large directories in /var/www/vhosts. If you don't find anything strange there, you could move up to for instance /var. Or maybe /tmp got filled up. You'll just have to dig around a bit. I'd just go over all the top-level directories in order of where you suspect the new data to be. Or just go over them in random order if you have no idea.

[coolemail]

please confirm that I am OK getting rid of one programme with teh recursive command like:

rm -r /usr/local/psa/var/cgitory/CS-Cart-1.3.5-12

and that that will not completely delete everything on my server!!

only 34GB in /var/www/vhosts
114GB in /var
using

Code: Select all

# cd /var
# du -h | tail -n 1

can I list all files with a datestamp of 30-31 Oct, for example? That should show up what has changed since Friday. Or list files in /var which are greater than a certain size?

[breun]

please confirm that I am OK getting rid of one programme with teh recursive command like:

rm -r /usr/local/psa/var/cgitory/CS-Cart-1.3.5-12

and that that will not completely delete everything on my server!!

That will do what you want if that's really what you want to remove. I'd add -f for good measure, or I believe you'll be asked to individually confirm the removal of each file.

only 34GB in /var/www/vhosts
114GB in /var
using

Code: Select all

# cd /var
# du -h | tail -n 1

can I list all files with a datestamp of 30-31 Oct, for example? That should show up what has changed since Friday. Or list files in /var which are greater than a certain size?

There's all kinds of magic you can perform with commands like find, but I recommend just running ncdu /var and browsing around there to find the large dirs/files. Everything is automatically sorted by size, so that's just what you need.

[coolemail]

I found a monthly backup file:
/home/monthlybackups/oct/dumps/monthly_info_1010010247.xml.tar which was 31GB and deleted that, but server was still reporting full

found a great command:

Code: Select all

find /var -type f -size +200000k -exec ls -lh {} \; | awk '{ print $9 ": " $5 }'

where /var is where to look and +200000k is the file size to look for.

This listed two files and I'm fairly confident that I should be able to delete these, should I not?

/var/lib/psa/dumps/monthly_info_1010310230.xml.tar: 32G
/var/lib/psa/dumps/domains/uploads.hosted-domain.com/monthly_uploads.hosted-domain.com_vhost_1010310230.tgz: 25G

and I will run the ncdu. Thank you for that tip breun. At least I have freed up enough space for the server to be running as normal. Now just to get the husbandry sorted!

[breun]

I don't do local backups through Plesk myself, but yeah, I guess you could delete those files. Or you could delete them through Plesk's Backup Manager I guess.

[coolemail]

ncdu is awesome - I got to where loads of space is being used (/var/lib/psa/dumps is using 67.2GB):

ncdu 1.5 ~ Use the arrow keys to navigate, press ? for help
--- /var/lib/psa/dumps --------------------------------------------------------------------------------------------------------------------------------------------------
/..
24.8GB /domains
10.2GB /clients
459.2MB /resellers
24.0kB /.discovered
e 4.0kB /tmp
31.3GB monthly_info_1010310230.xml.tar
17.0MB monthly_sapp-distrib.4567-90_1010310230.tgz
17.0MB monthly_sapp-distrib.4567-63_1010310230.tgz
16.9MB monthly_sapp-distrib.4567-88_1010310230.tgz
15.9MB monthly_sapp-distrib.4567-87_1010310230.tgz
14.0MB monthly_sapp-distrib.4567-51_1010310230.tgz
13.7MB monthly_sapp-distrib.4567-67_1010310230.tgz
13.5MB monthly_sapp-distrib.4567-3_1010310230.tgz
11.6MB monthly_sapp-distrib.4567-28_1010310230.tgz
11.0MB monthly_sapp-distrib.4567-47_1010310230.tgz
9.2MB monthly_sapp-distrib.4567-12_1010310230.tgz
8.7MB monthly_sapp-distrib.4567-54_1010310230.tgz
8.4MB monthly_sapp-distrib.4567-69_1010310230.tgz
7.9MB monthly_sapp-distrib.4567-32_1010310230.tgz
7.8MB monthly_sapp-distrib.4567-13_1010310230.tgz
7.3MB monthly_sapp-distrib.4567-8_1010310230.tgz
7.2MB monthly_sapp-distrib.4567-92_1010310230.tgz
7.2MB monthly_sapp-distrib.4567-84_1010310230.tgz
7.0MB monthly_sapp-distrib.4567-82_1010310230.tgz
6.5MB monthly_sapp-distrib.4567-78_1010310230.tgz
5.2MB monthly_sapp-distrib.4567-30_1010310230.tgz
5.1MB monthly_sapp-distrib.4567-4_1010310230.tgz
5.1MB monthly_sapp-distrib.4567-73_1010310230.tgz
5.1MB monthly_sapp-distrib.4567-91_1010310230.tgz
4.8MB monthly_sapp-distrib.4567-58_1010310230.tgz
4.6MB monthly_sapp-distrib.4567-62_1010310230.tgz
4.2MB monthly_sapp-distrib.4567-46_1010310230.tgz
4.1MB monthly_sapp-distrib.4567-23_1010310230.tgz
4.1MB monthly_sapp-distrib.4567-85_1010310230.tgz
4.1MB monthly_sapp-distrib.4567-14_1010310230.tgz
4.0MB monthly_sapp-distrib.4567-40_1010310230.tgz
4.0MB monthly_sapp-distrib.4567-7_1010310230.tgz
3.9MB monthly_sapp-distrib.4567-26_1010310230.tgz
3.8MB monthly_sapp-distrib.4567-34_1010310230.tgz
3.7MB monthly_info_1010310230.xml
3.7MB monthly_sapp-distrib.4567-83_1010310230.tgz
3.7MB monthly_sapp-distrib.4567-93_1010310230.tgz
3.6MB monthly_sapp-distrib.4567-1_1010310230.tgz
Total disk usage: 67.2GB Apparent size: 67.1GB Items: 2097

[breun]

ncdu is awesome

I hate to say I told you so.

[coolemail]

I'm really grateful to you for your help, as ever. THANK YOU.

[coolemail]

I'm getting lots of these in maillog - can you help me drill deeper to find out what is triggering it and what it is trying to tell me:

Oct 31 13:00:57 plesk2 qmail-local-handlers[17347]: from=
Oct 31 13:00:57 plesk2 qmail-local-handlers[17347]: to=root@plesk2.hostname.co.uk
Oct 31 13:00:57 plesk2 qmail-local-handlers[17347]: mailbox: /var/qmail/mailnames/plesk2.hostname.co.uk/root
Oct 31 13:00:57 plesk2 qmail-local-handlers[17347]: hook_dir = '/usr/local/psa/handlers/before-local'
Oct 31 13:00:57 plesk2 qmail-local-handlers[17347]: recipient[3] = 'root@plesk2.hostname.co.uk'
Oct 31 13:00:57 plesk2 qmail-local-handlers[17347]: handlers dir = '/usr/local/psa/handlers/before-local/recipient/root@plesk2.hostname.co.uk'
Oct 31 13:00:57 plesk2 qmail: 1288530057.419092 delivery 2039: deferral: ./Maildir/tmp/1288530057.M418478P17352.plesk2.hostname.co.uk,S=2406:_Permission_denied/
Oct 31 13:00:57 plesk2 qmail: 1288530057.419155 status: local 1/10 remote 0/20

[mneese77]

I haven't read every thing about this issue and the progress, but this will give you some feedback on file sizes that are large...

Code: Select all

find / -type f -size +20000k -exec ls -lh {} \; 2> /dev/null | awk '{ print $NF ": " $5 }'

and you can change the file size query as needed....

[coolemail]

thank you for your comment mneese77. I did find that command in my nightmare yesterday and put it in a post above in case it might help others, but you should try the ncdu command - it is even better imho