clamd & spamd dying

[Thought_Memory]

I installed qmail-scanner from the art repositories a couple of weeks ago, everythings been running fine, up until a few days ago ....

Now clamd & spamd are dying, I'm getting the odd 'kernel out of memory error' in the system logs, and sometimes other processes (httpd, mysql) being killed to free up memory.

The machine has 512Mb of memory, there's around 25-30 domains on there, email load is fairly low.

It's getting to be a bit of a pain as I'm having to check the machine several times a day to make sure the processes are still running, and if not to make sure nothing else has died also ....

Any ideas anyone?

[Thought_Memory]

hmmm perhaps this will add some info, I caught this just before the kernel started killing processes off to free up memory:

Code: Select all

 13:46:53  up  3:18,  3 users,  load average: 304.79, 191.40, 91.23
727 processes: 722 sleeping, 5 running, 0 zombie, 0 stopped
CPU states:   0.5% user   6.2% system   0.0% nice   0.0% iowait  93.2% idle
Mem:   505708k av,  500392k used,    5316k free,       0k shrd,     412k buff
                    433584k actv,   12528k in_d,   10504k in_c
Swap:  787176k av,  786924k used,     252k free                    6504k cached

  PID USER     PRI  NI  SIZE  RSS SHARE STAT %CPU %MEM   TIME CPU COMMAND
 4893 root      15   0 28052 4952     8 D     0.0  0.9   0:05   0 spamd
 7358 root      15   0  5512 4840    80 D     0.0  0.9   0:01   0 mrtg
 4897 qmailq    15   0 28112 4692    68 D     0.0  0.9   0:00   0 spamd
 7341 root      15   0  5436 4432     8 D     0.0  0.8   0:01   0 mrtg
 7221 qmailq    15   0  4384 4228   732 S     0.0  0.8   0:00   0 qmail-scanner
 4896 qmailq    15   0 28116 4216    76 D     0.0  0.8   0:00   0 spamd
 7116 qmailq    15   0  4132 3776   492 S     0.0  0.7   0:00   0 qmail-scanner
 7158 qmailq    15   0  3948 3760   300 S     0.0  0.7   0:00   0 qmail-scanner
 7235 qmailq    15   0  4048 3756   396 D     0.0  0.7   0:00   0 qmail-scanner
 7298 qmailq    15   0  4100 3648   452 D     0.0  0.7   0:00   0 qmail-scanner
 6876 qmailq    15   0  3840 3616   208 S     0.0  0.7   0:00   0 qmail-scanner
 6742 qmailq    15   0  3716 3584    96 S     0.0  0.7   0:00   0 qmail-scanner
 6581 qmailq    16   0  3708 3576    96 S     0.0  0.7   0:00   0 qmail-scanner
 6595 qmailq    15   0  3880 3568   268 S     0.0  0.7   0:00   0 qmail-scanner
 6992 qmailq    15   0  4000 3544   368 D     0.0  0.7   0:00   0 qmail-scanner
 7024 qmailq    15   0  4000 3544   364 D     0.0  0.7   0:00   0 qmail-scanner
 6735 qmailq    16   0  3876 3528   256 S     0.0  0.6   0:00   0 qmail-scanner
 6532 qmailq    16   0  3700 3492   100 S     0.0  0.6   0:00   0 qmail-scanner
 6706 qmailq    15   0  3852 3480   232 D     0.0  0.6   0:00   0 qmail-scanner
 6813 qmailq    15   0  3988 3480   364 S     0.0  0.6   0:00   0 qmail-scanner
 7277 qmailq    15   0  3812 3476   156 D     0.0  0.6   0:00   0 qmail-scanner
 6771 qmailq    15   0  3832 3456   208 S     0.0  0.6   0:00   0 qmail-scanner
 7186 qmailq    15   0  3816 3448   172 S     0.0  0.6   0:00   0 qmail-scanner
 6518 qmailq    15   0  3860 3444   252 D     0.0  0.6   0:00   0 qmail-scanner
 6699 qmailq    15   0  3896 3392   272 S     0.0  0.6   0:00   0 qmail-scanner
 7193 qmailq    15   0  3864 3376   208 D     0.0  0.6   0:00   0 qmail-scanner
 6727 qmailq    16   0  3720 3368    96 S     0.0  0.6   0:00   0 qmail-scanner
 7305 qmailq    15   0  3924 3352   272 D     0.0  0.6   0:00   0 qmail-scanner
 7179 qmailq    15   0  3868 3348   220 D     0.0  0.6   0:00   0 qmail-scanner
 6756 qmailq    15   0  3852 3312   228 D     0.0  0.6   0:00   0 qmail-scanner
 6560 qmailq    15   0  3856 3304   240 D     0.0  0.6   0:00   0 qmail-scanner
 7091 qmailq    15   0  3864 3304   232 D     0.0  0.6   0:00   0 qmail-scanner
 6609 qmailq    15   0  3776 3300   160 S     0.0  0.6   0:00   0 qmail-scanner
 7003 qmailq    15   0  3892 3292   256 D     0.0  0.6   0:00   0 qmail-scanner
 7270 qmailq    15   0  3848 3288   192 D     0.0  0.6   0:00   0 qmail-scanner
 6574 qmailq    15   0  3720 3284   104 D     0.0  0.6   0:00   0 qmail-scanner
 6649 qmailq    15   0  3660 3272    48 D     0.0  0.6   0:00   0 qmail-scanner
 7263 qmailq    15   0  3828 3268   180 D     0.0  0.6   0:00   0 qmail-scanner
 6720 qmailq    16   0  3868 3260   248 S     0.0  0.6   0:00   0 qmail-scanner
 7031 qmailq    15   0  3828 3248   192 D     0.0  0.6   0:00   0 qmail-scanner
 6978 qmailq    15   0  3848 3240   212 D     0.0  0.6   0:00   0 qmail-scanner
 6468 qmailq    15   0  3880 3224   276 D     0.0  0.6   0:00   0 qmail-scanner
 6546 qmailq    16   0  3704 3224    96 S     0.0  0.6   0:00   0 qmail-scanner
 6806 qmailq    15   0  3840 3224   212 D     0.0  0.6   0:00   0 qmail-scanner
 6785 qmailq    15   0  3788 3212   160 S     0.0  0.6   0:00   0 qmail-scanner
 6964 qmailq    15   0  4240 3212   600 D     0.0  0.6   0:00   0 qmail-scanner
 6691 qmailq    15   0  3876 3200   252 D     0.0  0.6   0:00   0 qmail-scanner
 6503 qmailq    15   0  3708 3192    96 S     0.0  0.6   0:00   0 qmail-scanner
 6656 qmailq    16   0  3776 3152   156 S     0.0  0.6   0:00   0 qmail-scanner
 6567 qmailq    15   0  3648 3148    36 D     0.0  0.6   0:00   0 qmail-scanner
 6616 qmailq    15   0  3644 3124    36 D     0.0  0.6   0:00   0 qmail-scanner
 7284 qmailq    15   0  3796 3124   140 D     0.0  0.6   0:00   0 qmail-scanner
 6827 qmailq    15   0  3848 3120   216 S     0.0  0.6   0:00   0 qmail-scanner
 6971 qmailq    15   0  3792 3088   156 D     0.0  0.6   0:00   0 qmail-scanner

[scott]

what do /var/qmail/bin/qmail-queue and /var/qmail/bin/qmail-queue.orig look like?

[Thought_Memory]

I uninstalled qmail-scanner last thursday as it was just causing so many problems .....

I'll re-install now to see if it still has problems.

Prior to install of qmail-scanner, this is the status of qmail-queue:

Code: Select all

-r-s--x--x    1 qmailq   qmail       14808 Aug 24 07:25 qmail-queue

After install:

Code: Select all

-rwsr-sr-x    1 qmailq   qmail        4464 Dec 19 09:01 qmail-queue
-r-s--x--x    1 qmailq   qmail       14808 Aug 24 07:25 qmail-queue.orig

I should know in a few hours whether the problems still there .....

[scott]

Right, thats expected, in order to run qmail-scanner without tcpserver in the mix, I had to create a wrapper around the original binary. (Side note, drweb does the same thing, which is why they arent compatible).

It could be that you've just got a lot of mail going through your system

[marcos]

I had the same problem so that i need to remove it from the system.

Everything was working fine just befor my last system update.

I update to psa7.4.5 and other related packages.

Maybe is there some compatiblity issue?

My queue was empy but i also had a lot of qmail-scanner process.

[scott]

If drweb is in there, then yes absolutely there will be compatibility issues.

[jjjheimer]

I have a machine that is experiencing this exact problem - did you ever find a solution to the spawning of the scanner perl scripts? Mail is being processed in a loop in my case - according to the qmail log.

[Thought_Memory]

After removal and reinstallation everythings been working fine. Not had any problems in the last few weeks.

The only difference I have noticed is that clam has stopped picking out the phishing emails for some reason, must be a config issue somewhere, but I've not tracked it down yet. (not tried too hard ....)

[scott]

double check the logs when you start clam to make sure its not throwing back any outdated database errors.

[Thought_Memory]

Last night I changed the qmail-scanner-reconfigure script to turn on user notification again, I'd not bothered turning it on since the re-install.

Now I'm back to the original problem, spamd & clamd dying, with some kernel out of memory errors ....

I've just reconfigured again to only let the admin know, but I think the problem is with the whole notify code, so I'm still expecting the same problems.

Any ideas anyone?

[scott]

Id check out the qmail-scanner list, see if anyone else has had similar issues.