Atomicorp

MySQL is shutting down at seemingly random intervals. Please see most recent bit of the log, below. What could possibly be causing this?


120305 09:35:02 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120305 9:35:02 [Note] Plugin 'FEDERATED' is disabled.
120305 9:35:02 InnoDB: The InnoDB memory heap is disabled
120305 9:35:02 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120305 9:35:02 InnoDB: Compressed tables use zlib 1.2.3
120305 9:35:02 InnoDB: Using Linux native AIO
120305 9:35:02 InnoDB: Initializing buffer pool, size = 128.0M
120305 9:35:02 InnoDB: Completed initialization of buffer pool
120305 9:35:02 InnoDB: highest supported file format is Barracuda.
120305 9:35:02 InnoDB: 1.1.8 started; log sequence number 571002234
120305 9:35:02 [Note] Event Scheduler: Loaded 0 events
120305 9:35:02 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.20-cll' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) by Atomicorp
120305 9:35:03 [Warning] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)
120305 9:37:44 [Note] /usr/libexec/mysqld: Normal shutdown

120305 9:37:44 [Note] Event Scheduler: Purging the queue. 0 events
120305 9:37:46 InnoDB: Starting shutdown...
120305 9:37:46 InnoDB: Shutdown completed; log sequence number 571002284
120305 9:37:46 [Note] /usr/libexec/mysqld: Shutdown complete

120305 09:37:46 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
120305 09:37:47 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120305 9:37:47 [Note] Plugin 'FEDERATED' is disabled.
120305 9:37:47 InnoDB: The InnoDB memory heap is disabled
120305 9:37:47 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120305 9:37:47 InnoDB: Compressed tables use zlib 1.2.3
120305 9:37:47 InnoDB: Using Linux native AIO
120305 9:37:47 InnoDB: Initializing buffer pool, size = 128.0M
120305 9:37:47 InnoDB: Completed initialization of buffer pool
120305 9:37:47 InnoDB: highest supported file format is Barracuda.
120305 9:37:47 InnoDB: 1.1.8 started; log sequence number 571002284
120305 9:37:47 [Note] Event Scheduler: Loaded 0 events
120305 9:37:47 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.20-cll' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) by Atomicorp
120305 9:37:48 [Warning] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)
120305 9:44:02 [Warning] Aborted connection 3663 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 9:59:01 [Warning] Aborted connection 12675 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 10:12:33 [Note] /usr/libexec/mysqld: Normal shutdown

120305 10:12:33 [Note] Event Scheduler: Purging the queue. 0 events
120305 10:12:35 InnoDB: Starting shutdown...
120305 10:12:36 InnoDB: Shutdown completed; log sequence number 571003151
120305 10:12:36 [Note] /usr/libexec/mysqld: Shutdown complete

120305 10:12:36 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
120305 10:12:59 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120305 10:12:59 [Note] Plugin 'FEDERATED' is disabled.
120305 10:12:59 InnoDB: The InnoDB memory heap is disabled
120305 10:12:59 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120305 10:12:59 InnoDB: Compressed tables use zlib 1.2.3
120305 10:12:59 InnoDB: Using Linux native AIO
120305 10:12:59 InnoDB: Initializing buffer pool, size = 128.0M
120305 10:12:59 InnoDB: Completed initialization of buffer pool
120305 10:12:59 InnoDB: highest supported file format is Barracuda.
120305 10:12:59 InnoDB: 1.1.8 started; log sequence number 571003151
120305 10:12:59 [Note] Event Scheduler: Loaded 0 events
120305 10:12:59 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.20-cll' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) by Atomicorp
120305 10:13:00 [Warning] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)
120305 10:14:01 [Warning] Aborted connection 620 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 10:27:11 [Note] /usr/libexec/mysqld: Normal shutdown

120305 10:27:11 [Note] Event Scheduler: Purging the queue. 0 events
120305 10:27:13 InnoDB: Starting shutdown...
120305 10:27:14 InnoDB: Shutdown completed; log sequence number 571003381
120305 10:27:14 [Note] /usr/libexec/mysqld: Shutdown complete

120305 10:27:14 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
120305 10:28:02 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120305 10:28:02 [Note] Plugin 'FEDERATED' is disabled.
120305 10:28:02 InnoDB: The InnoDB memory heap is disabled
120305 10:28:02 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120305 10:28:02 InnoDB: Compressed tables use zlib 1.2.3
120305 10:28:02 InnoDB: Using Linux native AIO
120305 10:28:02 InnoDB: Initializing buffer pool, size = 128.0M
120305 10:28:02 InnoDB: Completed initialization of buffer pool
120305 10:28:02 InnoDB: highest supported file format is Barracuda.
120305 10:28:02 InnoDB: Waiting for the background threads to start
120305 10:28:03 InnoDB: 1.1.8 started; log sequence number 571003381
120305 10:28:03 [Note] Event Scheduler: Loaded 0 events
120305 10:28:03 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.20-cll' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) by Atomicorp
120305 10:28:04 [Warning] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)
120305 10:29:01 [Warning] Aborted connection 622 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 10:44:01 [Warning] Aborted connection 8810 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 10:59:01 [Warning] Aborted connection 16216 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 11:14:01 [Warning] Aborted connection 25374 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 11:29:02 [Warning] Aborted connection 34522 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 11:41:55 [Note] /usr/libexec/mysqld: Normal shutdown

120305 11:41:55 [Note] Event Scheduler: Purging the queue. 0 events
120305 11:41:57 InnoDB: Starting shutdown...
120305 11:41:58 InnoDB: Shutdown completed; log sequence number 571004549
120305 11:41:58 [Note] /usr/libexec/mysqld: Shutdown complete

120305 11:41:58 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
120305 11:43:06 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120305 11:43:06 [Note] Plugin 'FEDERATED' is disabled.
120305 11:43:06 InnoDB: The InnoDB memory heap is disabled
120305 11:43:06 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120305 11:43:06 InnoDB: Compressed tables use zlib 1.2.3
120305 11:43:06 InnoDB: Using Linux native AIO
120305 11:43:06 InnoDB: Initializing buffer pool, size = 128.0M
120305 11:43:06 InnoDB: Completed initialization of buffer pool
120305 11:43:06 InnoDB: highest supported file format is Barracuda.
120305 11:43:06 InnoDB: Waiting for the background threads to start
120305 11:43:07 InnoDB: 1.1.8 started; log sequence number 571004549
120305 11:43:07 [Note] Event Scheduler: Loaded 0 events
120305 11:43:07 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.20-cll' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) by Atomicorp
120305 11:43:08 [Warning] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)
120305 11:44:01 [Warning] Aborted connection 579 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 12:34:55 [Warning] Aborted connection 33565 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 12:34:55 [Warning] Aborted connection 33573 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 12:37:37 [Warning] Aborted connection 35462 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 12:37:38 [Warning] Aborted connection 35471 to db: 'psa' user: 'admin' host: 'localhost' (Got an error reading communication packets)
120305 13:11:12 [Warning] Aborted connection 57920 to db: 'mailer' user: 'default' host: 'localhost' (Got an error reading communication packets)
120305 13:36:48 [Note] /usr/libexec/mysqld: Normal shutdown

120305 13:36:48 [Note] Event Scheduler: Purging the queue. 0 events
120305 13:36:50 InnoDB: Starting shutdown...
120305 13:36:51 InnoDB: Shutdown completed; log sequence number 571038272
120305 13:36:51 [Note] /usr/libexec/mysqld: Shutdown complete

120305 13:36:51 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
120305 13:37:13 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120305 13:37:13 [Note] Plugin 'FEDERATED' is disabled.
120305 13:37:13 InnoDB: The InnoDB memory heap is disabled
120305 13:37:13 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120305 13:37:13 InnoDB: Compressed tables use zlib 1.2.3
120305 13:37:13 InnoDB: Using Linux native AIO
120305 13:37:13 InnoDB: Initializing buffer pool, size = 128.0M
120305 13:37:13 InnoDB: Completed initialization of buffer pool
120305 13:37:13 InnoDB: highest supported file format is Barracuda.
120305 13:37:13 InnoDB: Waiting for the background threads to start
120305 13:37:14 InnoDB: 1.1.8 started; log sequence number 571038272
120305 13:37:14 [Note] Event Scheduler: Loaded 0 events
120305 13:37:14 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.20-cll' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) by Atomicorp
120305 13:37:14 [Warning] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)
120305 15:33:50 [Warning] Aborted connection 75469 to db: 'mailer' user: 'default' host: 'localhost' (Got an error reading communication packets)
120305 16:20:22 [Warning] Aborted connection 106716 to db: 'mailer' user: 'default' host: 'localhost' (Got an error reading communication packets)
120305 16:20:23 [Warning] Aborted connection 106738 to db: 'mailer' user: 'default' host: 'localhost' (Got an error reading communication packets)
120305 17:33:41 [Note] /usr/libexec/mysqld: Normal shutdown

120305 17:33:41 [Note] Event Scheduler: Purging the queue. 0 events
120305 17:33:43 InnoDB: Starting shutdown...
120305 17:33:45 InnoDB: Shutdown completed; log sequence number 571042400
120305 17:33:45 [Note] /usr/libexec/mysqld: Shutdown complete

120305 17:33:45 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
120305 17:34:37 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120305 17:34:37 [Note] Plugin 'FEDERATED' is disabled.
120305 17:34:37 InnoDB: The InnoDB memory heap is disabled
120305 17:34:37 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120305 17:34:37 InnoDB: Compressed tables use zlib 1.2.3
120305 17:34:37 InnoDB: Using Linux native AIO
120305 17:34:37 InnoDB: Initializing buffer pool, size = 128.0M
120305 17:34:37 InnoDB: Completed initialization of buffer pool
120305 17:34:37 InnoDB: highest supported file format is Barracuda.
120305 17:34:38 InnoDB: Waiting for the background threads to start
120305 17:34:39 InnoDB: 1.1.8 started; log sequence number 571042400
120305 17:34:39 [Note] Event Scheduler: Loaded 0 events
120305 17:34:39 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.20-cll' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) by Atomicorp
120305 17:34:39 [Warning] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)
120305 17:52:08 [Note] /usr/libexec/mysqld: Normal shutdown

120305 17:52:08 [Note] Event Scheduler: Purging the queue. 0 events
120305 17:52:10 InnoDB: Starting shutdown...
120305 17:52:11 InnoDB: Shutdown completed; log sequence number 571042690
120305 17:52:11 [Note] /usr/libexec/mysqld: Shutdown complete

120305 17:52:11 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
120305 17:52:42 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120305 17:52:42 [Note] Plugin 'FEDERATED' is disabled.
120305 17:52:42 InnoDB: The InnoDB memory heap is disabled
120305 17:52:42 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120305 17:52:42 InnoDB: Compressed tables use zlib 1.2.3
120305 17:52:42 InnoDB: Using Linux native AIO
120305 17:52:42 InnoDB: Initializing buffer pool, size = 128.0M
120305 17:52:42 InnoDB: Completed initialization of buffer pool
120305 17:52:42 InnoDB: highest supported file format is Barracuda.
120305 17:52:42 InnoDB: Waiting for the background threads to start
120305 17:52:43 InnoDB: 1.1.8 started; log sequence number 571042690
120305 17:52:43 [Note] Event Scheduler: Loaded 0 events
120305 17:52:43 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.20-cll' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) by Atomicorp
120305 17:52:44 [Warning] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)
120305 21:05:14 [Note] /usr/libexec/mysqld: Normal shutdown

120305 21:05:14 [Note] Event Scheduler: Purging the queue. 0 events
120305 21:05:16 InnoDB: Starting shutdown...
120305 21:05:17 InnoDB: Shutdown completed; log sequence number 571046478
120305 21:05:17 [Note] /usr/libexec/mysqld: Shutdown complete

120305 21:05:17 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
120305 21:06:19 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120305 21:06:19 [Note] Plugin 'FEDERATED' is disabled.
120305 21:06:19 InnoDB: The InnoDB memory heap is disabled
120305 21:06:19 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120305 21:06:19 InnoDB: Compressed tables use zlib 1.2.3
120305 21:06:19 InnoDB: Using Linux native AIO
120305 21:06:19 InnoDB: Initializing buffer pool, size = 128.0M
120305 21:06:19 InnoDB: Completed initialization of buffer pool
120305 21:06:19 InnoDB: highest supported file format is Barracuda.
120305 21:06:19 InnoDB: Waiting for the background threads to start
120305 21:06:20 InnoDB: 1.1.8 started; log sequence number 571046478
120305 21:06:20 [Note] Event Scheduler: Loaded 0 events
120305 21:06:20 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.20-cll' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) by Atomicorp
120305 21:06:21 [Warning] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)
120305 21:45:19 [Note] /usr/libexec/mysqld: Normal shutdown

120305 21:45:19 [Note] Event Scheduler: Purging the queue. 0 events
120305 21:45:21 InnoDB: Starting shutdown...
120305 21:45:23 InnoDB: Shutdown completed; log sequence number 571047244
120305 21:45:23 [Note] /usr/libexec/mysqld: Shutdown complete

120305 21:45:23 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
120305 21:45:23 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120305 21:45:23 [Note] Plugin 'FEDERATED' is disabled.
120305 21:45:23 InnoDB: The InnoDB memory heap is disabled
120305 21:45:23 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120305 21:45:23 InnoDB: Compressed tables use zlib 1.2.3
120305 21:45:23 InnoDB: Using Linux native AIO
120305 21:45:23 InnoDB: Initializing buffer pool, size = 128.0M
120305 21:45:23 InnoDB: Completed initialization of buffer pool
120305 21:45:24 InnoDB: highest supported file format is Barracuda.
120305 21:45:24 InnoDB: Waiting for the background threads to start
120305 21:45:25 InnoDB: 1.1.8 started; log sequence number 571047244
120305 21:45:25 [Note] Event Scheduler: Loaded 0 events
120305 21:45:25 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.20-cll' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) by Atomicorp
120305 21:45:25 [Warning] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)
120306 4:01:01 [Note] /usr/libexec/mysqld: Normal shutdown

120306 4:01:02 [Note] Event Scheduler: Purging the queue. 0 events
120306 4:01:04 [Warning] /usr/libexec/mysqld: Forcing close of thread 217360 user: 'admin'

120306 4:01:04 InnoDB: Starting shutdown...
120306 4:01:06 InnoDB: Shutdown completed; log sequence number 571081808
120306 4:01:06 [Note] /usr/libexec/mysqld: Shutdown complete

120306 04:01:06 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
120306 04:02:30 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120306 4:02:32 [Note] Plugin 'FEDERATED' is disabled.
120306 4:02:32 InnoDB: The InnoDB memory heap is disabled
120306 4:02:32 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120306 4:02:32 InnoDB: Compressed tables use zlib 1.2.3
120306 4:02:32 InnoDB: Using Linux native AIO
120306 4:02:32 InnoDB: Initializing buffer pool, size = 128.0M
120306 4:02:32 InnoDB: Completed initialization of buffer pool
120306 4:02:32 InnoDB: highest supported file format is Barracuda.
120306 4:02:39 InnoDB: Waiting for the background threads to start
120306 4:02:40 InnoDB: 1.1.8 started; log sequence number 571081808
120306 4:02:43 [Note] Event Scheduler: Loaded 0 events
120306 4:02:43 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.20-cll' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) by Atomicorp
120306 4:02:43 [Warning] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)
120306 7:48:40 [Note] /usr/libexec/mysqld: Normal shutdown

120306 7:48:40 [Note] Event Scheduler: Purging the queue. 0 events
120306 7:48:42 InnoDB: Starting shutdown...
120306 7:48:44 InnoDB: Shutdown completed; log sequence number 571085234
120306 7:48:44 [Note] /usr/libexec/mysqld: Shutdown complete

120306 07:48:44 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
120306 07:49:14 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120306 7:49:14 [Note] Plugin 'FEDERATED' is disabled.
120306 7:49:14 InnoDB: The InnoDB memory heap is disabled
120306 7:49:14 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120306 7:49:14 InnoDB: Compressed tables use zlib 1.2.3
120306 7:49:14 InnoDB: Using Linux native AIO
120306 7:49:14 InnoDB: Initializing buffer pool, size = 128.0M
120306 7:49:14 InnoDB: Completed initialization of buffer pool
120306 7:49:14 InnoDB: highest supported file format is Barracuda.
120306 7:49:14 InnoDB: Waiting for the background threads to start
120306 7:49:15 InnoDB: 1.1.8 started; log sequence number 571085234
120306 7:49:16 [Note] Event Scheduler: Loaded 0 events
120306 7:49:16 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.20-cll' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) by Atomicorp
120306 7:49:16 [Warning] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)

Does it stop right away when you try to start it?

Doesn't look like it:

scott wrote:Does it stop right away when you try to start it?

No. It starts fine, other than the initial warning message. It shuts down later, at what seem to be random times. Sometimes a few minutes, sometimes a few hours.

That almost sounds like someone is issuing a shutdown from inside of mysql

I'm pretty sure that's not happening, but I'll turn on query logging temporarily to find out ...

I can definitely rule out being any kind of package issue

mysqld just crashed again and there's no shutdown query showing up in the log (although I'm not sure it would?)

please post the output from yum list mysql*
could it be possible that you installed both 32bit and 64bit version ofd mysql?

It looks like maybe you're right? Our system is 64 bit; should these i386 packages be removed then?

Installed Packages
mysql.x86_64 5.5.20-2.el5.art installed
mysql-devel.i386 5.5.20-2.el5.art installed
mysql-devel.x86_64 5.5.20-2.el5.art installed
mysql-libs.i386 5.5.20-2.el5.art installed
mysql-libs.x86_64 5.5.20-2.el5.art installed
mysql-server.x86_64 5.5.20-2.el5.art installed
mysqlclient15.i386 5.0.90-1.el5.art installed
mysqlclient15.x86_64 5.0.90-1.el5.art installed
mysqlclient16.i386 5.1.59-2.el5.art installed
mysqlclient16.x86_64 5.1.59-2.el5.art installed
mysqlclient16-devel.i386 5.1.59-2.el5.art installed
mysqlclient16-devel.x86_64 5.1.59-2.el5.art installed

Well, checking the yum log, it looks like there have been i386 packages in there for a while, and we only recently began experiencing major problems (previously, mysql crashed once in a great while for no known reason, but for the past couple weeks it's crashing many times per day). The issue with the constant crashing goes back to a yum update of our CentOS 5.x machine on February 18th (attaching log below). I would like to simply revert to the prior versions of all of these packages, but it seems the only way to do that is to uninstall all of these packages (and all of their dependencies) and then reinstall the older versions? That's not practical since this is a live server. Are there any other options?


Feb 18 20:58:20 Updated: glibc-common-2.5-65.el5_7.3.x86_64
Feb 18 20:58:30 Updated: glibc-2.5-65.el5_7.3.x86_64
Feb 18 20:58:31 Updated: krb5-libs-1.6.1-63.el5_7.x86_64
Feb 18 20:58:33 Updated: openssl-0.9.8e-20.el5_7.1.0.1.centos.x86_64
Feb 18 20:58:40 Updated: php-common-5.3.10-5.el5.art.x86_64
Feb 18 20:58:41 Updated: libxml2-2.6.26-2.1.12.el5_7.2.x86_64
Feb 18 20:58:43 Updated: mysql-libs-5.5.20-2.el5.art.x86_64
Feb 18 20:58:45 Updated: krb5-devel-1.6.1-63.el5_7.x86_64
Feb 18 20:58:47 Updated: mysql-5.5.20-2.el5.art.x86_64
Feb 18 20:58:47 Updated: php-cli-5.3.10-5.el5.art.x86_64
Feb 18 20:58:47 Updated: php-pdo-5.3.10-5.el5.art.x86_64
Feb 18 20:58:48 Updated: tomcat5-servlet-2.4-api-5.5.23-0jpp.22.el5_7.x86_64
Feb 18 20:58:51 Updated: openssl-devel-0.9.8e-20.el5_7.1.0.1.centos.x86_64
Feb 18 20:58:55 Updated: kernel-headers-2.6.18-274.18.1.el5.x86_64
Feb 18 20:58:56 Updated: php-5.3.10-5.el5.art.x86_64
Feb 18 20:58:58 Updated: lvm2-2.02.84-6.el5_7.2.x86_64
Feb 18 20:58:59 Updated: libicu-3.6-5.16.1.x86_64
Feb 18 20:58:59 Updated: tomcat5-jsp-2.0-api-5.5.23-0jpp.22.el5_7.x86_64
Feb 18 20:59:00 Updated: php-mysql-5.3.10-5.el5.art.x86_64
Feb 18 21:01:34 Updated: mysql-server-5.5.20-2.el5.art.x86_64
Feb 18 21:01:34 Updated: php-xml-5.3.10-5.el5.art.x86_64
Feb 18 21:01:35 Updated: libxml2-python-2.6.26-2.1.12.el5_7.2.x86_64
Feb 18 21:01:35 Updated: php-mcrypt-5.3.10-5.el5.art.x86_64
Feb 18 21:01:35 Updated: php-mbstring-5.3.10-5.el5.art.x86_64
Feb 18 21:01:35 Updated: php-sqlite-5.3.10-5.el5.art.x86_64
Feb 18 21:01:36 Updated: php-imap-5.3.10-5.el5.art.x86_64
Feb 18 21:01:36 Updated: php-gd-5.3.10-5.el5.art.x86_64
Feb 18 21:01:36 Updated: monit-5.3.2-2.el5.rf.x86_64
Feb 18 21:01:36 Updated: nscd-2.5-65.el5_7.3.x86_64
Feb 18 21:01:38 Updated: glibc-headers-2.5-65.el5_7.3.x86_64
Feb 18 21:01:40 Updated: glibc-devel-2.5-65.el5_7.3.x86_64
Feb 18 21:01:44 Updated: php-devel-5.3.10-5.el5.art.x86_64
Feb 18 21:01:45 Updated: mysql-devel-5.5.20-2.el5.art.x86_64
Feb 18 21:01:49 Updated: glibc-2.5-65.el5_7.3.i686
Feb 18 21:01:50 Updated: krb5-libs-1.6.1-63.el5_7.i386
Feb 18 21:01:51 Updated: openssl-0.9.8e-20.el5_7.1.0.1.centos.i686
Feb 18 21:01:53 Updated: mysql-libs-5.5.20-2.el5.art.i386
Feb 18 21:01:55 Updated: openssl-devel-0.9.8e-20.el5_7.1.0.1.centos.i386
Feb 18 21:01:56 Updated: krb5-devel-1.6.1-63.el5_7.i386
Feb 18 21:01:57 Updated: mysql-devel-5.5.20-2.el5.art.i386
Mar 01 04:13:18 Installed: mysqlclient16-5.1.59-2.el5.art.x86_64
Mar 01 04:13:37 Installed: mysqlclient16-5.1.59-2.el5.art.i386
Mar 01 04:13:49 Installed: mysqlclient16-devel-5.1.59-2.el5.art.i386
Mar 01 04:14:07 Installed: mysqlclient16-devel-5.1.59-2.el5.art.x86_64

you can try using yum downgrade.
But if I were you I would uninstall/reinstall mysql with only needed packages.
First make a backup of the whole system of course
and check if there might be any upgrade issues if you upgraded to 5.5 from prior version on 18th Feb.

I dont think the i386 packages matter here. This isnt a packaging problem at all. The daemon is dying because someone/thing is shutting it down, theres a deeper problem with the system (bad drives, memory, etc), or maybe even a bad my.cnf (overtuned).

Is it a Plesk server? Those times of shut downs are very close to multiples of 5 minutes... meaning that Watchdog may be doing it. Check the watchdog log file :

/usr/local/psa/var/modules/watchdog/log/monit.log

Not entirely sure why it would be doing it mind, perhaps its tests disagree with 5.5 in some way...

Paul.

Yes, it's a Plesk server (unfortunately ... nothing but headaches). But I don't think we have watchdog running, and there isn't such a log at the location you have noted. We are running on Plesk 9.x