Resolved: Urgent help required server reboot

[coolemail]

I've a server with Centos5, ASL & Plesk. It ground to a halt & we asked datacentre to manually reboot. Not responding to pings any longer so on route now there. Please all I'll need some help in what to do with it. Think cause is when Parallels changed kernel; they warned this could happen but manual reboots were OK til now. Pse be patient as my knowledge is not the same as all yours. Will be on site about 90 mins time. Pse help me then!
Many thanks in advance.

[coolemail]

now in data centre. connected to the server.
it says:

checking file systems
/dev/VolGroup00/LogVol00 contains a file system with errors, check forced
/dev/VolGroup00/LogVol00:
Inodes that were part of a corrupted orphan linked list found.

/dev/VolGroup00/LogVol00: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY
(i.e., without -a or -p options)
[FAILED]

*** An error occurred during the file system check.
***Dropping you to a shell; the system will reboot
***when you leave the shell
Give root password for maintenance

so I guess I need to log in and then run fsck??

[coolemail]

running fsck
currently fixing "inodes that were part of a corrupted orphan linked list"

[coolemail]

said "yes" to all fixes it prompted. now says:

(Repair filesystem) 2 #

do I have to do fsck again for second port?

[coolemail]

the file check, fixes and a reboot resolved it. Thanks to all - even your presnece out there is a reassurance!

[Kalimari]

I only picked up on this thread this morning, looks like a tough night coolemail. Glad you got the server sorted. Always a nightmare when coming up against new situations and having to figure out what to do - thanks for posting the steps and outcome, it will no doubt be helpful to someone else at some point.

[faris]

Think cause is when Parallels changed kernel

You run Virtuozzo/Open VZ?

Anyway, I'm glad it is up and running again.

Faris.

[coolemail]

thanks for the posts. I don't have Virtuozzo/Open VZ. But the server had decided that without the filecheck/fix, it was not going to allow any more remote root access.

breun (highly recommended for IT support if required) then took it over and did a great job for my sanity:

- Remove Dr. Web (and other filters if present)
- Install qmail-scanner from ART with ClamAV and SpamAssassin
- Check all MySQL databases and perform an optimize and/or repair if necessary

Additionally, we have:
- Disabled ossec-rootcheck in /var/ossec/etc/ossec.conf to lower I/O load
- Lowered the Apache preform maximums in /etc/httpd/conf/httpd.conf to an appropiate limit corresponding to the amount of RAM in your server
- Installed some yum plug-ins for ease and better performance when using yum
- We have also recommended a RAM upgrade.

and I have today taken on a software designer to help me and I hope now to be able to help more people in this forum in the future. THANK YOU all . A good end to a horrible night last night. And I think an HP VM blade will be my next purchase.

[faris]

Yeah, Breun RULES

Faris.