AWstats broken

General Discussion of atomic repo and development projects.

Ask for help here with anything else not covered by other forums.
coolemail
Forum Regular
Forum Regular
Posts: 369
Joined: Tue Dec 16, 2008 8:01 am
Location: United Kingdom

Re: AWstats broken

Unread post by coolemail »

Thank you both for the response.

I do have that awstats cron job:
#!/bin/sh

/usr/share/awstats/awstats_updateall.pl now -awstatsprog=/var/www/cgi-bin/awstats/awstats.pl -configdir=/etc/awstats >/dev/null 2>&1

exit 0
and a 00webalizer one as well:
#! /bin/bash
# update access statistics for the web site

if [ -s /var/log/httpd/access_log ]; then
exec /usr/bin/webalizer -Q
fi
and /var/log/httpd/access_log is not a large file which appears to have mostly webmail entries and a lot of:
"Apache (internal dummy connection)"
::1 - - [21/Feb/2010:20:31:25 +0000] "OPTIONS * HTTP/1.0" 200 - "-"
Does that give any more clue?

The strange thing is that it was working perfectly until 21 Feb and we did no update or anything that should have triggered that.

I may try a server reboot in the night.
BruceLee
Forum Regular
Forum Regular
Posts: 879
Joined: Sat Mar 28, 2009 6:58 pm
Location: Germany

Re: AWstats broken

Unread post by BruceLee »

just a thought. what does

date

say?

and what do you get when running:

/usr/local/psa/admin/sbin/statistics
coolemail
Forum Regular
Forum Regular
Posts: 369
Joined: Tue Dec 16, 2008 8:01 am
Location: United Kingdom

Re: AWstats broken

Unread post by coolemail »

[root@plesk2 ~]# date
Wed Feb 24 22:24:36 GMT 2010
[root@plesk2 ~]#
and the latter - just a small part of that file says:
[root@plesk2 ~]# /usr/local/psa/admin/sbin/statistics
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (clf)
DNS Lookup (15): None to process
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (clf)
DNS Lookup (15): None to process
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (ftp)
DNS Lookup (15): None to process
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (ftp)
DNS Lookup (15): None to process
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (clf)
Using DNS cache file /usr/local/psa/var/lib/webalizer/webalizer.cache
Creating output in /var/www/vhosts/absen.info/statistics/webstat
Hostname for reports is 'absen.info'
Reading history file... webalizer.hist
Reading previous run data.. webalizer.current
No valid records found!
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (clf)
Using DNS cache file /usr/local/psa/var/lib/webalizer/webalizer.cache
Creating output in /var/www/vhosts/absen.info/statistics/webstat-ssl
Hostname for reports is 'domain1.info'
History file not found...
Previous run data not found...
No valid records found!
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (ftp)
Using DNS cache file /usr/local/psa/var/lib/webalizer/webalizer.cache
Creating output in /var/www/vhosts/domain1.info/statistics/anon_ftpstat
Hostname for reports is 'domain1.info'
History file not found...
Previous run data not found...
No valid records found!
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (ftp)
Using DNS cache file /usr/local/psa/var/lib/webalizer/webalizer.cache
Creating output in /var/www/vhosts/domain1.info/statistics/ftpstat
Hostname for reports is 'domain1.info'
Reading history file... webalizer.hist
Reading previous run data.. webalizer.current
No valid records found!
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (clf)
DNS Lookup (15): None to process
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (clf)
DNS Lookup (15): None to process
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (ftp)
DNS Lookup (15): None to process
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (ftp)
DNS Lookup (15): None to process
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (clf)
Using DNS cache file /usr/local/psa/var/lib/webalizer/webalizer.cache
Creating output in /var/www/vhosts/domain2.co.uk/statistics/webstat
Hostname for reports is 'domain2.co.uk'
Reading history file... webalizer.hist
Reading previous run data.. webalizer.current
No valid records found!
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (clf)
Using DNS cache file /usr/local/psa/var/lib/webalizer/webalizer.cache
Creating output in /var/www/vhosts/ahfchoc.co.uk/statistics/webstat-ssl
Hostname for reports is 'domain2.co.uk'
History file not found...
Previous run data not found...
No valid records found!
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (ftp)
Using DNS cache file /usr/local/psa/var/lib/webalizer/webalizer.cache
Creating output in /var/www/vhosts/domain2.co.uk/statistics/anon_ftpstat
Hostname for reports is 'domain2.co.uk'
History file not found...
Previous run data not found...
No valid records found!
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (ftp)
Using DNS cache file /usr/local/psa/var/lib/webalizer/webalizer.cache
Creating output in /var/www/vhosts/domain2.co.uk/statistics/ftpstat
Hostname for reports is 'domain2.co.uk'
Reading history file... webalizer.hist
Reading previous run data.. webalizer.current
No valid records found!
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (clf)
DNS Lookup (15): None to process
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (clf)
DNS Lookup (15): None to process
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (ftp)
DNS Lookup (15): None to process
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (ftp)
DNS Lookup (15): None to process
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (clf)
Using DNS cache file /usr/local/psa/var/lib/webalizer/webalizer.cache
Creating output in /var/www/vhosts/domain3.com/statistics/webstat
Hostname for reports is 'domain3.com'
Reading history file... webalizer.hist
Reading previous run data.. webalizer.current
No valid records found!
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (clf)
Using DNS cache file /usr/local/psa/var/lib/webalizer/webalizer.cache
Creating output in /var/www/vhosts/ahfrancis.com/statistics/webstat-ssl
Hostname for reports is 'domain3.com'
Reading history file... webalizer.hist
Reading previous run data.. webalizer.current
No valid records found!
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (ftp)
Using DNS cache file /usr/local/psa/var/lib/webalizer/webalizer.cache
Creating output in /var/www/vhosts/ahfrancis.com/statistics/anon_ftpstat
Hostname for reports is 'domain3.com'
History file not found...
Previous run data not found...
No valid records found!
Webalizer V2.01-10 (Linux 2.6.29.6-1.art.x86_64) English
Using logfile STDIN (ftp)
Using DNS cache file /usr/local/psa/var/lib/webalizer/webalizer.cache
Creating output in /var/www/vhosts/ahfrancis.com/statistics/ftpstat
Hostname for reports is 'domain3.com'
Reading history file... webalizer.hist
Reading previous run data.. webalizer.current
[new_unode] Warning: String exceeds storage size (1781)
[new_unode] Warning: String exceeds storage size (1780)
[new_unode] Warning: String exceeds storage size (1779)
[new_unode] Warning: String exceeds storage size (1778)
[new_unode] Warning: String exceeds storage size (1777)
[new_unode] Warning: String exceeds storage size (1776)
[new_unode] Warning: String exceeds storage size (1775)
[new_unode] Warning: String exceeds storage size (1774)
[new_unode] Warning: String exceeds storage size (1773)
[new_unode] Warning: String exceeds storage size (1772)
[new_unode] Warning: String exceeds storage size (1771)
[new_unode] Warning: String exceeds storage size (1770)
[new_unode] Warning: String exceeds storage size (1769)
[new_unode] Warning: String exceeds storage size (1768)
BruceLee
Forum Regular
Forum Regular
Posts: 879
Joined: Sat Mar 28, 2009 6:58 pm
Location: Germany

Re: AWstats broken

Unread post by BruceLee »

hhmm. I have no clue. Your output is showing the webalizer part.
Maybe a reinstalling awstats helps?
Maybe your permissions in /var/www/vhosts/domain.tld/statistics are wrong.
coolemail
Forum Regular
Forum Regular
Posts: 369
Joined: Tue Dec 16, 2008 8:01 am
Location: United Kingdom

Re: AWstats broken

Unread post by coolemail »

During the night I tried a server reboot. I guess I have to wait until 0400 hrs to see if it is successful?

I also did a check of the files in the webstat directory and the latest ones are all still stuck on this morning at 06:09 hrs:
[root@plesk2 ~]# ls -l /var/www/vhosts/domain1.com/statistics/webstat
total 6292
drwxr-xr-x 2 root root 4096 Nov 1 04:21 2009-10
drwxr-xr-x 2 root root 4096 Dec 1 04:08 2009-11
drwxr-xr-x 2 root root 4096 Jan 1 04:08 2009-12
drwxr-xr-x 2 root root 4096 Feb 1 04:03 2010-01
drwxr-xr-x 2 root root 4096 Feb 25 06:10 2010-02
-rw-r--r-- 1 root root 2141821 Feb 1 04:03 awstats012010.domain1.com-http.txt
-rw-r--r-- 1 root root 1514898 Feb 25 06:09 awstats022010.domain1.com-http.txt
-rw-r--r-- 1 root root 296354 Nov 1 04:21 awstats102009.domain1.com-http.txt
-rw-r--r-- 1 root root 614272 Dec 1 04:08 awstats112009.domain1.com-http.txt
-rw-r--r-- 1 root root 1819212 Jan 1 04:08 awstats122009.domain1.com-http.txt
lrwxrwxrwx 1 root root 7 Feb 25 06:09 current -> 2010-02
-rwxr-xr-x 1 root root 457 Feb 25 06:10 index.html
-rwxr-xr-x 1 root root 1119 Feb 25 06:10 nav.html
[root@plesk2 ~]#
[root@plesk2 ~]# dir -l /var/www/vhosts/domain1.com/statistics/webstat/current
lrwxrwxrwx 1 root root 7 Feb 25 06:09 /var/www/vhosts/domain1.com/statistics/webstat/current -> 2010-02
[root@plesk2 ~]#
I also tried rebuilding the webstats for a single domain:
[root@plesk2 ~]# /usr/local/psa/admin/sbin/statistics --calculate-one --domain-name=domain1.com
Create/Update database for config "/usr/local/psa/etc/awstats/awstats.domain1.com-http.conf" by AWStats version 6.6 (build 1.887)
From data in log file "-"...
Phase 1 : First bypass old records, searching new record...
Searching new records from beginning of log file...
Phase 2 : Now process new records (Flush history on disk after 20000 hosts)...
Jumped lines in file: 0
Parsed lines in file: 211
Found 0 dropped records,
Found 0 corrupted records,
Found 0 old records,
Found 211 new qualified records.
Build main page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output
Build alldomains page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=alldomains
Build allhosts page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=allhosts
Build lasthosts page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=lasthosts
Build unknownip page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=unknownip
Build allrobots page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=allrobots
Build lastrobots page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=lastrobots
Build session page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=session
Build urldetail page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=urldetail
Build urlentry page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=urlentry
Build urlexit page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=urlexit
Build osdetail page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=osdetail
Build unknownos page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=unknownos
Build browserdetail page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=browserdetail
Build unknownbrowser page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=unknownbrowser
Build refererse page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=refererse
Build refererpages page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=refererpages
Build keyphrases page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=keyphrases
Build keywords page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=keywords
Build errors404 page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-http -staticlinks -configdir=/usr/local/psa/etc/awstats -output=errors404
20 files built.
Main HTML page is 'awstats.domain1.com-http.html'.
Create/Update database for config "/usr/local/psa/etc/awstats/awstats.domain1.com-https.conf" by AWStats version 6.6 (build 1.887)
From data in log file "-"...
Phase 1 : First bypass old records, searching new record...
Searching new records from beginning of log file...
Jumped lines in file: 0
Parsed lines in file: 0
Found 0 dropped records,
Found 0 corrupted records,
Found 0 old records,
Found 0 new qualified records.
Build main page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output
Build alldomains page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=alldomains
Build allhosts page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=allhosts
Build lasthosts page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=lasthosts
Build unknownip page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=unknownip
Build allrobots page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=allrobots
Build lastrobots page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=lastrobots
Build session page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=session
Build urldetail page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=urldetail
Build urlentry page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=urlentry
Build urlexit page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=urlexit
Build osdetail page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=osdetail
Build unknownos page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=unknownos
Build browserdetail page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=browserdetail
Build unknownbrowser page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=unknownbrowser
Build refererse page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=refererse
Build refererpages page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=refererpages
Build keyphrases page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=keyphrases
Build keywords page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=keywords
Build errors404 page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-https -staticlinks -configdir=/usr/local/psa/etc/awstats -output=errors404
20 files built.
Main HTML page is 'awstats.domain1.com-https.html'.
Create/Update database for config "/usr/local/psa/etc/awstats/awstats.domain1.com-anon_ftp.conf" by AWStats version 6.6 (build 1.887)
From data in log file "-"...
Phase 1 : First bypass old records, searching new record...
Searching new records from beginning of log file...
Jumped lines in file: 0
Parsed lines in file: 0
Found 0 dropped records,
Found 0 corrupted records,
Found 0 old records,
Found 0 new qualified records.
Build main page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output
Build alldomains page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=alldomains
Build allhosts page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=allhosts
Build lasthosts page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=lasthosts
Build unknownip page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=unknownip
Build allrobots page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=allrobots
Build lastrobots page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=lastrobots
Build session page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=session
Build urldetail page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=urldetail
Build urlentry page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=urlentry
Build urlexit page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=urlexit
Build osdetail page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=osdetail
Build unknownos page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=unknownos
Build browserdetail page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=browserdetail
Build unknownbrowser page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=unknownbrowser
Build refererse page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=refererse
Build refererpages page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=refererpages
Build keyphrases page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=keyphrases
Build keywords page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=keywords
Build errors404 page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-anon_ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=errors404
20 files built.
Main HTML page is 'awstats.domain1.com-anon_ftp.html'.
Create/Update database for config "/usr/local/psa/etc/awstats/awstats.domain1.com-ftp.conf" by AWStats version 6.6 (build 1.887)
From data in log file "-"...
Phase 1 : First bypass old records, searching new record...
Searching new records from beginning of log file...
Jumped lines in file: 0
Parsed lines in file: 0
Found 0 dropped records,
Found 0 corrupted records,
Found 0 old records,
Found 0 new qualified records.
Build main page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output
Build alldomains page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=alldomains
Build allhosts page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=allhosts
Build lasthosts page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=lasthosts
Build unknownip page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=unknownip
Build allrobots page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=allrobots
Build lastrobots page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=lastrobots
Build session page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=session
Build urldetail page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=urldetail
Build urlentry page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=urlentry
Build urlexit page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=urlexit
Build osdetail page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=osdetail
Build unknownos page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=unknownos
Build browserdetail page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=browserdetail
Build unknownbrowser page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=unknownbrowser
Build refererse page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=refererse
Build refererpages page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=refererpages
Build keyphrases page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=keyphrases
Build keywords page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=keywords
Build errors404 page: "/var/www/cgi-bin/awstats/awstats.pl" -config=domain1.com-ftp -staticlinks -configdir=/usr/local/psa/etc/awstats -output=errors404
20 files built.
Main HTML page is 'awstats.domain1.com-ftp.html'.
error: error accessing /var/www/vhosts/induction.domain3.com/statistics/logs: No such file or directory
error: induction.domain3.com:1 glob failed for /var/www/vhosts/induction.domain3.com/statistics/logs/*.processed
error: error accessing /var/www/vhosts/plesk3.serverdomain.co.uk/statistics/logs: No such file or directory
error: plesk3.serverdomain.co.uk:1 glob failed for /var/www/vhosts/plesk3.serverdomain.co.uk/statistics/logs/*.processed
error: error accessing /var/www/vhosts/domain2.com/statistics/logs: No such file or directory
error: domain2.com:1 glob failed for /var/www/vhosts/domain2.com /statistics/logs/*.processed
[root@plesk2 ~]#
Do the errors at the end referring to different domains give any clue?

Is there any way we can see whether the server is counting the activity in real time?

The other thing I THINK is happening is that the domains are not showing up any growing traffic usage each day. The particular domain in question above is a heavy use domain and I think that the traffic usage has been the same for the last few days.

I do hope that people can help us get this back working. We have made no changes since the server seems to have stopped recording everything!

I did find http://kb.parallels.com/en/8006 which talks about replacing /usr/local/psa/admin/sbin/pipelog. Should I do that? And if so, how do I replace /usr/local/psa/admin/sbin/pipelog with a downloaded file called update.tar.bz2 now on my desktop? Grateful for advice on that.
breun
Long Time Forum Regular
Long Time Forum Regular
Posts: 2813
Joined: Sat Aug 20, 2005 9:30 am
Location: The Netherlands

Re: AWstats broken

Unread post by breun »

The times I've seen problems with awstats always were when Plesk's awstats package had been replaced by an awstats package by another packager that had its files in different locations. Check if the AWSTATS_* directives in /etc/psa/psa.conf match the layout of your awstats installation.
Lemonbit Internet Dedicated Server Management
coolemail
Forum Regular
Forum Regular
Posts: 369
Joined: Tue Dec 16, 2008 8:01 am
Location: United Kingdom

Re: AWstats broken

Unread post by coolemail »

Thanks breun. They seem OK

/etc/psa/psa.conf includes the following:
# AWStats
AWSTATS_ETC_D /etc/awstats
AWSTATS_BIN_D /var/www/cgi-bin/awstats
AWSTATS_TOOLS_D /usr/share/awstats
AWSTATS_DOC_D /var/www/html/awstats
and
# Webalizer
WEB_STAT /usr/bin/webalizer

# Logrotate
LOGROTATE /usr/local/psa/logrotate/sbin/logrotate
I did find http://kb.parallels.com/en/8006 which talks about replacing /usr/local/psa/admin/sbin/pipelog. Should I do that? And if so, how do I replace /usr/local/psa/admin/sbin/pipelog with a downloaded file called update.tar.bz2 now on my desktop? Grateful for advice on that.
and we have all the relevant folders that go with that.
breun
Long Time Forum Regular
Long Time Forum Regular
Posts: 2813
Joined: Sat Aug 20, 2005 9:30 am
Location: The Netherlands

Re: AWstats broken

Unread post by breun »

They seem ok, but have you checked that those configured locations are actually correct?

Do you use the pipelog feature (recommended with 300+ domains)? We do on certain machines and had to install this patch, but without the patch you'd just be getting empty stats for HTTP and everything under HTTPS.

You need to transfer the file to your server (for instance using scp), unpack it (or unpack it on your machine and then transfer it) and copy it over the old file. Make sure permissions and ownership stay the same (for instance if you decide to move the old file elsewhere before putting the new one in place).
Lemonbit Internet Dedicated Server Management
coolemail
Forum Regular
Forum Regular
Posts: 369
Joined: Tue Dec 16, 2008 8:01 am
Location: United Kingdom

Re: AWstats broken

Unread post by coolemail »

Hi breun,
Yes, I have confirmed that those configured locations are all as per our server paths.
We have never set up pipelog so unless an update that we have ever done automativcally turns it on, then it is not active.
I think that something I did yesterday (probably the server reboot) has resolved the issue because this morning we are getting much higher stats showing on all domains for yesterday.
Is there a way of knowing that the server is recording the statistics in real time to the server stats? Should I put the awstats and webalizer cron jobs into an hourly (not daily) one for a bit? Or would that be too heavy a load for the server?
breun
Long Time Forum Regular
Long Time Forum Regular
Posts: 2813
Joined: Sat Aug 20, 2005 9:30 am
Location: The Netherlands

Re: AWstats broken

Unread post by breun »

Piped logging won't be enabled by default. You can check by running mysql -uadmin -p`cat /etc/psa/.psa.shadow` -e "SELECT * FROM psa.misc WHERE param = 'apache_pipelog'". If that returns nothing or that apache_pipelog is set to false, then it's not enabled.

Apache logs to the access_*log and error_*log files in the statistics/logs dir under a domain's directory. The statistics are not updated in real-time, by default only nightly by the statistics cronjob which processes the log files. I don't know if your nightly statistics job takes more or less than an hour. You can always update the statistics manually by running /usr/local/psa/admin/sbin/statistics (see how long that takes and how much load it puts on your server and then decide if you'd want to run that more than once per day).
Lemonbit Internet Dedicated Server Management
Post Reply