Hello
I have done that with the 4 reverse proxies I admin. I've got around 24Mhit
daily... I use mergelog + a tool to split the logs by something similar
to "virtualhosts" ( well. by /paths ). Finally I run the webalizer.
The process takes 50 minutes and it's done at night. You still can use renice
+19.
About the rest, what do you want to stats? You also can have marvellous graphs
with rrdtools and a little bit of imagination. Apache2 mod_info could give
you amount of information that could be summarized for all your Webservers.
BR,
Francisco Gimeno
> Ok so I've moved a number of websites over to a pair of servers running
> Ultramonkey on completely separate filesystems which are sync'd every 15
> minutes. Previously stats were run via webalizer on the single log files
> for the site. Now with multiple log files each on different servers, how
> do you run your stats without having stats suddenly drop (approximately) in
> half, and constantly change when you are not running persistent
> connections?
>
> My thoughts on this (there must be a better way though) would be to
> download the transfer logs from both halfs of the site to another server
> (I've got a development server which sits idle 90% of the night), merge the
> logs, run stats on it, and update the stats directory on the servers.
|