[WBEL-users] Web Log Files - HUGE

Thomas Swan tswan@idigx.com
Mon, 07 Jun 2004 17:28:12 -0500


Thomas Swan wrote:

>Ladar Levison wrote:
>
>  
>
>>Jeff --
>>
>>By default, logrotate should rotate the logs every week, and keep up to
>>four weeks worth. Perhaps you accidently stopped the cron the job from
>>running.
>>
>>Make sure this log-rotate script is still set to run daily. Also note
>>that you can have logrotate compress your log files, which might be a
>>good idea in your case (if you don't mind the overhead).
>>
>> 
>>
>>    
>>
>Another really useful option is "delaycompress"
>
>The current log and the most recently rotated copy are uncompressed for
>searching, etc.  Older rotations are fully compressed.
>  
>
If your log files are growing unwieldy you can increase the frequency of
rotation from weekly to daily.   If you do this, then set the number of
rotations to keep to a larger number so you keep the same number of days
like 28 or 35. 

I have a server where the web traffic logs are over 2GB for a week and
the traffic analyzer was throwing fits.   The solution was to analyze,
rotate and compress the log files daily.   This dramatically reduced log
file space by keeping the average daily disk usage fairly constant: 
i.e. instead of using 2-5GB of disk space, the average usage is around
750MB.