Articles in this section

See more

How to recalculate AWStats web-statistics using domain logs for previous months in Plesk

Avatar
Dinara Aspembitova
Updated
Follow
Plesk Onyx for Linux kb: how-to ABT: Group B

Applicable to:

  • Plesk Onyx for Linux

Question

How to recalculate AWStats web-statistics using domain logs for previous months?

Answer

There are two techniques to recalculate/regenerate AWStats statistic files:

  1. From AWStats txt files, which are still within the AWStat directory:

    Instructions to check

    1. Connect to the server via SSH.

    2. Check the directory:

      # ls -lahn /var/www/vhosts/system/example.com/statistics/webstat-ssl/ | grep awstats | awk '{print $9}'
      awstats082018.example.com-https.txt
      awstats092018.example.com-https.txt
      awstats102018.example.com-https.txt
      awstats112018.example.com-https.txt
      awstats122018.example.com-https.txt

    Note: In this case the months 08(August), 09(Semptember), 10(November), 11(October), 12(December) can be retrieved for the year 2018.

  2. From the old logs, which are present on the server.

Note: In both, old logs and AWStats txt file, are deleted, the recalculation will not be possible.

Installation

How to install the tool

  1. Connect to a Plesk server via SSH.

  2. Download and unpack the script:

    # wget https://support.plesk.com/hc/en-us/article_attachments/360015808219/rebuild_awstats.tar.gz

    # tar -xzvf rebuild_awstats.tar.gz

    • For Ubuntu 14.04, a symbolic link should be created:

      # ln -s /usr/lib/plesk-9.0/logresolvemerge /usr/share/doc/awstats/examples/logresolvemerge.pl

  3. Run this command to show help message:

    # ./rebuild_awstats.sh
    Rebuild AWstats static pages from available log files.

    Usage: ./rebuild_awstats.sh [options] [<domains...>]

    Options:
    -A
    --all-domains
    Process all domains. If this option is not specified, then list of
    domains to process must be provided.

    -F
    --from-scratch
    Remove contents of webstat/ and webstat-ssl/ directories before
    rebuilding statistics pages (originals are saved with numeric
    suffix). Statistics will be rebuilt from logs only, only for
    period covered by log files. If this parameter is not used, then
    statistics is recalculated beginning on the month on which log files
    start (if log starts in the middle of the month, then statistics
    for first half of the month will not be present.)

    -R
    --rebuild
    Rebuilds the HTML files for AWStats.

    -h
    --help
    This message.

Click on a section to expand

How script works

  • General Functionality

    1. For each specified domain (or all domains, if the -A option is used), the script will memorize the log file's start date.

    2. Then, it will remove AWStats data files for the months covered by the log files and rebuild them with corresponding information.

    3. Finally, the script will build static pages with statistics summary for each month covered by the log files.

  • -F
    If the -F option is used, all AWStats data will be removed and new files will be generated using only the information stored in the log files.

  • -R
    if the -R option is used, the script will gather all data of the mentioned domain and will generate all months, where the AWStats txt data is existing.

  • Merging Web-Statistics

    In order to merge web-statistics which was created from scratch with AWStats statistics from another directory, the corresponding .txt file should be copied from the webstat directory. For example, statistics of a domain for December were created from scratch. In this case, the following files should be copied from /var/www/vhosts/system/example.com/statistics/webstat/:

    • A .txt file dated by December 2018: awstats122018.example.com-http.txt

    At the end it required to run the script with -R to build the HMTL files:

    # ./rebuild_awstats.sh -R example.com

Click on a section to expand

Output example

For every processed domain, the script will report this message:

CONFIG_TEXT: === example.com
Saving: webstat* --> webstat*.3
Logs begin on Apr 18 2018
access_log* (new/old/corrupted): 9/0/0
access_ssl_log* (new/old/corrupted): 71/0/0
Rebuilding static pages: 2018-04 2018-05 2018-06 2018-07

The message "_Saving: webstat* --> webstat*.3 _" in the output above shows that the original directories are saved with a numeric suffix (the suffix is increased if the destination directory already exists). This makes it possible to roll-back to old AWStats statistics if needed.

In case the script was launched to recalculate statistics from scratch (with -F flag), which removes old web-statistics that is not stored in log files, it is possible to restore it from the backup that was created by the script.

Comments

4 comments

Sort by Date Votes

Please sign in to leave a comment.

Have more questions? Submit a request

Related articles