Problem with UsageStats

Hello,

We’ve been using OJS to manage our online Review of Disability Studies Journal for over three years, and we’re having some recurring problems with UsageStats.

We’re not able to access any stats for the last six months, and we’re receiving email error messages about the UsageStats loader (Usage Statistics File Loader Task Error).

We’ve tried the following to address the error:

  1. Placed the logs in the stage folder and waited 24 hours for UsageStatsLoader (Acron) to process the logs

  2. Used the command to trigger the UsageStatsLoader to process right away (see https://pkp.sfu.ca/wiki/index.php?title=PKP_Statistics_Framework#Geolocation_database)

  3. Placed all logs in usageEventLogs, and deleted the row table scheduled_tasks in the DB to trigger reprocessing.

Here are the results:

#1 is not working: the file in stage folder is not being processed.

#2 is not working: the logs are moved to reject folder, then you receive the error notices with the following: [2017-09-08 08:42:38] [Error] The COUNTER bot list could not be found, or more than one list is present. The file /home/rdsjournal/uploads/usageStats/processing/usage_events_20170621.log could not be processed.

#3 is not working: similar to #2 the logs are moved to reject folder, then you receive the error notices with the following: [2017-09-08 08:42:38] [Error] The COUNTER bot list could not be found, or more than one list is present. The file /home/rdsjournal/uploads/usageStats/processing/usage_events_20170621.log could not be processed.

Any advice you could offer to help troubleshoot this problem would be greatly appreciated.

Thanks.

-Trip

Hi @wrems

What OJS version are you using?

What do you have in you folder plugins/generic/usageStats/lib/counter/?

It looks like something would be wrong with the COUNTER bot list file there, as the error says.
I do not know if this was the problem from the beginning – you could eventually investigate the earlier scheduled task log files (in the folder files_dir/scheduledTaskLogs/Usagestatisticsfileloadertask-…log).
Or, when this problem is fixed, you could try again and you will see if there is another problem…

(The files are automatically moved to the stage folder i.e. no need to do number 1 above. This step would be needed if the following scheduled tasks script would be run: plugins/generic/usageStats/scheduledTasks.xml.)

Best,
Bozana

Hi Bozana,

Thanks for the quick reply. Regarding your questions:

  1. We’re using OJS version 2.4.8.2.

  2. There is only one file under ‘plugins/generic/usageStats/lib/counter/’: (COUNTER_robot_txt_list_Jan_2011.txt).

Thanks again for your help.

Aloha,

-Trip

Hi @wrems

Hmmm… The error occurs here: ojs/UsageStatsLoader.inc.php at ojs-2_4_8-2 · pkp/ojs · GitHub.
The varialbe _counterRobotsListFile is set here: ojs/UsageStatsLoader.inc.php at ojs-2_4_8-2 · pkp/ojs · GitHub
i.e. this function is called: ojs/UsageStatsLoader.inc.php at ojs-2_4_8-2 · pkp/ojs · GitHub.
Would it be possible for you to somehow debug that function, e.g. to print out the variable $file before this line: ojs/UsageStatsLoader.inc.php at ojs-2_4_8-2 · pkp/ojs · GitHub ?

Thanks!
Bozana

1 Like