Abstract views, PDF views and Download Stats Made Public 😶

Hi,
Thank you for the info but am somehow skeptical doing the upgrade particularly when it hits my mind that maybe the upgrade is no gonna be the solution to the metrics issue. I have seen pple on this forum whose metrics are showing but running the same version i have, others running version 2.4.X. Might there be a different solution to this?

Hi @otuya1

Yes, maybe first to find out the problem.

From my earlier post:
Could you take a look in those log files to see if there are any article or galley view URLs?
Are the log files successfully processed and moved to the folder archive?

2.4.x is fine – the plugin works there. Could you send the link from the post where the plugin is working with 3.0 version?

Best,
Bozana

Thanks @bozana for quick reply.

My usageStatlogs folder got two files both dated today: See below part of the log file

197.248.78.90 administrative 1 “2017-08-17 23:48:31” https://iprjb.org/journals/index.php/AJEP/article/view/50 200 “Mozilla/5.0 (Windows NT 6.1; rv:54.0) Gecko/20100101 Firefox/54.0”
197.248.78.90 administrative 1 “2017-08-17 23:49:02” Journal of Public Policy and Administration 200 “Mozilla/5.0 (Windows NT 6.1; rv:54.0) Gecko/20100101 Firefox/54.0”
197.248.78.90 administrative 1 “2017-08-17 23:49:26” Journal of Public Policy and Administration 200 “Mozilla/5.0 (Windows NT 6.1; rv:54.0) Gecko/20100101 Firefox/54.0”
197.248.78.90 administrative 1 “2017-08-17 23:49:43” https://iprjb.org/journals/index.php/JPPA/article/view/90 200 “Mozilla/5.0 (Windows NT 6.1; rv:54.0) Gecko/20100101 Firefox/54.0”
112.133.251.73 - - “2017-08-17 23:49:53” Journal of Animal Health 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:51:09” Journal of Health, Medicine and Nursing 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:51:29” Vol. 1 No. 1 (2017) | Journal of Health, Medicine and Nursing 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:51:41” https://iprjb.org/journals/index.php/JHMN/article/download/271/493/1667 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:51:43” https://iprjb.org/journals/index.php/JHMN/article/download/273/494/1668 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:51:43” https://iprjb.org/journals/index.php/JHMN/article/download/270/492/1666 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:51:44” https://iprjb.org/journals/index.php/JHMN/article/download/274/496/1670 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:51:50” https://iprjb.org/journals/index.php/JHMN/article/download/273/494/1668 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:51:42” https://iprjb.org/journals/index.php/JHMN/article/download/272/363/1285 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:51:55” https://iprjb.org/journals/index.php/JHMN/article/download/270/492/1666 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
68.227.248.106 - - “2017-08-17 23:52:00” https://iprjb.org/journals/index.php/AJEP/article/view/50 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Firefox/52.0”
112.133.251.73 - - “2017-08-17 23:51:55” https://iprjb.org/journals/index.php/JHMN/article/download/274/496/1670 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:51:49” https://iprjb.org/journals/index.php/JHMN/article/download/271/493/1667 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:52:05” https://iprjb.org/journals/index.php/JHMN/article/download/272/363/1285 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
66.249.79.30 bot - “2017-08-17 23:53:31” https://iprjb.org/journals/index.php/AJCET/article/download/284/381/1352 200 “Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)”
212.49.65.155 - - “2017-08-17 23:54:37” https://iprjb.org/journals/index.php/IJTS/article/view/29 200 “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.90 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:54:43” Vol. 1 No. 2 (2017) | Journal of Health, Medicine and Nursing 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:54:49” https://iprjb.org/journals/index.php/JHMN/article/download/276/498/1672 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:54:51” https://iprjb.org/journals/index.php/JHMN/article/download/276/498/1672 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:54:49” https://iprjb.org/journals/index.php/JHMN/article/download/301/499/1673 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:54:51” https://iprjb.org/journals/index.php/JHMN/article/download/303/500/1674 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:54:54” https://iprjb.org/journals/index.php/JHMN/article/download/301/499/1673 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:54:55” https://iprjb.org/journals/index.php/JHMN/article/download/302/472/1631 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:54:56” https://iprjb.org/journals/index.php/JHMN/article/download/303/500/1674 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:54:59” https://iprjb.org/journals/index.php/JHMN/article/download/302/472/1631 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:57:19” Journal of Health, Medicine and Nursing 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:57:28” Global Journal of Health Sciences 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:57:40” Vol. 1 No. 1 (2016) | Global Journal of Health Sciences 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:57:47” https://iprjb.org/journals/index.php/GJHS/article/download/40/69/208 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:57:48” https://iprjb.org/journals/index.php/GJHS/article/download/53/85/260 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:57:50” https://iprjb.org/journals/index.php/GJHS/article/download/96/133/434 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:57:52” https://iprjb.org/journals/index.php/GJHS/article/download/74/141/466 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:57:55” https://iprjb.org/journals/index.php/GJHS/article/download/53/85/260 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:57:54” https://iprjb.org/journals/index.php/GJHS/article/download/77/113/356 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:57:56” https://iprjb.org/journals/index.php/GJHS/article/download/151/195/682 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:57:53” https://iprjb.org/journals/index.php/GJHS/article/download/40/69/208 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:58:05” https://iprjb.org/journals/index.php/GJHS/article/download/96/133/434 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:58:05” https://iprjb.org/journals/index.php/GJHS/article/download/74/141/466 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:58:14” https://iprjb.org/journals/index.php/GJHS/article/download/151/195/682 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”
112.133.251.73 - - “2017-08-17 23:58:15” https://iprjb.org/journals/index.php/GJHS/article/download/77/113/356 200 “Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.110 Safari/537.36”

In addition to this, my stage and processing folders are empty, very old(more than a month) logs are in archived while most recent logs are in reject folder. What makes them to be rejected?

more logs:
41.79.226.19 - - “2017-08-17 00:00:56” https://iprjb.org/journals/index.php/IJFA/article/download/243/310/1119 200 “Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko”
66.249.79.30 bot - “2017-08-17 00:01:07” https://iprjb.org/journals/index.php/IJFA/article/view/2 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”
66.249.79.130 bot - “2017-08-17 00:01:32” International Journal of Online and Distance Learning 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”
66.249.79.30 bot - “2017-08-17 00:01:40” https://iprjb.org/journals/index.php/GJHS/article/view/53 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”
66.249.79.30 bot - “2017-08-17 00:01:52” International Journal of Technology and Systems 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”
66.249.79.30 bot - “2017-08-17 00:02:03” https://iprjb.org/journals/index.php/JHMN/article/download/270/492/1666 200 “Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)”
66.249.79.3 bot - “2017-08-17 00:02:44” Vol. 1 No. 3 (2017) | Journal of Human Resource and Leadership 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”
66.249.79.30 bot - “2017-08-17 00:03:23” https://iprjb.org/journals/index.php/IJFA/article/download/176/225/805 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”
66.249.79.30 bot - “2017-08-17 00:03:34” Vol. 1 No. 1 (2016) | Journal of Public Policy and Administration 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”
66.249.79.30 bot - “2017-08-17 00:03:52” https://iprjb.org/journals/index.php/IJCPR/article/view/78 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”
66.249.79.30 bot - “2017-08-17 00:04:09” Journal of Health, Medicine and Nursing 200 “Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)”
66.249.79.3 bot - “2017-08-17 00:04:09” Vol. 1 No. 1 (2016) | International Journal of Economics 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”
66.249.79.30 bot - “2017-08-17 00:04:18” Journal of Statistics and Actuarial Research 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”
66.249.79.30 bot - “2017-08-17 00:04:37” https://iprjb.org/journals/index.php/AJEP/article/view/50 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”
66.249.79.3 bot - “2017-08-17 00:06:16” International Journal of Psychology 200 “Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)”
77.88.5.1 bot - “2017-08-17 00:06:33” https://iprjb.org/journals/index.php/AJEP/article/view/18 200 “Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)”
66.249.79.30 bot - “2017-08-17 00:06:36” https://iprjb.org/journals/index.php/GJHS/article/download/77/113/356 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”
66.249.79.30 bot - “2017-08-17 00:06:43” https://iprjb.org/journals/index.php/IJECON/article/view/3 200 “Googlebot/2.1 (+http://www.google.com/bot.html)”

The processing error message should be in the latest log file in the folder scheduledTaskLogs. Could you take a look and post the error message? Lets first figure out what is happening here…

The log files seem to be OK i.e. the access to articles is logged correctly. Thus, something goes wrong with processing.

Is the Usage Statistics plugin enabled for all your journals?

Okay, first of all here, the contents of my scheduledTaskLogs

image

when i open the #plugins.generic.usageStats… folder, below is what i see:

[2017-08-18 01:16:32] https://iprjb.org/journals
[2017-08-18 01:16:32] [Notice] Task process started.
[2017-08-18 01:16:34] [Error] Cannot load record: submission file is not associated with a representation object.
[2017-08-18 01:16:34] [Notice] Task process stopped.

Hmmm… You log files contain URLs that do not exist, e.g.
https://iprjb.org/journals/index.php/IJCPR/article/view/78
https://iprjb.org/journals/index.php/AJEP/article/view/50
https://iprjb.org/journals/index.php/AJEP/article/view/18

Do you know what is going on with those articles – did they ever exist and if so why are they not there any more?

It can be that the plugin does not find the article and stops processing the log file further. You would then eventually have to remove all the wrong URLs from those log files…

The error message from your scheduled task log file looks similar to the problem here https://github.com/pkp/pkp-lib/issues/2134#issuecomment-270927868

… a few of your log files contains download link of a file that is not a galley … When processed, the error occurs here: https://github.com/pkp/pkp-lib/blob/master/classes/statistics/PKPMetricsDAO.inc.php#L362 and the processing stops at that place i.e. further entries will not be inserted into the metrics table. …

This is for example one bug fix since 3.0 version. However, also with the patch you will have to remove those wrong URLs from the log files :frowning:

I have no idea. Maybe a few things changed when we had an upgrade from 2.4.8 to OJS3.

Does this mean i clear all the logs for the system start recording new ones or ? Am not so good with OJS

If you would like to have the old log files successfully processed, you would need to patch your current OJS version, remove all the wrong URLs from the log files and reprocess them again.
You can just keep using the new ones, but they might be buggy as well – the 3.0 version is maybe not logging the access correctly (as it was the case in that GitHub issue, for example). You can track/see what is happening with the new log files – are the article URLs correctly logged and processed.
If also the new log files are buggy and not processed correctly – it means that the 3.0 version is buggy – you would have to apply all the patches to fix the bugs or upgrade to the most recent OJS version. When the code is fixed, then you can decide if you would like to fix the old log files or just continue with the new ones.

Best,
Bozana

Hi @bozana, i just upgraded to 3.0.2, i also deleted all old logs and enabled the usagestatplugin.

Am hoping that the system will now log correct paths. How long will i wait before i can see any changes? i have one file in my usageEventLogs folder which was logged barely 20min ago

Hi @otuya1

Access different web pages today and immediately take a look if they are correctly logged. If everything is logged correctly, wait till tomorrow to see if the log file is processed correctly – the log files should be processed daily – that log file should be then moved to the folder archive/ and you should see all the metrics in your DB table metrics.
If you have several journals double check that the Usage Statistics is enabled for all journals. Ensure that the Acron plugin is enabled and that the permissions for the files_dir are correct.

Best,
Bozana

Thank you. Am on it.

@bozana, Hi, hope you you fine. So its a new day and noting is happened. I still have yesterday’s log file in my usageEventLogs , all other folders(stage,processing,reject, archive) are empty. Surprising enough; scheduledTaskLogs is also empty! Any ideas.

Hi @otuya1

Could you take a look in your DB table scheduled_tasks? When is the class UsageStatsLoader run for the last time?
Could you remove that row with class_name = plugins.generic.usageStats.UsageStatsLoader from the table scheduled_tasks and open an article page – to trigger the scheduled task execution with Acron plugin.
Have you double checked the files permissions of your files_dir? Is Acron plugin enabled? Is Usage Statistics plugin enabled for each journal?

Best,
Bozana

oh yeah… i think it is working now, i can see some metrics :smiley::smiley::smiley::smiley:

It actually was the solution. Thank you.

Oh and by the way graph not showing for some articles

Hi @otuya1

Glad it works…

I think that those articles without the graph haven’t been accessed in this year yet…

Please watch your log files and metrics for a few more days, maybe also to do some specific tests, to see if everything is working well…

Best,
Bozana

Hi @bozana,

Do I need to change the scheduled_tasks to on in the configuration file?

I am seeing stats, but scheduled_task is not on.

-Newone