[OJS 3.1.2.4] Blank statistics after upgrade

Hi @pmangahis ,

I just upgrade OJS to 3.1.2.4. With latest version Journal statistic doesnt work. After successful upgrade Journal statistic still doesnt work. I track all posts, check almost everything but the problem still exist.
Do you have concrete suggestion what to do and how to solve the problem with statistic report? Statistical graphic doesn`t work, Statistic Articles reports… nothing.

Regards,
Lazar

1 Like

Hi @Lazar_Stosic,

Can you check you PHP error log to see if this shows anything?

Kind Regards,
Patricia M.
Public Knowledge Project

Hi @pmangahis ,
When I click to Statistics/Articles in PHP error log received:

[02-Jan-2020 22:24:06 Europe/Belgrade] ojs2: 404 Not Found
[02-Jan-2020 22:25:17 Europe/Belgrade] PHP Warning: Declaration of SubmissionSubjectEntryDAO::getByControlledVocabId($controlledVocabId, $rangeInfo = NULL) should be compatible with ControlledVocabEntryDAO::getByControlledVocabId($controlledVocabId, $rangeInfo = NULL, $filter = NULL) in /home/ijcadsee/public_html/lib/pkp/classes/submission/SubmissionSubjectEntryDAO.inc.php on line 20
[02-Jan-2020 22:25:17 Europe/Belgrade] PHP Warning: Declaration of SubmissionDisciplineEntryDAO::getByControlledVocabId($controlledVocabId, $rangeInfo = NULL) should be compatible with ControlledVocabEntryDAO::getByControlledVocabId($controlledVocabId, $rangeInfo = NULL, $filter = NULL) in /home/ijcadsee/public_html/lib/pkp/classes/submission/SubmissionDisciplineEntryDAO.inc.php on line 44
[02-Jan-2020 22:25:17 Europe/Belgrade] PHP Warning: Declaration of SubmissionKeywordEntryDAO::getByControlledVocabId($controlledVocabId, $rangeInfo = NULL) should be compatible with ControlledVocabEntryDAO::getByControlledVocabId($controlledVocabId, $rangeInfo = NULL, $filter = NULL) in /home/ijcadsee/public_html/lib/pkp/classes/submission/SubmissionKeywordEntryDAO.inc.php on line 45
[02-Jan-2020 22:25:17 Europe/Belgrade] PHP Warning: Declaration of SubmissionAgencyEntryDAO::getByControlledVocabId($controlledVocabId, $rangeInfo = NULL) should be compatible with ControlledVocabEntryDAO::getByControlledVocabId($controlledVocabId, $rangeInfo = NULL, $filter = NULL) in /home/ijcadsee/public_html/lib/pkp/classes/submission/SubmissionAgencyEntryDAO.inc.php on line 44

No other errors.

Kind regards,
Lazar

Hi @Lazar_Stosic,

When you say the statistics tools don’t work, can you describe what you mean? Do you get blank pages (suggestive of PHP errors), empty reports (suggestive of a log processing problem), or something else?

Regards,
Alec Smecher
Public Knowledge Project Team

[root@srva public_html]# php tools/runScheduledTasks.php plugins/generic/usageStats/scheduledTasks.xml
PHP Fatal error:  Uncaught Error: Call to a member function getCategory() on null in /home/ojs/web/ojs.webojs.com/public_html/plugins/generic/usageStats/UsageStatsLoader.inc.php:479
Stack trace:
#0 /home/ojs/web/ojs.webojs.com/public_html/plugins/generic/usageStats/UsageStatsLoader.inc.php(438): UsageStatsLoader->getOJSAssoc(515, Array, 'article', 'download', Array)
#1 /home/ojs/web/ojs.webojs.com/public_html/plugins/generic/usageStats/UsageStatsLoader.inc.php(174): UsageStatsLoader->getAssoc(515, Array, 'article', 'download', Array)
#2 /home/ojs/web/ojs.webojs.com/public_html/lib/pkp/classes/task/FileLoader.inc.php(167): UsageStatsLoader->processFile('/home/ojs...')
#3 /home/ojs/web/ojs.webojs.com/public_html/plugins/generic/usageStats/UsageStatsLoader.inc.php(127): FileLoader->executeActions()
#4 /home/ojs/web/ojs.webojs.com/public_html/lib/pkp/classes/scheduledTask/ScheduledTask.inc.php(148): UsageStatsLoader->executeActions()
#5 /home/ojs/web/ojs in /home/ojs/web/ojs.webojs.com/public_html/plugins/generic/usageStats/UsageStatsLoader.inc.php on line 479

can u help me?

Hi @ciptoblues,

I think that’s a different problem than we’re discussing here; could you post it as a new topic?

Thanks,
Alec Smecher
Public Knowledge Project Team

Hi @asmecher ,
thanks for your support, as always.
First, I deleted error.log, want to see what happened when click Statistics/Articles. After click I received only>
[04-Jan-2020 19:48:56 Europe/Belgrade] ojs2: 404 Not Found
In Statistics/Articles I have got>
Articles
For separate article I received
Downloads
When I click Statistics/Report Generator received>

[04-Jan-2020 19:48:56 Europe/Belgrade] ojs2: 404 Not Found
[04-Jan-2020 19:50:03 Europe/Belgrade] ojs2: 404 Not Found
[04-Jan-2020 19:50:34 Europe/Belgrade] ojs2: 404 Not Found
[04-Jan-2020 19:51:32 Europe/Belgrade] ojs2: 404 Not Found
[04-Jan-2020 19:52:53 Europe/Belgrade] PHP Warning: Declaration of SubmissionKeywordEntryDAO::getByControlledVocabId($controlledVocabId, $rangeInfo = NULL) should be compatible with ControlledVocabEntryDAO::getByControlledVocabId($controlledVocabId, $rangeInfo = NULL, $filter = NULL) in /home/ijcadsee/public_html/lib/pkp/classes/submission/SubmissionKeywordEntryDAO.inc.php on line 20
[04-Jan-2020 19:52:57 Europe/Belgrade] ojs2: 404 Not Found
[04-Jan-2020 19:53:57 Europe/Belgrade] ojs2: 404 Not Found

I had problems with latest version OJS. After upgrade the problems still exists. I read all forum posts, check a lot of settings but nothing.
Any idea what and where to check?

Kind regards,
Lazar

Any idea? There are a lot of posts with this issue but not and concrete results or patch.

@Lazar_Stosic, let’s check to see if your usage statistics logs are actually processing into metrics after the upgrade.

Are you comfortable with direct access to the mysql tables? I’m curious what recent data you have in the metrics table.

Please also look in your private files_dir, under the “usageStats” folder. Do files here appear to be moving from “usageEventLogs” to “processing” to “archive”? If you see older files in “usageEventLogs” or in “reject”, this may indicate a processing error.

Ok. Thank you for you answer and wish to help.
In metrics table have older data till date 20191105 when statistics stop working
image

In “usageEventLogs” have usage_events_20200226.log
“processing” folder is empty
“archive” folder have a lot of files, older till yesterday

If you need more information I am ready to present it.

This sounds like your usageEventLogs are being processed “without error”, but are not resulting in new metrics. Please check the logs in files_dir under “scheduledTaskLogs”. You should find files like: Usagestatisticsfileloadertask-*-2020????.log.

What do recent files here report?

Today file is Usagestatisticsfileloadertask-5e568aee96259-20200226.log and report:

[2020-02-26 16:12:46] http://www.ijcrsee.com/index.php/ijcrsee
[2020-02-26 16:12:46] [Notice] Task process started.
[2020-02-26 16:12:46] [Notice] File /home/ijcadsee/files3114/usageStats/processing/usage_events_20200225.log was processed and archived.
[2020-02-26 16:12:46] [Notice] Task process stopped.

But, in someone has:

[2020-02-12 15:04:38] http://www.ijcrsee.com/index.php/ijcrsee
[2020-02-12 15:04:38] [Notice] Task process started.
[2020-02-12 15:04:38] [Warning] Usage statistics plugin is disabled. No log files processed.
[2020-02-12 15:04:38] [Notice] Task process stopped.

[2020-02-22 15:36:59] http://www.ijcrsee.com/index.php/ijcrsee
[2020-02-22 15:36:59] [Notice] Task process started.
[2020-02-22 15:36:59] [Notice] File /home/ijcadsee/files3114/usageStats/processing/usage_events_20200118.log was processed and archived.
[2020-02-22 15:36:59] [Notice] Task process stopped.

I was hoping that messages in these logs might point to logfile lines being individually rejected or similar.

The warning that the Usage Statistics plugin is disabled on 12 Feburary is odd, as is they processing of 18 January’s log on 22 February, but neither explain why statistics wouldn’t be present for 25 Feb or 18 January.

If you look at the contents of
/home/ijcadsee/files3114/usageStats/archive/usage_events_20200225.log
and
/home/ijcadsee/files3114/usageStats/archive/usage_events_20200118.log
do you see access log lines as you might expect for a typical day?

for log /home/ijcadsee/files3114/usageStats/archive/usage_events_20200225.log I have a lot of records:
91.242.162.103 bot - “2020-02-25 00:07:54” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/56 200 “user-agent Mozilla/5.0 (compatible; Qwantify/Bleriot/1.1; +https://help.qwant.com/bot;)”
34.236.26.31 bot - “2020-02-25 00:08:49” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/44 200 “com.plumanalytics”
34.236.26.31 bot - “2020-02-25 00:10:22” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/41 200 “com.plumanalytics”
91.242.162.103 bot - “2020-02-25 00:11:40” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/56 200 “user-agent Mozilla/5.0 (compatible; Qwantify/Bleriot/1.1; +https://help.qwant.com/bot;)”
34.236.26.31 bot - “2020-02-25 00:13:36” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/42 200 “com.plumanalytics”
66.249.79.51 bot - “2020-02-25 00:14:09” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/download/425/287/1770 200 “Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.92 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)”
34.231.43.114 bot - “2020-02-25 00:14:48” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/82 200 “com.plumanalytics”
34.236.26.31 bot - “2020-02-25 00:15:08” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/47 200 “com.plumanalytics”
91.242.162.103 bot - “2020-02-25 00:15:31” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/56 200 “user-agent Mozilla/5.0 (compatible; Qwantify/Bleriot/1.1; +https://help.qwant.com/bot;)”
34.236.26.31 bot - “2020-02-25 00:16:38” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/48 200 “com.plumanalytics”
64.233.172.72 bot - “2020-02-25 00:17:29” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.75 Safari/537.36 Google Favicon”
34.236.26.31 bot - “2020-02-25 00:18:14” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/45 200 “com.plumanalytics”
34.236.26.31 bot - “2020-02-25 00:19:43” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/46 200 “com.plumanalytics”
117.20.48.80 - - “2020-02-25 00:25:42” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/158 200 “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.122 Safari/537.36”
34.236.26.31 bot - “2020-02-25 00:27:50” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/18 200 “com.plumanalytics”

for log /home/ijcadsee/files3114/usageStats/archive/usage_events_20200118.log have also a lot of records:
66.249.64.26 bot - “2020-01-18 00:26:13” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)”
178.174.227.127 - - “2020-01-18 00:29:01” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/download/2/187/576 200 “Mozilla/5.0 (Linux; Android 9; SM-A105FN) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.116 Mobile Safari/537.36”
121.221.68.110 - - “2020-01-18 00:44:53” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/download/216/266/1286 200 “Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Safari/537.36”
36.90.208.210 - - “2020-01-18 00:58:07” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:72.0) Gecko/20100101 Firefox/72.0”
36.90.208.210 - - “2020-01-18 01:05:14” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/issue/view/16 200 “Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:72.0) Gecko/20100101 Firefox/72.0”
61.130.106.126 - - “2020-01-18 01:44:07” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko”
61.130.106.126 - - “2020-01-18 01:44:08” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko”
61.130.106.126 - - “2020-01-18 01:44:48” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko”
61.130.106.126 - - “2020-01-18 01:44:50” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko”
61.130.106.126 - - “2020-01-18 01:44:53” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko”
61.130.106.126 - - “2020-01-18 01:44:54” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko”
61.130.106.126 - - “2020-01-18 01:45:00” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko”
61.130.106.126 - - “2020-01-18 01:45:02” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko”
61.130.106.126 - - “2020-01-18 01:45:05” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko”
61.130.106.126 - - “2020-01-18 01:45:07” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko”
61.130.106.126 - - “2020-01-18 01:45:10” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/issue/view/16 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko”
61.130.106.126 - - “2020-01-18 01:45:12” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/issue/view/16 200 “Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko”
66.249.83.192 bot - “2020-01-18 01:45:44” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/21 200 “Mozilla/5.0 (Linux; Android 4.2.1; en-us; Nexus 5 Build/JOP40D) AppleWebKit/535.19 (KHTML, like Gecko; googleweblight) Chrome/38.0.1025.166 Mobile Safari/535.19”
66.249.83.213 bot - “2020-01-18 01:45:45” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/download/21/207/731 200 “Mozilla/5.0 (Linux; Android 4.2.1; en-us; Nexus 5 Build/JOP40D) AppleWebKit/535.19 (KHTML, like Gecko; googleweblight) Chrome/38.0.1025.166 Mobile Safari/535.19”
66.249.64.26 bot - “2020-01-18 01:46:34” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/82 200 “Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)”
52.86.112.146 bot - “2020-01-18 02:01:15” http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/index 200 “Scrapy/1.5.0 (+https://scrapy.org)”

Your URLs in the logs look odd. Notice the repetition of “/index.php/ijcrsee” in http://www.ijcrsee.com/index.php/ijcrsee/index.php/ijcrsee/article/view/56.

What are your base_url and base_url[ijcrsee] (if applicable) settings in config.inc.php?

; The canonical URL to the OJS installation (excluding the trailing slash)
base_url = “http://www.ijcrsee.com/index.php/ijcrsee

From some reason, since November.5 all stopped working. I saw repetition of “/index.php/ijcrsee” but I did not do nothing and that is strange.

The base_url here should be:

base_url = http://www.ijcrsee.com

It should not contain a reference to a specific journal context.

OJS will add the component “/index.php” if you do not have restful_urls turned on, and will add the component “/ijcrsee” for any journal-specific URLs.

The formulation of a base_url with the journal’s context path would be appropriate a bit later in the config.inc.php, as:

base_url[ijcrsee] = http://www.ijcrsee.com/index.php/ijcrsee

but, this would only be necessary if the journal’s path were to be re-written so that is it not based on the base_url.

After correcting the base URL, see if the new logs generated process into metrics correctly. If so, we can discuss how to reprocess the existing logs.

I changed the base url as you suggest and now in the log /home/ijcadsee/files3114/usageStats/archive/usage_events_20200228.log I received valid links.

109.92.154.24 - - “2020-02-28 15:31:05” http://www.ijcrsee.com/index.php/ijcrsee/index 200 “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Safari/537.36”
109.92.154.24 - - “2020-02-28 15:31:09” http://www.ijcrsee.com/index.php/ijcrsee/article/view/461 200 “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Safari/537.36”
109.92.154.24 - - “2020-02-28 15:31:14” http://www.ijcrsee.com/index.php/ijcrsee/article/download/461/299/2151 200 “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Safari/537.36”
109.92.154.24 - - “2020-02-28 15:31:21” http://www.ijcrsee.com/index.php/ijcrsee/article/view/461 200 “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Safari/537.36”

What to do next?

Easiest will be to wait for this log to be processed tomorrow, and check the metrics table to see if it was populated.

If you want to process the log sooner as a test, we can provide instructions on how to do that.

I will wait till tomorrow and inform you. You are so busy to work only with me.
Thank you for assistance. I will inform you tomorrow.