Do you also have a log file from yesterday? If so, where is it, in which folder (archive, usageEventLogs, rejected)?
Could you also take a look in your DB table scheduled_tasks
, if there is UsageStatsLoader
entry?
Thanks!
Bozana
Do you also have a log file from yesterday? If so, where is it, in which folder (archive, usageEventLogs, rejected)?
Could you also take a look in your DB table scheduled_tasks
, if there is UsageStatsLoader
entry?
Thanks!
Bozana
Hi @bozana,
Yes, itās in the same folder, usageEventLogs
.
Yes, it is there:
+--------------------------------------------------+---------------------+
| class_name | last_run |
+--------------------------------------------------+---------------------+
| lib.pkp.classes.task.ReviewReminder | 2017-02-07 22:34:01 |
| plugins.generic.usageStats.UsageStatsLoader | 2017-02-07 22:34:00 |
| plugins.importexport.crossref.CrossrefInfoSender | 2017-02-07 22:34:01 |
| plugins.importexport.datacite.DataciteInfoSender | 2017-02-07 22:34:01 |
| plugins.importexport.medra.MedraInfoSender | 2017-02-07 22:34:01 |
+--------------------------------------------------+---------------------+
Hi @Ph_We
Sorry, but could you take a look for the same information today again? ā If the file from the 07. February was processed and moved to archive and the scheduled task run yesterday ā it seems that the scheduled tasks run late in the evening, so maybe it havenāt run yesterday when you looked at it, but maybe after thatā¦
Thanks!
Bozana
Hi @bozana,
Now the file from the 7th of February is in the archive: ./archive/usage_events_20170207.log
In the usageEventLogs folder: usage_events_20170208.log usage_events_20170209.log
mysql> select * from scheduled_tasks;
+--------------------------------------------------+---------------------+
| class_name | last_run |
+--------------------------------------------------+---------------------+
| lib.pkp.classes.task.ReviewReminder | 2017-02-08 22:35:37 |
| plugins.generic.usageStats.UsageStatsLoader | 2017-02-08 22:35:36 |
| plugins.importexport.crossref.CrossrefInfoSender | 2017-02-08 22:35:37 |
| plugins.importexport.datacite.DataciteInfoSender | 2017-02-08 22:35:37 |
| plugins.importexport.medra.MedraInfoSender | 2017-02-08 22:35:37 |
+--------------------------------------------------+---------------------+
Hi @Ph_We
Yes, that looks fine. Are there now some metrics in the DB table metrics from the log file usage_events_20170207.log? If no, could you take a look in the latest (by datum) file with the name Usagestatisticsfileloadertask-ā¦log in the scheduledTasksLogs
folder, that is in the files folder?
Best,
Bozana
Hi @bozana,
Here is the current metrics
table:
[details=Summary] mysql> select * from metrics;
Ā±--------------------------Ā±-----------Ā±---------------Ā±------------------Ā±----------------Ā±--------------Ā±------------------Ā±-----------Ā±---------Ā±---------Ā±-------Ā±----------Ā±-----------Ā±-------Ā±-----Ā±-------------Ā±-------+
| load_id | context_id | pkp_section_id | assoc_object_type | assoc_object_id | submission_id | representation_id | assoc_type | assoc_id | day | month | file_type | country_id | region | city | metric_type | metric |
Ā±--------------------------Ā±-----------Ā±---------------Ā±------------------Ā±----------------Ā±--------------Ā±------------------Ā±-----------Ā±---------Ā±---------Ā±-------Ā±----------Ā±-----------Ā±-------Ā±-----Ā±-------------Ā±-------+
| usage_events_20161218.log | 3 | NULL | NULL | NULL | NULL | NULL | 259 | 104 | 20161218 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 2 |
| usage_events_20161218.log | 3 | NULL | 259 | 99 | NULL | NULL | 261 | 113 | 20161218 | 201612 | 2 | NULL | NULL | NULL | ojs::counter | 1 |
| usage_events_20161218.log | 3 | NULL | 259 | 104 | NULL | NULL | 261 | 116 | 20161218 | 201612 | 2 | NULL | NULL | NULL | ojs::counter | 3 |
| usage_events_20161218.log | 3 | NULL | 259 | 103 | NULL | NULL | 261 | 117 | 20161218 | 201612 | 2 | NULL | NULL | NULL | ojs::counter | 1 |
| usage_events_20161218.log | 3 | NULL | 259 | 102 | NULL | NULL | 261 | 118 | 20161218 | 201612 | 2 | NULL | NULL | NULL | ojs::counter | 1 |
| usage_events_20161218.log | 2 | 9 | 259 | 1 | 14 | NULL | 1048585 | 14 | 20161218 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 1 |
| usage_events_20161218.log | 2 | 5 | 259 | 4 | 44 | NULL | 1048585 | 44 | 20161218 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 1 |
| usage_events_20161218.log | 2 | 16 | 259 | 8 | 97 | NULL | 1048585 | 97 | 20161218 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 3 |
| usage_events_20161218.log | 2 | 16 | 259 | 8 | 99 | NULL | 1048585 | 99 | 20161218 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 1 |
| usage_events_20161218.log | 2 | 16 | 259 | 8 | 100 | NULL | 1048585 | 100 | 20161218 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 2 |
| usage_events_20161218.log | 2 | 16 | 259 | 8 | 101 | NULL | 1048585 | 101 | 20161218 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 1 |
| usage_events_20161220.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20161220 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 29 |
| usage_events_20161221.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20161221 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 5 |
| usage_events_20161222.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20161222 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 11 |
| usage_events_20161223.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20161223 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 3 |
| usage_events_20161224.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20161224 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 1 |
| usage_events_20161225.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20161225 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 1 |
| usage_events_20161226.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20161226 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 3 |
| usage_events_20161227.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20161227 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 3 |
| usage_events_20161228.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20161228 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 2 |
| usage_events_20161229.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20161229 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 1 |
| usage_events_20161230.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20161230 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 216 |
| usage_events_20161231.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20161231 | 201612 | NULL | NULL | NULL | NULL | ojs::counter | 455 |
| usage_events_20170101.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170101 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 173 |
| usage_events_20170102.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170102 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 45 |
| usage_events_20170103.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170103 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 15 |
| usage_events_20170104.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170104 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 11 |
| usage_events_20170105.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170105 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 10 |
| usage_events_20170106.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170106 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 6 |
| usage_events_20170107.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170107 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 3 |
| usage_events_20170108.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170108 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 7 |
| usage_events_20170109.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170109 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 19 |
| usage_events_20170110.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170110 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 10 |
| usage_events_20170111.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170111 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 4 |
| usage_events_20170112.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170112 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 7 |
| usage_events_20170113.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170113 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 6 |
| usage_events_20170114.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170114 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 2 |
| usage_events_20170115.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170115 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 2 |
| usage_events_20170116.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170116 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 4 |
| usage_events_20170117.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170117 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 8 |
| usage_events_20170118.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170118 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 6 |
| usage_events_20170119.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170119 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 9 |
| usage_events_20170120.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170120 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 3 |
| usage_events_20170121.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170121 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 8 |
| usage_events_20170122.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170122 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 3 |
| usage_events_20170123.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170123 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 3 |
| usage_events_20170124.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170124 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 4 |
| usage_events_20170125.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170125 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 8 |
| usage_events_20170126.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170126 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 9 |
| usage_events_20170127.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170127 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 6 |
| usage_events_20170128.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170128 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 6 |
| usage_events_20170129.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170129 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 4 |
| usage_events_20170130.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170130 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 3 |
| usage_events_20170131.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170131 | 201701 | NULL | NULL | NULL | NULL | ojs::counter | 11 |
| usage_events_20170201.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170201 | 201702 | NULL | NULL | NULL | NULL | ojs::counter | 3 |
| usage_events_20170202.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170202 | 201702 | NULL | NULL | NULL | NULL | ojs::counter | 5 |
| usage_events_20170207.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170207 | 201702 | NULL | NULL | NULL | NULL | ojs::counter | 2 |
| usage_events_20170208.log | 8 | NULL | NULL | NULL | NULL | NULL | 256 | 8 | 20170208 | 201702 | NULL | NULL | NULL | NULL | ojs::counter | 15 |
Ā±--------------------------Ā±-----------Ā±---------------Ā±------------------Ā±----------------Ā±--------------Ā±------------------Ā±-----------Ā±---------Ā±---------Ā±-------Ā±----------Ā±-----------Ā±-------Ā±-----Ā±-------------Ā±-------+
226 rows in set (0.01 sec)
mysql>
[/details]
Here is the list of files in the scheduledTasksLogs
folder:
-rw-rār-- 1 www-data www-data 228 Feb 2 22:04 ???-589382c74b163-20170202.log
-rw-rār-- 1 www-data www-data 228 Feb 5 22:31 ???-58977d9bf030b-20170205.log
-rw-rār-- 1 www-data www-data 228 Feb 6 22:32 ???-5898cf4eafe82-20170206.log
-rw-rār-- 1 www-data www-data 228 Feb 7 22:34 ???-589a2129685ec-20170207.log
-rw-rār-- 1 www-data www-data 228 Feb 8 22:35 ???-589b730985d0e-20170208.log
-rw-rār-- 1 www-data www-data 228 Feb 9 22:36 ???-589cc4af9046e-20170209.log
(I think, those question marks might be placeholders for Cyrillic variant of Usagestatisticsfileloadertask
:))
Here is the contents of the last log:
[2017-02-09 22:36:15] [Notice] Task process started.
[2017-02-09 22:36:15] [Notice] Task process stopped.
Hi @bozana,
Here is an update. Now Iāve found at least one journal with the stats report working normally. The strange thing is that the statistical data begins with the 9-th of February. That was the day when we changed the default address for this journal. Might that be the clue?
Here is an example: http://cmd-journal.hse.ru/article/view/2879
The statistical data for all the other journals for the year 2017 are still missingā¦
Best,
Ivan
Hi @Ph_We
Hmmmā¦
The metrics table contains some entries from this year, but only a few and they are all only journal access statistics ā no article access
What does it mean āchanged the default address for this journalā? Are your journal URLs correctly configured in config.inc.php?
Best,
Bozana
Hi @bozana,
We just changed its domain name, from something like
ojs.hse.ru/index.php/cmd
to
cmd-journal.hse.ru
.
Most of the other journals have their ānormalā addresses like ojs.hse.ru/index.php/***
BTW, our installation of OJS runs behind NGINX (thatās why IPs are not registered).
Could this be connected, see the last post: Usage stats warnings: system can't remove the base url - #7 by bozana
Yes, I also thought that this could be connected to that postā¦
All journals run in the same OJS installation, right @Ph_We?
How did you change the URL of that one journal ā did you change something in config.inc.php?
We used the recommended settings for base URL override in config.inc.php (see below). But please note, that for now this is the only journal (out of 12) for which stats reporting seems to work correctly. And we do not seem to have all those errors, which @ajnyga reported (thanks, @ajnyga).
base_url[cmd] = https://cmd-journal.hse.ru
Yes
Hi,
This sounds like the exact same problem although you do not get the errors I reported in the beginning of that thread.
Now that you have that one base_url override, you probably need to override all your journals to get the statistics to work.
For example like this:
base_url[cfjournal] = Journal of Corporate Finance Research / ŠŠ¾ŃŠæŠ¾ŃŠ°ŃŠøŠ²Š½ŃŠµ Š¤ŠøŠ½Š°Š½ŃŃ | ISSN: 2073-0438
As I mentioned in the other thread, I do not think that an override setting should work this way, but this is the only solution I found.
@ajnyga, Ah, now I see, thanks again!
@bozana, would you confirm this might be a (recommended) solution?
Yes @Ph_We, I think this might be the solution. I wanted to double check and test it locally once again, but if you could do/try it as well, it would be greatā¦
Just to confirm that after defining the base_urlās for our journals I no longer get the error messages mentioned there and all the journals are getting hits in the metrics table.
OK, weāve tried that on another journal and stats really appeared. Today weāll do that for all the other ones.
Could you exactly explain what did you added?
The entries in the DB table metrics look fine, the usage stats log file processing as wellā¦
Best,
Bozana
Hmmmā¦ Is this your journal: http://journalppw.com/index.php/JPPW/issue/view/1 ā I can see the numbers there
The content of the log file from your last post is OK ā that process logs when it starts and when it stops. That scheduled task log file is from 22th of September (you can see it in the file name Usagestatisticsfileloadertask-59c558c5a7915-20170922.log). It seems that on that day several usage stats log files were successfully processed and archived, from 8th of March till 21th of September.
Where are the other, more recent usage log files? Do you see them in your usageStats/ folder in your files_dir?
Do you have any entry in your DB table metrics with submission id = 13 or submission id = 16 or submission id = 20?
Do you have any entry in your DB table metrics with the date later then 21th of September?
Best,
Bozana