Error in processing log files

ctgraham · July 7, 2015, 3:15pm

I wonder how your journals with restful URLs are working with restful_urls = Off.

You can test your theory by turning off scheduled_tasks_report_error_only and examining the mail from (re)procesing a logfile. I suspect the email will report the warning plugins.generic.usageStats.removeUrlError (“Could not remove base URL from…”) for each line relating to access within one of these journals.

This would come from:

github.com

pkp/ojs/blob/ojs-stable-2_4_6/plugins/generic/usageStats/UsageStatsLoader.inc.php#L376


	function _getAssocFromUrl($url, $filePath, $lineNumber) {
		// Check the passed url.
		$assocId = $assocType = $journalId = false;
		$expectedPageAndOp = $this->_getExpectedPageAndOp();

		$pathInfoDisabled = Config::getVar('general', 'disable_path_info');

		// Apache and ojs log files comes with complete or partial
		// base url, remove it so system can retrieve path, page,
		// operation and args.
		$url = Core::removeBaseUrl($url);
		if ($url) {
			$contextPaths = Core::getContextPaths($url, !$pathInfoDisabled);
			$page = Core::getPage($url, !$pathInfoDisabled);
			$operation = Core::getOp($url, !$pathInfoDisabled);
			$args = Core::getArgs($url, !$pathInfoDisabled);
		} else {
			// Could not remove the base url, can't go on.
			$this->addExecutionLogEntry(__('plugins.generic.usageStats.removeUrlError',
				array('file' => $filePath, 'lineNumber' => $lineNumber)), SCHEDULED_TASK_MESSAGE_TYPE_WARNING);
			return array(false, false);

A quick reading of the logic in the Core::_getBaseUrlAndPath() might point to the situation you are describing:

github.com

pkp/pkp-lib/blob/ojs-stable-2_4_6/classes/core/Core.inc.php#L320


	}

	/**
	 * Try to get the base url and, if configuration
	 * is set to use base url override, context
	 * path for the passed url.
	 * @param $url string
	 * @return array Base url and context path strings,
	 * false if not found or not the case.
	 */
	function _getBaseUrlAndPath($url) {
		$baseUrl = false;
		$contextPath = false;

		// Check for override base url settings.
		$contextBaseUrls =& Config::getContextBaseUrls();

		if (empty($contextBaseUrls)) {
			$baseUrl = Config::getVar('general', 'base_url');
		} else {
			// Arrange them in length order, so we make sure

marchitelli · July 7, 2015, 3:50pm

So, the log of processing log is full of rows similar to this one

[2015-07-07 17:39:39] [Warning] The line number 2 from the file /ojs-uploads/riviste.unimi/usageStats/processing/usage_events_20150629.log contains an url that the system can't remove the base url from.

the line 2 of the log file is

5.9.112.6 - - "2015-06-29 00:00:23" http://riviste.unimi.it/index.php/promoitals/article/download/433/621 200 "Mozilla/5.0 (Macintosh; Intel Mac OS X 1084) AppleWebKit/536.29.13 (KHTML like Gecko) Version/6.0.4 Safari/536.29.13"

this is an url without override

If I add in config.inc.php an override for each base_url[journalname] (ever if it is the same of the root base_url) and then re-run the log processing the sceduled task log has no errors and the data are shown.