If you want use a base_url without /index.php you need set restful_urls = On and adjust your Apache .htaccess file to reflect such change and handling with that (what I presume you already did).
Please, double check Apache is redirecting request to right path either.
See here some more infos about it:
Regards,
Israel Cefrin
Public Knowledge Project Team