I use Gmail smtp service in other projects (but not anymore in OJS), but theres is a topic regards about it:
If not helps, perhaps you may paste an mail error log portion from your server with SMTP message error, probably there is some tip about what is going on and makes it easier to help you either. Even using Gmail account, all connection errors from server are recorded in log error.
Best
Israel