OJS rate reviewer who didn’t complete

In OJS you can set up reviewing so an editor rates a reviewer on completion of a review. If a reviewer doesn’t complete a review and eventually has to be cancelled as a reviewer, is there any way for an editor to give them a rating? The only other options I can think of are to delete them from the reviewer DB or to tell all the editors offline, neither entirely satisfactory.