Hi @tannerna,
Presently, I don’t believe that such functionality exists in OJS, and it doesn’t appear to be planned for future development, so far as I can tell. Your use case sounds similar to what is featured in this feature request here: Pull Reviewer Ratings in Reviewer Report? - #2 by rcgillis
You may wish to add your comments and voice your support for such functionality on that post.
-Roger
PKP Team