Hi @fasken,
We notice this behavior on 3.4 OJS version too. Some automatic emails sent by OJS on 3.4 version seems not have an efficient filter rules and create some misunderstanding with journal contributors.
I reported an unexpected behavior about an automatic reviewer reminder that had already responded and been thanked at this post