Hi, sorry scratch this entire thing.
The issue was that the key-commands were interfering with the same commands in Spectacle. So when I switched spaces Spectacle was also switching monitors. I’m assuming there was a race condition here which is why it was intermittent.