Frontmost Finder window also appears when activating Visor

When activating the visor (^`), whatever window happens to be frontmost in the finder (a normal Finder window or the Finder preferences) will also appear on top of the current App. This undermines the usefulness of the Visor window as a quick way to access the file system from within other apps, as the additional Finder window often obscures the current app.

Is there a hidden preference or plist setting that I’m missing, (or may have turned on in the past) that may be causing this?