Assuming that the extension that you’re using is based on the automatically-constructed internal connection map, I don’t think there would be an easy way to suppress the relevant directions as being valid for movement.
You may be better off by implementing the window as something other than a door, similar to the bushes from your earlier question (How to connect rooms using non-corresponding directions? - #4 by Ponpoko).