Fix remapping in modes that shouldn't be remapped
Fix remapping in modes that shouldn't be remapped

Chillee/VSCodeNeovim,westim/Vim,rufusroflpunch/Vim,rufusroflpunch/Vim,VSCodeVim/Vim,westim/Vim,VSCodeVim/Vim,westim/Vim,Chillee/VSCodeNeovim,Chillee/Vim,Chillee/Vim,Chillee/VSCodeNeovim