libinput: signal input remove on libinput backend destroy
libinput: signal input remove on libinput backend destroy

This lets the upper crust cleanup and free their own states

ascent12/wlroots,SirCmpwn/wlroots,swaywm/wlroots,ascent12/wlroots,swaywm/wlroots