swaybar: Fix input device removal
swaybar: Fix input device removal

Before swaybar would exit with a protocol error when a pointer or touch
device was removed.

ascent12/sway,SirCmpwn/sway,1ace/sway,ascent12/sway,ascent12/sway,1ace/sway,1ace/sway