backend: Use sets for other keys
backend: Use sets for other keys

Seems it wasn't noticeable before due to the choice of other keys.

drbig/cddarjb,cdda/rjb,drbig/cddarjb,cdda/rjb,cdda/rjb,cdda/rjb,drbig/cddarjb