MAINT: Don't check for colorspace until absolutely necessary
MAINT: Don't check for colorspace until absolutely necessary

Don't need colorspace if we're never interpolating, so don't
bother to ask for it until the last minute so we don't have to
distrupt unnecessarily.

scottclowe/cbrewer2