decode.c: fix return value on bitstream decoding errors
decode.c: fix return value on bitstream decoding errors

Change ENOMEM into EINVAL, since at this point memory allocation
errors don't occur, and bitstream decoding errors are not fatal.

videolan/dav1d