Problem: Enter and exit of with: block takes a lot of time
Problem: Enter and exit of with: block takes a lot of time

Solution: If we just set the flag directly it saves 20% of time when
decoding keys from a CBOR mapping.

agronholm/cbor2,agronholm/cbor2,agronholm/cbor2