Only remove exchanges from the reader side
Only remove exchanges from the reader side

If both the reader and the writer remove the exchange, we may
double-remove an exchange and cause the sendChRef wait group
to go negative, causing a panic.

uber/tchannel-go,uber/tchannel-go