Fix so that use destination port even when matching on source address.
Fix so that use destination port even when matching on source address.

neiljerram/felix,ocadotechnology/calico,fasaxc/felix,beddari/calico,nbartos/calico,neiljerram/felix,alexhersh/calico,alexhersh/calico,neiljerram/felix,ocadotechnology/calico,TrimBiggs/calico,fasaxc/felix,Metaswitch/calico,neiljerram/felix,nbartos/calico,kasisnu/calico,anortef/calico,kasisnu/calico,matthewdupre/felix,anortef/calico,beddari/calico,alexaltair/calico,alexaltair/calico,TrimBiggs/calico,matthewdupre/felix,Metaswitch/calico