Well that was fun.. I backed out all the changes.. and dropped to 13.x us in netpipe.
Well that was fun.. I backed out all the changes.. and
dropped to 13.x us in netpipe.

Then I added them back one at a time.. recording the
changes. It bacame obvious it was only the changes
in sctp_indata.c...

Then applying them one at a time.. at the end I
was at a 13.x us instead of the 18.x us I had seen
before... I then changed the slide point to when
ever we get a full 8 bits (instead of 32) go ahead
and call sack_check. This means we call sack_check
4 times more often, but it also means the macro for
figuring out where the cum-ack is and setting/testing
the bits is only in the first 8 bits for the most part.

This optimizes so I am now seeing the best time ...

Still no solution for as to why we can't use all of
the CPU on the Xeon machines with my gig-e testing.

The receiver does nothing for 2.5 ms.. locked out
in mfree().. and then his rwnd is full.. and he never
catches up.. very strange. It could be that we open the
rwnd just enough that we get packets in 2 or so at a
time.. which holds both CPU threads... this then
causes one after the other to run.. and serializes out
the reader to wait... not sure...

I will next do a gprof'd kernel of my local laptop
and see what comes about.. and I also need to
recompile the SMP machines to non-SMP and see
if I see any difference..

R

sdd330/sctp-refimpl,sdd330/sctp-refimpl,sctplab/sctp-refimpl,deepak899/sctp-refimpl,ossy-szeged/sctp-refimpl,ossy-szeged/sctp-refimpl,tosakanth/sctp-refimpl,deepak899/sctp-refimpl,tosakanth/sctp-refimpl,deepak899/sctp-refimpl,timsuchanek/sctp-refimpl,gale320/sctp-refimpl,gale320/sctp-refimpl,deepak899/sctp-refimpl,timsuchanek/sctp-refimpl,TopPano/sctp-refimpl,gale320/sctp-refimpl,TopPano/sctp-refimpl,sctplab/sctp-refimpl,gale320/sctp-refimpl,tosakanth/sctp-refimpl,sdd330/sctp-refimpl,gale320/sctp-refimpl,deepak899/sctp-refimpl,sdd330/sctp-refimpl,deepak899/sctp-refimpl,xwhuang/sctp-refimpl,tosakanth/sctp-refimpl,timsuchanek/sctp-refimpl,TopPano/sctp-refimpl,gale320/sctp-refimpl,sdd330/sctp-refimpl,sctplab/sctp-refimpl,tosakanth/sctp-refimpl,ossy-szeged/sctp-refimpl,timsuchanek/sctp-refimpl,tosakanth/sctp-refimpl,ossy-szeged/sctp-refimpl,xwhuang/sctp-refimpl,xwhuang/sctp-refimpl,tosakanth/sctp-refimpl,tosakanth/sctp-refimpl,xwhuang/sctp-refimpl,sdd330/sctp-refimpl,xwhuang/sctp-refimpl,TopPano/sctp-refimpl,timsuchanek/sctp-refimpl,timsuchanek/sctp-refimpl,ossy-szeged/sctp-refimpl,sctplab/sctp-refimpl,TopPano/sctp-refimpl,timsuchanek/sctp-refimpl,sdd330/sctp-refimpl,timsuchanek/sctp-refimpl,tosakanth/sctp-refimpl,TopPano/sctp-refimpl,gale320/sctp-refimpl,sctplab/sctp-refimpl,ossy-szeged/sctp-refimpl,ossy-szeged/sctp-refimpl,TopPano/sctp-refimpl,sctplab/sctp-refimpl,sdd330/sctp-refimpl,timsuchanek/sctp-refimpl,gale320/sctp-refimpl,ossy-szeged/sctp-refimpl,ossy-szeged/sctp-refimpl,gale320/sctp-refimpl,TopPano/sctp-refimpl,sdd330/sctp-refimpl,xwhuang/sctp-refimpl,TopPano/sctp-refimpl