Size prediction for residual layers, limit #threads
Size prediction for residual layers, limit #threads

- Prediction of size of working set now works for convolutional and residual layers
- Fixed the "too many resource at kernel launch" bug by limiting the number of threads of the coeffs_from kernels to 256, this prevents to many registers from being allocated
- Now code is able to merge two residual paths regardless of which path
has the bigger working set (by swapping pointers if necessary)

eth-srl/OptOctagon,eth-srl/OptOctagon,eth-srl/OptOctagon