Support native silu activation (aka swish). An optimized ver is available in PyTorch 1.7.
Support native silu activation (aka swish). An optimized ver is available in PyTorch 1.7.

rwightman/pytorch-image-models,rwightman/pytorch-image-models