Remove matrix specialization code for now
Remove matrix specialization code for now

It makes stuff slightly more complicated for no reason. Add it in later
if there's a need for specializations.

aleksijuvani/polygonist