Revert "Use sparse matrix types in compute_polynomial_times_sky"
Revert "Use sparse matrix types in compute_polynomial_times_sky"

This reverts commit f2b9d7c8aea4ffc3ba529e82f5557a3d9a09ae88.

desihub/desispec,desihub/desispec