Only track modulus remainder during simplification if they're interesting.
Only track modulus remainder during simplification if they're interesting.

Mild compilation speedup (~150ms for local laplacian)

tdenniston/Halide,damienfir/Halide,lglucin/Halide,kgnk/Halide,dan-tull/Halide,adasworks/Halide,adasworks/Halide,myrtleTree33/Halide,ronen/Halide,dan-tull/Halide,aam/Halide,aam/Halide,mcanthony/Halide,myrtleTree33/Halide,delcypher/Halide,rodrigob/Halide,smxlong/Halide,fengzhyuan/Halide,dan-tull/Halide,delcypher/Halide,delcypher/Halide,adasworks/Halide,ronen/Halide,dan-tull/Halide,dougkwan/Halide,rodrigob/Halide,gchauras/Halide,dougkwan/Halide,fengzhyuan/Halide,ayanazmat/Halide,smxlong/Halide,mcanthony/Halide,kenkuang1213/Halide,damienfir/Halide,delcypher/Halide,psuriana/Halide,ayanazmat/Halide,kenkuang1213/Halide,smxlong/Halide,damienfir/Halide,ronen/Halide,myrtleTree33/Halide,kgnk/Halide,kenkuang1213/Halide,mcanthony/Halide,lglucin/Halide,smxlong/Halide,ronen/Halide,tdenniston/Halide,mcanthony/Halide,jiawen/Halide,tdenniston/Halide,dan-tull/Halide,myrtleTree33/Halide,lglucin/Halide,lglucin/Halide,delcypher/Halide,dan-tull/Halide,fengzhyuan/Halide,myrtleTree33/Halide,smxlong/Halide,adasworks/Halide,jiawen/Halide,ayanazmat/Halide,aam/Halide,dougkwan/Halide,ayanazmat/Halide,smxlong/Halide,dan-tull/Halide,ronen/Halide,kgnk/Halide,gchauras/Halide,kgnk/Halide,aam/Halide,dan-tull/Halide,psuriana/Halide,myrtleTree33/Halide,kgnk/Halide,ronen/Halide,dougkwan/Halide,kenkuang1213/Halide,mcanthony/Halide,damienfir/Halide,tdenniston/Halide,gchauras/Halide,mcanthony/Halide,rodrigob/Halide,kenkuang1213/Halide,kgnk/Halide,psuriana/Halide,lglucin/Halide,psuriana/Halide,mcanthony/Halide,aam/Halide,rodrigob/Halide,kgnk/Halide,aam/Halide,fengzhyuan/Halide,dougkwan/Halide,psuriana/Halide,rodrigob/Halide,jiawen/Halide,ayanazmat/Halide,dougkwan/Halide,jiawen/Halide,gchauras/Halide,kenkuang1213/Halide,ronen/Halide,rodrigob/Halide,smxlong/Halide,mcanthony/Halide,delcypher/Halide,rodrigob/Halide,adasworks/Halide,aam/Halide,lglucin/Halide,ayanazmat/Halide,gchauras/Halide,damienfir/Halide,fengzhyuan/Halide,damienfir/Halide,smxlong/Halide,fengzhyuan/Halide,adasworks/Halide,kenkuang1213/Halide,kenkuang1213/Halide,dougkwan/Halide,ronen/Halide,ayanazmat/Halide,dougkwan/Halide,jiawen/Halide,psuriana/Halide,adasworks/Halide,myrtleTree33/Halide,tdenniston/Halide,delcypher/Halide,kgnk/Halide,tdenniston/Halide,jiawen/Halide,tdenniston/Halide,ayanazmat/Halide,damienfir/Halide,fengzhyuan/Halide,myrtleTree33/Halide,lglucin/Halide,jiawen/Halide,damienfir/Halide,delcypher/Halide,fengzhyuan/Halide,gchauras/Halide,tdenniston/Halide,psuriana/Halide,adasworks/Halide,rodrigob/Halide