Why only rtn one?
#1
by
RanchiZhao
- opened
hi, is there any AutoRound one for this 120b model?
AutoRound is a very small team with limited computational resources and bandwidth to generate quantized models for the community. We have open-sourced our quantization library and included quantization commands in most model cards. We encourage other users to leverage their resources to help generate these models as well.