Text Generation
Transformers
PyTorch
TensorBoard
Safetensors
bloom
Eval Results
text-generation-inference

Let's talk about the model

#284
by kalashshah19 - opened

Does this model have active parameters, or are all parameters active all the time? And also share the GPU utilization of this model. Thanks

BigScience Workshop org

Hi. This is a regular dense model. All parameters are always active.

Please read the model card and the previous issues on this repo where GPU usage has already been discussed extensively.

christopher changed discussion status to closed

Sign up or log in to comment