model load and infer

#6
by yy - opened
  1. Does the model support two A6000s(48G) to load the model for inference?
  2. features 2.8 billion activated parameter, why is the model weight file as high as 80G?

Sign up or log in to comment