Update README.md

README.md

@@ -68,6 +68,18 @@ or
 
 ```
 
+This model seems to have issues with device="auto" in the model arguments (and requires the trust_remote_code=True, so you should maybe load it like I am here:  
+```  
+        self.tokenizer = AutoTokenizer.from_pretrained("./Replit-CodeInstruct/", trust_remote_code=True)
+        self.model = AutoModelForCausalLM.from_pretrained(
+            "./Replit-CodeInstruct",
+            torch_dtype=torch.bfloat16,
+            trust_remote_code=True
+        )
+        self.model.to('cuda')
+```  
+
+
 This model for me produced coherent outputs with the following sampler settings, but feel free to experiment:  
 ```  
 max_new_tokens=128, do_sample=True, use_cache=True, temperature=0.2, top_p=0.9, eos_token_id= self.tokenizer.eos_token_id