Tonylin52
/

pruned_chatglm

Model card Files Files and versions

Tonylin52 commited on Mar 23, 2023

Commit

bcb433e

·

1 Parent(s): 9214dde

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -16,7 +16,7 @@
   "max_sequence_length": 2048,
   "model_type": "chatglm",
   "num_attention_heads": 32,
-  "num_layers": 28,
   "position_encoding_2d": true,
   "torch_dtype": "float16",
   "transformers_version": "4.23.1",

   "max_sequence_length": 2048,
   "model_type": "chatglm",
   "num_attention_heads": 32,
+  "num_layers": 20,
   "position_encoding_2d": true,
   "torch_dtype": "float16",
   "transformers_version": "4.23.1",