danielhanchen commited on
Commit
30c0338
·
verified ·
1 Parent(s): 517d8c2

Add files using upload-large-folder tool

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +1 -0
  2. README.md +191 -3
  3. added_tokens.json +28 -0
  4. chat_template.jinja +131 -0
  5. config.json +42 -0
  6. generation_config.json +12 -0
  7. merges.txt +0 -0
  8. model-00001-of-00241.safetensors +3 -0
  9. model-00002-of-00241.safetensors +3 -0
  10. model-00003-of-00241.safetensors +3 -0
  11. model-00004-of-00241.safetensors +3 -0
  12. model-00005-of-00241.safetensors +3 -0
  13. model-00006-of-00241.safetensors +3 -0
  14. model-00007-of-00241.safetensors +3 -0
  15. model-00008-of-00241.safetensors +3 -0
  16. model-00009-of-00241.safetensors +3 -0
  17. model-00010-of-00241.safetensors +3 -0
  18. model-00011-of-00241.safetensors +3 -0
  19. model-00012-of-00241.safetensors +3 -0
  20. model-00013-of-00241.safetensors +3 -0
  21. model-00014-of-00241.safetensors +3 -0
  22. model-00015-of-00241.safetensors +3 -0
  23. model-00016-of-00241.safetensors +3 -0
  24. model-00017-of-00241.safetensors +3 -0
  25. model-00018-of-00241.safetensors +3 -0
  26. model-00019-of-00241.safetensors +3 -0
  27. model-00020-of-00241.safetensors +3 -0
  28. model-00021-of-00241.safetensors +3 -0
  29. model-00022-of-00241.safetensors +3 -0
  30. model-00023-of-00241.safetensors +3 -0
  31. model-00024-of-00241.safetensors +3 -0
  32. model-00025-of-00241.safetensors +3 -0
  33. model-00026-of-00241.safetensors +3 -0
  34. model-00027-of-00241.safetensors +3 -0
  35. model-00028-of-00241.safetensors +3 -0
  36. model-00029-of-00241.safetensors +3 -0
  37. model-00030-of-00241.safetensors +3 -0
  38. model-00031-of-00241.safetensors +3 -0
  39. model-00032-of-00241.safetensors +3 -0
  40. model-00033-of-00241.safetensors +3 -0
  41. model-00034-of-00241.safetensors +3 -0
  42. model-00035-of-00241.safetensors +3 -0
  43. model-00036-of-00241.safetensors +3 -0
  44. model-00037-of-00241.safetensors +3 -0
  45. model-00038-of-00241.safetensors +3 -0
  46. model-00039-of-00241.safetensors +3 -0
  47. model-00040-of-00241.safetensors +3 -0
  48. model-00041-of-00241.safetensors +3 -0
  49. model-00042-of-00241.safetensors +3 -0
  50. model-00043-of-00241.safetensors +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,191 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - unsloth
4
+ base_model:
5
+ - Qwen/Qwen3-Coder-480B-A35B-Instruct
6
+ library_name: transformers
7
+ license: apache-2.0
8
+ license_link: https://huggingface.co/Qwen/Qwen3-Coder-480B-A35B-Instruct/blob/main/LICENSE
9
+ pipeline_tag: text-generation
10
+ ---
11
+ > [!NOTE]
12
+ > Includes Unsloth **chat template fixes**! <br> For `llama.cpp`, use `--jinja`
13
+ >
14
+
15
+ <div>
16
+ <p style="margin-top: 0;margin-bottom: 0;">
17
+ <em><a href="https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves superior accuracy & outperforms other leading quants.</em>
18
+ </p>
19
+ <div style="display: flex; gap: 5px; align-items: center; ">
20
+ <a href="https://github.com/unslothai/unsloth/">
21
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
22
+ </a>
23
+ <a href="https://discord.gg/unsloth">
24
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
25
+ </a>
26
+ <a href="https://docs.unsloth.ai/">
27
+ <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
28
+ </a>
29
+ </div>
30
+ </div>
31
+
32
+
33
+ # Qwen3-Coder-480B-A35B-Instruct
34
+ <a href="https://chat.qwen.ai/" target="_blank" style="margin: 2px;">
35
+ <img alt="Chat" src="https://img.shields.io/badge/%F0%9F%92%9C%EF%B8%8F%20Qwen%20Chat%20-536af5" style="display: inline-block; vertical-align: middle;"/>
36
+ </a>
37
+
38
+ ## Highlights
39
+
40
+ Today, we're announcing **Qwen3-Coder**, our most agentic code model to date. **Qwen3-Coder** is available in multiple sizes, but we're excited to introduce its most powerful variant first: **Qwen3-Coder-480B-A35B-Instruct**. featuring the following key enhancements:
41
+
42
+ - **Significant Performance** among open models on **Agentic Coding**, **Agentic Browser-Use**, and other foundational coding tasks, achieving results comparable to Claude Sonnet 4.
43
+ - **Long-context Capabilities** with native support for **256K** tokens, extendable up to **1M** tokens using Yarn, optimized for repository-scale understanding.
44
+ - **Agentic Coding** supporting for most platfrom such as **Qwen Code**, **CLINE**, featuring a specially designed function call format.
45
+
46
+ ![image/jpeg](https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen3-Coder/qwen3-coder-main.jpg)
47
+
48
+ ## Model Overview
49
+
50
+ **Qwen3-480B-A35B-Instruct** has the following features:
51
+ - Type: Causal Language Models
52
+ - Training Stage: Pretraining & Post-training
53
+ - Number of Parameters: 480B in total and 35B activated
54
+ - Number of Layers: 62
55
+ - Number of Attention Heads (GQA): 96 for Q and 8 for KV
56
+ - Number of Experts: 160
57
+ - Number of Activated Experts: 8
58
+ - Context Length: **262,144 natively**.
59
+
60
+ **NOTE: This model supports only non-thinking mode and does not generate ``<think></think>`` blocks in its output. Meanwhile, specifying `enable_thinking=False` is no longer required.**
61
+
62
+ For more details, including benchmark evaluation, hardware requirements, and inference performance, please refer to our [blog](https://qwenlm.github.io/blog/qwen3-coder/), [GitHub](https://github.com/QwenLM/Qwen3-Coder), and [Documentation](https://qwen.readthedocs.io/en/latest/).
63
+
64
+
65
+ ## Quickstart
66
+
67
+ We advise you to use the latest version of `transformers`.
68
+
69
+ With `transformers<4.51.0`, you will encounter the following error:
70
+ ```
71
+ KeyError: 'qwen3_moe'
72
+ ```
73
+
74
+ The following contains a code snippet illustrating how to use the model generate content based on given inputs.
75
+ ```python
76
+ from transformers import AutoModelForCausalLM, AutoTokenizer
77
+
78
+ model_name = "Qwen/Qwen3-480B-A35B-Instruct"
79
+
80
+ # load the tokenizer and the model
81
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
82
+ model = AutoModelForCausalLM.from_pretrained(
83
+ model_name,
84
+ torch_dtype="auto",
85
+ device_map="auto"
86
+ )
87
+
88
+ # prepare the model input
89
+ prompt = "Write a quick sort algorithm."
90
+ messages = [
91
+ {"role": "user", "content": prompt}
92
+ ]
93
+ text = tokenizer.apply_chat_template(
94
+ messages,
95
+ tokenize=False,
96
+ add_generation_prompt=True,
97
+ )
98
+ model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
99
+
100
+ # conduct text completion
101
+ generated_ids = model.generate(
102
+ **model_inputs,
103
+ max_new_tokens=65536
104
+ )
105
+ output_ids = generated_ids[0][len(model_inputs.input_ids[0]):].tolist()
106
+
107
+ content = tokenizer.decode(output_ids, skip_special_tokens=True)
108
+
109
+ print("content:", content)
110
+ ```
111
+
112
+ **Note: If you encounter out-of-memory (OOM) issues, consider reducing the context length to a shorter value, such as `32,768`.**
113
+
114
+ For local use, applications such as Ollama, LMStudio, MLX-LM, llama.cpp, and KTransformers have also supported Qwen3.
115
+
116
+ ## Agentic Coding
117
+
118
+ Qwen3-Coder excels in tool calling capabilities.
119
+
120
+ You can simply define or use any tools as following example.
121
+ ```python
122
+ # Your tool implementation
123
+ def square_the_number(num: float) -> dict:
124
+ return num ** 2
125
+
126
+ # Define Tools
127
+ tools=[
128
+ {
129
+ "type":"function",
130
+ "function":{
131
+ "name": "square_the_number",
132
+ "description": "output the square of the number.",
133
+ "parameters": {
134
+ "type": "object",
135
+ "required": ["input_num"],
136
+ "properties": {
137
+ 'input_num': {
138
+ 'type': 'number',
139
+ 'description': 'input_num is a number that will be squared'
140
+ }
141
+ },
142
+ }
143
+ }
144
+ }
145
+ ]
146
+
147
+ import OpenAI
148
+ # Define LLM
149
+ client = OpenAI(
150
+ # Use a custom endpoint compatible with OpenAI API
151
+ base_url='http://localhost:8000/v1', # api_base
152
+ api_key="EMPTY"
153
+ )
154
+
155
+ messages = [{'role': 'user', 'content': 'square the number 1024'}]
156
+
157
+ completion = client.chat.completions.create(
158
+ messages=messages,
159
+ model="Qwen3-480B-A35B-Instruct",
160
+ max_tokens=65536,
161
+ tools=tools,
162
+ )
163
+
164
+ print(completion.choice[0])
165
+ ```
166
+
167
+ ## Best Practices
168
+
169
+ To achieve optimal performance, we recommend the following settings:
170
+
171
+ 1. **Sampling Parameters**:
172
+ - We suggest using `temperature=0.7`, `top_p=0.8`, `top_k=20`, `repetition_penalty=1.05`.
173
+
174
+ 2. **Adequate Output Length**: We recommend using an output length of 65,536 tokens for most queries, which is adequate for instruct models.
175
+
176
+
177
+ ### Citation
178
+
179
+ If you find our work helpful, feel free to give us a cite.
180
+
181
+ ```
182
+ @misc{qwen3technicalreport,
183
+ title={Qwen3 Technical Report},
184
+ author={Qwen Team},
185
+ year={2025},
186
+ eprint={2505.09388},
187
+ archivePrefix={arXiv},
188
+ primaryClass={cs.CL},
189
+ url={https://arxiv.org/abs/2505.09388},
190
+ }
191
+ ```
added_tokens.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</think>": 151668,
3
+ "</tool_call>": 151658,
4
+ "</tool_response>": 151666,
5
+ "<think>": 151667,
6
+ "<tool_call>": 151657,
7
+ "<tool_response>": 151665,
8
+ "<|box_end|>": 151649,
9
+ "<|box_start|>": 151648,
10
+ "<|endoftext|>": 151643,
11
+ "<|file_sep|>": 151664,
12
+ "<|fim_middle|>": 151660,
13
+ "<|fim_pad|>": 151662,
14
+ "<|fim_prefix|>": 151659,
15
+ "<|fim_suffix|>": 151661,
16
+ "<|im_end|>": 151645,
17
+ "<|im_start|>": 151644,
18
+ "<|image_pad|>": 151655,
19
+ "<|object_ref_end|>": 151647,
20
+ "<|object_ref_start|>": 151646,
21
+ "<|quad_end|>": 151651,
22
+ "<|quad_start|>": 151650,
23
+ "<|repo_name|>": 151663,
24
+ "<|video_pad|>": 151656,
25
+ "<|vision_end|>": 151653,
26
+ "<|vision_pad|>": 151654,
27
+ "<|vision_start|>": 151652
28
+ }
chat_template.jinja ADDED
@@ -0,0 +1,131 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {% macro render_item_list(item_list, tag_name='required') %}
2
+ {%- if item_list is defined and item_list is iterable and item_list | length > 0 %}
3
+ {%- if tag_name %}{{- '\n<' ~ tag_name ~ '>' -}}{% endif %}
4
+ {{- '[' }}
5
+ {%- for item in item_list -%}
6
+ {%- if loop.index > 1 %}{{- ", "}}{% endif -%}
7
+ {%- if item is string -%}
8
+ {{ "`" ~ item ~ "`" }}
9
+ {%- else -%}
10
+ {{ item }}
11
+ {%- endif -%}
12
+ {%- endfor -%}
13
+ {{- ']' }}
14
+ {%- if tag_name %}{{- '</' ~ tag_name ~ '>' -}}{% endif %}
15
+ {%- endif %}
16
+ {% endmacro %}
17
+
18
+ {%- if messages[0]["role"] == "system" %}
19
+ {%- set system_message = messages[0]["content"] %}
20
+ {%- set loop_messages = messages[1:] %}
21
+ {%- else %}
22
+ {%- set loop_messages = messages %}
23
+ {%- endif %}
24
+
25
+ {%- if not tools is defined %}
26
+ {%- set tools = [] %}
27
+ {%- endif %}
28
+
29
+ {%- if system_message is defined %}
30
+ {{- "<|im_start|>system\n" + system_message }}
31
+ {%- else %}
32
+ {%- if tools is iterable and tools | length > 0 %}
33
+ {{- "<|im_start|>system\nYou are Qwen, a helpful AI assistant that can interact with a computer to solve tasks." }}
34
+ {%- endif %}
35
+ {%- endif %}
36
+ {%- if tools is iterable and tools | length > 0 %}
37
+ {{- "\n\nYou have access to the following functions:\n\n" }}
38
+ {{- "<tools>" }}
39
+ {%- for tool in tools %}
40
+ {%- if tool.function is defined %}
41
+ {%- set tool = tool.function %}
42
+ {%- endif %}
43
+ {{- "\n<function>\n<name>" ~ tool.name ~ "</name>" }}
44
+ {{- '\n<description>' ~ (tool.description | trim) ~ '</description>' }}
45
+ {{- '\n<parameters>' }}
46
+ {%- for param_name, param_fields in tool.parameters.properties|items %}
47
+ {{- '\n<parameter>' }}
48
+ {{- '\n<name>' ~ param_name ~ '</name>' }}
49
+ {%- if param_fields.type is defined %}
50
+ {{- '\n<type>' ~ (param_fields.type | string) ~ '</type>' }}
51
+ {%- endif %}
52
+ {%- if param_fields.description is defined %}
53
+ {{- '\n<description>' ~ (param_fields.description | trim) ~ '</description>' }}
54
+ {%- endif %}
55
+ {{- render_item_list(param_fields.enum, 'enum') }}
56
+ {%- set handled_keys = ['type', 'description', 'enum', 'required'] %}
57
+ {%- for json_key in param_fields.keys() | reject("in", handled_keys) %}
58
+ {%- set normed_json_key = json_key | replace("-", "_") | replace(" ", "_") | replace("$", "") %}
59
+ {%- if param_fields[json_key] is mapping %}
60
+ {{- '\n<' ~ normed_json_key ~ '>' ~ (param_fields[json_key] | tojson | safe) ~ '</' ~ normed_json_key ~ '>' }}
61
+ {%- else %}
62
+ {{-'\n<' ~ normed_json_key ~ '>' ~ (param_fields[json_key] | string) ~ '</' ~ normed_json_key ~ '>' }}
63
+ {%- endif %}
64
+ {%- endfor %}
65
+ {{- render_item_list(param_fields.required, 'required') }}
66
+ {{- '\n</parameter>' }}
67
+ {%- endfor %}
68
+ {{- render_item_list(tool.parameters.required, 'required') }}
69
+ {{- '\n</parameters>' }}
70
+ {%- if tool.return is defined %}
71
+ {%- if tool.return is mapping %}
72
+ {{- '\n<return>' ~ (tool.return | tojson | safe) ~ '</return>' }}
73
+ {%- else %}
74
+ {{- '\n<return>' ~ (tool.return | string) ~ '</return>' }}
75
+ {%- endif %}
76
+ {%- endif %}
77
+ {{- '\n</function>' }}
78
+ {%- endfor %}
79
+ {{- "\n</tools>" }}
80
+ {{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}
81
+ {%- endif %}
82
+ {%- if system_message is defined %}
83
+ {{- '<|im_end|>\n' }}
84
+ {%- else %}
85
+ {%- if tools is iterable and tools | length > 0 %}
86
+ {{- '<|im_end|>\n' }}
87
+ {%- endif %}
88
+ {%- endif %}
89
+ {%- for message in loop_messages %}
90
+ {%- if message.role == "assistant" and message.tool_calls is defined and message.tool_calls is iterable and message.tool_calls | length > 0 %}
91
+ {{- '<|im_start|>' + message.role }}
92
+ {%- if message.content is defined and message.content is string and message.content | trim | length > 0 %}
93
+ {{- '\n' + message.content | trim + '\n' }}
94
+ {%- endif %}
95
+ {%- for tool_call in message.tool_calls %}
96
+ {%- if tool_call.function is defined %}
97
+ {%- set tool_call = tool_call.function %}
98
+ {%- endif %}
99
+ {{- '\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
100
+ {%- if tool_call.arguments is defined %}
101
+ {%- for args_name, args_value in tool_call.arguments|items %}
102
+ {{- '<parameter=' + args_name + '>\n' }}
103
+ {%- set args_value = args_value if args_value is string else args_value | string %}
104
+ {{- args_value }}
105
+ {{- '\n</parameter>\n' }}
106
+ {%- endfor %}
107
+ {%- endif %}
108
+ {{- '</function>\n</tool_call>' }}
109
+ {%- endfor %}
110
+ {{- '<|im_end|>\n' }}
111
+ {%- elif message.role == "user" or message.role == "system" or message.role == "assistant" %}
112
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
113
+ {%- elif message.role == "tool" %}
114
+ {%- if loop.previtem and loop.previtem.role != "tool" %}
115
+ {{- '<|im_start|>user\n' }}
116
+ {%- endif %}
117
+ {{- '<tool_response>\n' }}
118
+ {{- message.content }}
119
+ {{- '\n</tool_response>\n' }}
120
+ {%- if not loop.last and loop.nextitem.role != "tool" %}
121
+ {{- '<|im_end|>\n' }}
122
+ {%- elif loop.last %}
123
+ {{- '<|im_end|>\n' }}
124
+ {%- endif %}
125
+ {%- else %}
126
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>\n' }}
127
+ {%- endif %}
128
+ {%- endfor %}
129
+ {%- if add_generation_prompt %}
130
+ {{- '<|im_start|>assistant\n' }}
131
+ {%- endif %}
config.json ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3MoeForCausalLM"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "decoder_sparse_step": 1,
8
+ "eos_token_id": 151645,
9
+ "head_dim": 128,
10
+ "hidden_act": "silu",
11
+ "hidden_size": 6144,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 8192,
14
+ "max_position_embeddings": 262144,
15
+ "max_window_layers": 62,
16
+ "mlp_only_layers": [],
17
+ "model_type": "qwen3_moe",
18
+ "moe_intermediate_size": 2560,
19
+ "norm_topk_prob": true,
20
+ "num_attention_heads": 96,
21
+ "num_experts": 160,
22
+ "num_experts_per_tok": 8,
23
+ "num_hidden_layers": 62,
24
+ "num_key_value_heads": 8,
25
+ "output_router_logits": false,
26
+ "pad_token_id": 151654,
27
+ "qkv_bias": false,
28
+ "rms_norm_eps": 1e-06,
29
+ "rope_scaling": null,
30
+ "rope_theta": 10000000,
31
+ "router_aux_loss_coef": 0.0,
32
+ "shared_expert_intermediate_size": 0,
33
+ "sliding_window": null,
34
+ "tie_word_embeddings": false,
35
+ "torch_dtype": "bfloat16",
36
+ "transformers_version": "4.53.3",
37
+ "unsloth_fixed": true,
38
+ "use_cache": true,
39
+ "use_qk_norm": true,
40
+ "use_sliding_window": false,
41
+ "vocab_size": 151936
42
+ }
generation_config.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "pad_token_id": 151643,
3
+ "do_sample": true,
4
+ "eos_token_id": [
5
+ 151645,
6
+ 151643
7
+ ],
8
+ "repetition_penalty": 1.05,
9
+ "temperature": 0.7,
10
+ "top_p": 0.8,
11
+ "top_k": 20
12
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
model-00001-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:696359183790b186b584590f0a09dbed9a71ac1cf99776090be9b9355257097b
3
+ size 3987218640
model-00002-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f15136f1864960b643ee0facb4c698bfe20dcd9da2420163310eae607cbca67d
3
+ size 3995090312
model-00003-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7bd6a23bb5a0c1c32c7e4afea306d1bed4ba120d1cf92f8ca80498b04e927283
3
+ size 3995090328
model-00004-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b7bef72a61bdb5e64d0d863068bb65b3270c39c741c9089390412731dba0fb8
3
+ size 3995090448
model-00005-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba3291e8db1bdd5080f1b8393c06a1c00cc3cf3ea74a116f2ff04865ce2c44ec
3
+ size 3978206784
model-00006-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38e134c3eb7e9b0108672d797865420f060e5b8e4a95a548ce29f67455b2748e
3
+ size 3995090320
model-00007-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c6dcab788c6ece9da6055bf7149506ae7926b66a7b3ec7221fe4001c93daac0
3
+ size 3995090344
model-00008-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb218233ab8d7c0cc9e69303b52849251f12326c18d65c3da3d5c46eda79553b
3
+ size 3995090448
model-00009-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b0178266bb08753bad9b1a90a02f19b70f2f881dd2035e023ce4497b8c4d251
3
+ size 3978206760
model-00010-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9bb58f5c16a5a557b2b6f9a739f7facc8b500d62406c0392f862177871b3a236
3
+ size 3995090320
model-00011-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bde201697a22d933b7c214ff4267109547f4ad3c527aac6ae6da596252e88511
3
+ size 3995090360
model-00012-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68afa2bc64a5d871e828942d04090e2875401acd8958989b0e5895f2aea60a73
3
+ size 3995090440
model-00013-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efecfffb46905ff8ae2f7150dad70a583d9547c1bcbaf21898977ae6a29f73b1
3
+ size 3978206744
model-00014-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a360907b5fa30e82d0f53efa2d4948fbb8190da47b7a7be8363c2cc70aa4508
3
+ size 3995090312
model-00015-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3021af86247ed15068c9d1d2e15d157ef2f0d2d6c04b517588f6f26c2ef29ee9
3
+ size 3995090376
model-00016-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75dea6d7e0ea0e9748ca0a4fb8255d7657eb7e477397264c3b382da297785e04
3
+ size 3890125904
model-00017-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06c90be752a9047abec50f93205a02f74ab6f92bfd73520b6480f490aa75280c
3
+ size 3988799064
model-00018-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1398bceef358a05285f0de48c6d6144f40c803e03ab999763d69c9f3960ce6f9
3
+ size 3995090320
model-00019-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15ac812c536dd408f1f287e3d496f4f461aab337918e5f4bb27421de8a0a57c8
3
+ size 3995090392
model-00020-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84d80084411562beb050a7b9d931a487b01f31b73b814b11829a3b16992f0b28
3
+ size 3978206864
model-00021-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce12a0de36b3a9016972c48762424adebd91e02ad475112c550c71530a403fb2
3
+ size 3995090296
model-00022-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b353e30eeaa4e9c1e526e7ecd69444455f05d5576a6b876f12e6aa17ff4608b
3
+ size 3995090320
model-00023-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51067fc9bf28ee5ebfbad19ad43d5fd3df4100c0b9111e4346162ae47527e259
3
+ size 3995090408
model-00024-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4947a83eb17460d488ab8c45d10b23908100ccc5646b95c4721cfcf077f2a689
3
+ size 3978206824
model-00025-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:428ffc8747f788b24b678934dcf4ff2530a103c84fda541e1d02a8450101b644
3
+ size 3995090320
model-00026-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65da06755a2c02ef8aef83e1b73e221dac1916c1fdd6b7a1ee6fb9ae17163808
3
+ size 3995090312
model-00027-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b547a982929374484e8231c4360ffbf40b442137faddd772e6472a8f000ccdaa
3
+ size 3995090424
model-00028-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9a09cb7c6d8eaa28716d8de96f03e3e465a5ae61ada4bd6de88bdc3b11fad04
3
+ size 3978206808
model-00029-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5737bc3d3183f149a9d59d310b4478b33e056123ecd9f6ade93f01e236947cec
3
+ size 3995090320
model-00030-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c7993bf1396c1fda1d9976f0fb841ed58bc913fbbf85bba87719835e2855686
3
+ size 3995090320
model-00031-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c6ba5c8e28077e419d874932f397c8258f7bccd51bad514766c31b0fb634009
3
+ size 3995090440
model-00032-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8c3deb16ba6f30636667733085a31b5ee073f2b36435791cc3c8a4c95bf55e5
3
+ size 3978206792
model-00033-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:032774e27661175134ba328c5cfd1ccecff4c5f4120667bd4b88f4025b5c4701
3
+ size 3995090312
model-00034-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f081c85bc9a753da755c51cc6bbca4188a952c4439d74a80e05006bbbf57c199
3
+ size 3995090336
model-00035-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f773d5d20662dc0cd902fd7589bf77b48be0b403393fac6cd1cd9c21d89e7d65
3
+ size 3995090448
model-00036-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82888814641532ff220d91571c0a46c81ea40a1c333b88a91c13caefce19f41b
3
+ size 3978206776
model-00037-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62a9b0f7ab5167c67c3bd9bec2194612640b7eb04cf6b8af0036e4e1054abec1
3
+ size 3995090320
model-00038-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8eba06af74446d4a41bc959f379652db340519ce9299a98958f8668e13c193b8
3
+ size 3995090352
model-00039-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bdd1a347b949a57f1bace9fd62af574a8b45fbb5168c8d486d478fa1bdbf0d66
3
+ size 3995090448
model-00040-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38c52f38250a3a8f86bc0bbdbfdce987b8375403440913a20f06ee5ae884f0ec
3
+ size 3978206872
model-00041-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:431d22d56955c52a94fdf39a2ef10dfb6b79686b35eb6728008b4ddac0a952be
3
+ size 3995090448
model-00042-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a5297559a7745d57576df98b66d59c4668f14e612db85a9ba80c8a2ca05a54b
3
+ size 3995090496
model-00043-of-00241.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c8ad437c376bf5cf71a6a2292e01223de5593ccaa15cde51fb0a286cca505b9
3
+ size 3995090568