Initial commit

logs.txt

@@ -0,0 +1,332 @@
+/opt/conda/envs/py310/bin/python -m mlc_llm gen_config /models/Mixtral-8x7B-Instruct-v0.1 --quantization q0f16 --conv-template mistral_default --output /models/mlc-delivery/hf/mlc-ai/Mixtral-8x7B-Instruct-v0.1-q0f16-MLC
+[2024-06-06 22:24:15] INFO auto_config.py:116: Found model configuration: /models/Mixtral-8x7B-Instruct-v0.1/config.json
+[2024-06-06 22:24:15] INFO auto_config.py:154: Found model type: mixtral. Use `--model-type` to override.
+[2024-06-06 22:24:15] INFO llama_model.py:52: context_window_size not found in config.json. Falling back to max_position_embeddings (32768)
+[2024-06-06 22:24:15] INFO llama_model.py:72: prefill_chunk_size defaults to 2048
+[2024-06-06 22:24:15] INFO config.py:107: Overriding max_batch_size from 1 to 80
+[2024-06-06 22:24:15] INFO gen_config.py:143: [generation_config.json] Setting bos_token_id: 1
+[2024-06-06 22:24:15] INFO gen_config.py:143: [generation_config.json] Setting eos_token_id: 2
+[2024-06-06 22:24:15] INFO gen_config.py:155: Found tokenizer config: /models/Mixtral-8x7B-Instruct-v0.1/tokenizer.model. Copying to /models/mlc-delivery/hf/mlc-ai/Mixtral-8x7B-Instruct-v0.1-q0f16-MLC/tokenizer.model
+[2024-06-06 22:24:15] INFO gen_config.py:155: Found tokenizer config: /models/Mixtral-8x7B-Instruct-v0.1/tokenizer.json. Copying to /models/mlc-delivery/hf/mlc-ai/Mixtral-8x7B-Instruct-v0.1-q0f16-MLC/tokenizer.json
+[2024-06-06 22:24:15] INFO gen_config.py:157: Not found tokenizer config: /models/Mixtral-8x7B-Instruct-v0.1/vocab.json
+[2024-06-06 22:24:15] INFO gen_config.py:157: Not found tokenizer config: /models/Mixtral-8x7B-Instruct-v0.1/merges.txt
+[2024-06-06 22:24:15] INFO gen_config.py:157: Not found tokenizer config: /models/Mixtral-8x7B-Instruct-v0.1/added_tokens.json
+[2024-06-06 22:24:15] INFO gen_config.py:155: Found tokenizer config: /models/Mixtral-8x7B-Instruct-v0.1/tokenizer_config.json. Copying to /models/mlc-delivery/hf/mlc-ai/Mixtral-8x7B-Instruct-v0.1-q0f16-MLC/tokenizer_config.json
+[2024-06-06 22:24:15] INFO gen_config.py:216: Detected tokenizer info: {'token_postproc_method': 'byte_fallback', 'prepend_space_in_encode': True, 'strip_space_in_decode': True}
+[2024-06-06 22:24:15] INFO gen_config.py:32: [System default] Setting pad_token_id: 0
+[2024-06-06 22:24:15] INFO gen_config.py:32: [System default] Setting temperature: 1.0
+[2024-06-06 22:24:15] INFO gen_config.py:32: [System default] Setting presence_penalty: 0.0
+[2024-06-06 22:24:15] INFO gen_config.py:32: [System default] Setting frequency_penalty: 0.0
+[2024-06-06 22:24:15] INFO gen_config.py:32: [System default] Setting repetition_penalty: 1.0
+[2024-06-06 22:24:15] INFO gen_config.py:32: [System default] Setting top_p: 1.0
+[2024-06-06 22:24:15] INFO gen_config.py:223: Dumping configuration file to: /models/mlc-delivery/hf/mlc-ai/Mixtral-8x7B-Instruct-v0.1-q0f16-MLC/mlc-chat-config.json
+/opt/conda/envs/py310/bin/python -m mlc_llm convert_weight /models/Mixtral-8x7B-Instruct-v0.1 --quantization q0f16 --output /models/mlc-delivery/hf/mlc-ai/Mixtral-8x7B-Instruct-v0.1-q0f16-MLC
+[2024-06-06 22:24:17] INFO auto_config.py:116: Found model configuration: /models/Mixtral-8x7B-Instruct-v0.1/config.json
+[2024-06-06 22:24:18] INFO auto_device.py:79: Found device: cuda:0
+[2024-06-06 22:24:20] INFO auto_device.py:88: Not found device: rocm:0
+[2024-06-06 22:24:21] INFO auto_device.py:88: Not found device: metal:0
+[2024-06-06 22:24:23] INFO auto_device.py:79: Found device: vulkan:0
+[2024-06-06 22:24:23] INFO auto_device.py:79: Found device: vulkan:1
+[2024-06-06 22:24:23] INFO auto_device.py:79: Found device: vulkan:2
+[2024-06-06 22:24:23] INFO auto_device.py:79: Found device: vulkan:3
+[2024-06-06 22:24:24] INFO auto_device.py:88: Not found device: opencl:0
+[2024-06-06 22:24:24] INFO auto_device.py:35: Using device: cuda:0
+[2024-06-06 22:24:24] INFO auto_weight.py:71: Finding weights in: /models/Mixtral-8x7B-Instruct-v0.1
+[2024-06-06 22:24:24] INFO auto_weight.py:137: Not found Huggingface PyTorch
+[2024-06-06 22:24:24] INFO auto_weight.py:144: Found source weight format: huggingface-safetensor. Source configuration: /models/Mixtral-8x7B-Instruct-v0.1/model.safetensors.index.json
+[2024-06-06 22:24:24] INFO auto_weight.py:107: Using source weight configuration: /models/Mixtral-8x7B-Instruct-v0.1/model.safetensors.index.json. Use `--source` to override.
+[2024-06-06 22:24:24] INFO auto_weight.py:111: Using source weight format: huggingface-safetensor. Use `--source-format` to override.
+[2024-06-06 22:24:24] INFO auto_config.py:154: Found model type: mixtral. Use `--model-type` to override.
+[2024-06-06 22:24:24] INFO llama_model.py:52: context_window_size not found in config.json. Falling back to max_position_embeddings (32768)
+[2024-06-06 22:24:24] INFO llama_model.py:72: prefill_chunk_size defaults to 2048
+Weight conversion with arguments:
+  --config          /models/Mixtral-8x7B-Instruct-v0.1/config.json
+  --quantization    NoQuantize(name='q0f16', kind='no-quant', model_dtype='float16')
+  --model-type      mixtral
+  --device          cuda:0
+  --source          /models/Mixtral-8x7B-Instruct-v0.1/model.safetensors.index.json
+  --source-format   huggingface-safetensor
+  --output          /models/mlc-delivery/hf/mlc-ai/Mixtral-8x7B-Instruct-v0.1-q0f16-MLC
+Start storing to cache /models/mlc-delivery/hf/mlc-ai/Mixtral-8x7B-Instruct-v0.1-q0f16-MLC
+
  0%|          | 0/227 [00:00<?, ?it/s]
                                       
+
  0%|          | 0/227 [00:00<?, ?it/s]
                                       
+
  0%|          | 0/227 [00:05<?, ?it/s]
  0%|          | 1/227 [00:05<22:09,  5.88s/it]
                                               
+
  0%|          | 1/227 [00:05<22:09,  5.88s/it]
                                               
+
  0%|          | 1/227 [00:19<22:09,  5.88s/it]
  1%|          | 2/227 [00:24<49:39, 13.24s/it]
                                               
+
  1%|          | 2/227 [00:28<49:39, 13.24s/it]
  1%|▏         | 3/227 [00:31<38:21, 10.27s/it]
                                               
+
  1%|▏         | 3/227 [00:31<38:21, 10.27s/it]
                                               
+
  1%|▏         | 3/227 [00:31<38:21, 10.27s/it]
                                               
+
  1%|▏         | 3/227 [00:40<38:21, 10.27s/it]
  3%|▎         | 6/227 [00:45<24:38,  6.69s/it]
                                               
+
  3%|▎         | 6/227 [00:51<24:38,  6.69s/it]
  3%|▎         | 7/227 [00:53<25:41,  7.01s/it]
                                               
+
  3%|▎         | 7/227 [00:53<25:41,  7.01s/it]
                                               
+
  3%|▎         | 7/227 [00:53<25:41,  7.01s/it]
                                               
+
  3%|▎         | 7/227 [00:53<25:41,  7.01s/it]
                                               
+
  3%|▎         | 7/227 [00:53<25:41,  7.01s/it]
  5%|▍         | 11/227 [00:53<10:49,  3.01s/it]
                                                
+
  5%|▍         | 11/227 [00:54<10:49,  3.01s/it]
  5%|▌         | 12/227 [00:54<09:01,  2.52s/it]
                                                
+
  5%|▌         | 12/227 [00:54<09:01,  2.52s/it]
                                                
+
  5%|▌         | 12/227 [00:54<09:01,  2.52s/it]
                                                
+
  5%|▌         | 12/227 [00:54<09:01,  2.52s/it]
                                                
+
  5%|▌         | 12/227 [00:54<09:01,  2.52s/it]
                                                
+
  5%|▌         | 12/227 [00:59<09:01,  2.52s/it]
  6%|▌         | 14/227 [01:00<09:31,  2.68s/it]
                                                
+
  6%|▌         | 14/227 [01:06<09:31,  2.68s/it]
  7%|▋         | 15/227 [01:11<15:19,  4.34s/it]
                                                
+
  7%|▋         | 15/227 [01:13<15:19,  4.34s/it]
  7%|▋         | 16/227 [01:15<15:20,  4.36s/it]
                                                
+
  7%|▋         | 16/227 [01:15<15:20,  4.36s/it]
                                                
+
  7%|▋         | 16/227 [01:16<15:20,  4.36s/it]
                                                
+
  7%|▋         | 16/227 [01:16<15:20,  4.36s/it]
                                                
+
  7%|▋         | 16/227 [01:16<15:20,  4.36s/it]
  9%|▉         | 20/227 [01:16<06:56,  2.01s/it]
                                                
+
  9%|▉         | 20/227 [01:16<06:56,  2.01s/it]
  9%|▉         | 21/227 [01:16<05:51,  1.71s/it]
                                                
+
  9%|▉         | 21/227 [01:16<05:51,  1.71s/it]
                                                
+
  9%|▉         | 21/227 [01:37<05:51,  1.71s/it]
 10%|▉         | 22/227 [01:42<21:45,  6.37s/it]
                                                
+
 10%|▉         | 22/227 [01:47<21:45,  6.37s/it]
 10%|█         | 23/227 [01:50<22:49,  6.71s/it]
                                                
+
 10%|█         | 23/227 [01:50<22:49,  6.71s/it]
 11%|█         | 24/227 [01:50<17:29,  5.17s/it]
                                                
+
 11%|█         | 24/227 [01:50<17:29,  5.17s/it]
 11%|█         | 25/227 [01:51<13:16,  3.94s/it]
                                                
+
 11%|█         | 25/227 [01:51<13:16,  3.94s/it]
 11%|█▏        | 26/227 [01:51<09:52,  2.95s/it]
                                                
+
 11%|█▏        | 26/227 [01:51<09:52,  2.95s/it]
                                                
+
 11%|█▏        | 26/227 [01:51<09:52,  2.95s/it]
                                                
+
 11%|█▏        | 26/227 [02:01<09:52,  2.95s/it]
 13%|█▎        | 29/227 [02:06<13:32,  4.10s/it]
                                                
+
 13%|█▎        | 29/227 [02:10<13:32,  4.10s/it]
 13%|█▎        | 30/227 [02:13<15:09,  4.62s/it]
                                                
+
 13%|█▎        | 30/227 [02:13<15:09,  4.62s/it]
                                                
+
 13%|█▎        | 30/227 [02:13<15:09,  4.62s/it]
                                                
+
 13%|█▎        | 30/227 [02:13<15:09,  4.62s/it]
                                                
+
 13%|█▎        | 30/227 [02:13<15:09,  4.62s/it]
 15%|█▍        | 34/227 [02:13<07:02,  2.19s/it]
                                                
+
 15%|█▍        | 34/227 [02:13<07:02,  2.19s/it]
 15%|█▌        | 35/227 [02:13<05:57,  1.86s/it]
                                                
+
 15%|█▌        | 35/227 [02:13<05:57,  1.86s/it]
                                                
+
 15%|█▌        | 35/227 [02:14<05:57,  1.86s/it]
                                                
+
 15%|█▌        | 35/227 [02:29<05:57,  1.86s/it]
 16%|█▌        | 36/227 [02:34<17:13,  5.41s/it]
                                                
+
 16%|█▌        | 36/227 [02:40<17:13,  5.41s/it]
 16%|█▋        | 37/227 [02:42<18:59,  6.00s/it]
                                                
+
 16%|█▋        | 37/227 [02:42<18:59,  6.00s/it]
 17%|█▋        | 38/227 [02:42<14:36,  4.64s/it]
                                                
+
 17%|█▋        | 38/227 [02:43<14:36,  4.64s/it]
 17%|█▋        | 39/227 [02:43<11:06,  3.54s/it]
                                                
+
 17%|█▋        | 39/227 [02:43<11:06,  3.54s/it]
 18%|█▊        | 40/227 [02:43<08:17,  2.66s/it]
                                                
+
 18%|█▊        | 40/227 [02:43<08:17,  2.66s/it]
                                                
+
 18%|█▊        | 40/227 [02:43<08:17,  2.66s/it]
                                                
+
 18%|█▊        | 40/227 [02:44<08:17,  2.66s/it]
                                                
+
 18%|█▊        | 40/227 [02:48<08:17,  2.66s/it]
                                                
+
 18%|█▊        | 40/227 [03:01<08:17,  2.66s/it]
 18%|█▊        | 41/227 [03:05<24:54,  8.03s/it]
                                                
+
 18%|█▊        | 41/227 [03:11<24:54,  8.03s/it]
 19%|█▊        | 42/227 [03:13<24:48,  8.05s/it]
                                                
+
 19%|█▊        | 42/227 [03:13<24:48,  8.05s/it]
                                                
+
 19%|█▊        | 42/227 [03:14<24:48,  8.05s/it]
 19%|█▉        | 44/227 [03:14<13:51,  4.54s/it]
                                                
+
 19%|█▉        | 44/227 [03:14<13:51,  4.54s/it]
 20%|█▉        | 45/227 [03:14<10:34,  3.49s/it]
                                                
+
 20%|█▉        | 45/227 [03:14<10:34,  3.49s/it]
                                                
+
 20%|█▉        | 45/227 [03:14<10:34,  3.49s/it]
                                                
+
 20%|█▉        | 45/227 [03:20<10:34,  3.49s/it]
 20%|██        | 46/227 [03:22<14:28,  4.80s/it]
                                                
+
 20%|██        | 46/227 [03:35<14:28,  4.80s/it]
 21%|██        | 47/227 [03:40<24:25,  8.14s/it]
                                                
+
 21%|██        | 47/227 [03:40<24:25,  8.14s/it]
 21%|██        | 48/227 [03:40<17:42,  5.94s/it]
                                                
+
 21%|██        | 48/227 [03:40<17:42,  5.94s/it]
                                                
+
 21%|██        | 48/227 [03:48<17:42,  5.94s/it]
 22%|██▏       | 50/227 [03:52<17:57,  6.09s/it]
                                                
+
 22%|██▏       | 50/227 [03:57<17:57,  6.09s/it]
 22%|██▏       | 51/227 [03:59<18:27,  6.29s/it]
                                                
+
 22%|██▏       | 51/227 [03:59<18:27,  6.29s/it]
                                                
+
 22%|██▏       | 51/227 [03:59<18:27,  6.29s/it]
                                                
+
 22%|██▏       | 51/227 [03:59<18:27,  6.29s/it]
                                                
+
 22%|██▏       | 51/227 [04:00<18:27,  6.29s/it]
 24%|██▍       | 55/227 [04:00<07:45,  2.70s/it]
                                                
+
 24%|██▍       | 55/227 [04:00<07:45,  2.70s/it]
 25%|██▍       | 56/227 [04:00<06:27,  2.27s/it]
                                                
+
 25%|██▍       | 56/227 [04:00<06:27,  2.27s/it]
                                                
+
 25%|██▍       | 56/227 [04:01<06:27,  2.27s/it]
                                                
+
 25%|██▍       | 56/227 [04:01<06:27,  2.27s/it]
                                                
+
 25%|██▍       | 56/227 [04:05<06:27,  2.27s/it]
 25%|██▌       | 57/227 [04:05<08:02,  2.84s/it]
                                                
+
 25%|██▌       | 57/227 [04:05<08:02,  2.84s/it]
                                                
+
 25%|██▌       | 57/227 [04:05<08:02,  2.84s/it]
                                                
+
 25%|██▌       | 57/227 [04:18<08:02,  2.84s/it]
 26%|██▌       | 59/227 [04:22<13:51,  4.95s/it]
                                                
+
 26%|██▌       | 59/227 [04:27<13:51,  4.95s/it]
 26%|██▋       | 60/227 [04:30<15:08,  5.44s/it]
                                                
+
 26%|██▋       | 60/227 [04:30<15:08,  5.44s/it]
                                                
+
 26%|██▋       | 60/227 [04:30<15:08,  5.44s/it]
 27%|██▋       | 62/227 [04:30<09:36,  3.49s/it]
                                                
+
 27%|██▋       | 62/227 [04:30<09:36,  3.49s/it]
 28%|██▊       | 63/227 [04:30<07:38,  2.80s/it]
                                                
+
 28%|██▊       | 63/227 [04:30<07:38,  2.80s/it]
                                                
+
 28%|██▊       | 63/227 [04:30<07:38,  2.80s/it]
                                                
+
 28%|██▊       | 63/227 [04:41<07:38,  2.80s/it]
 29%|██▉       | 66/227 [04:45<10:21,  3.86s/it]
                                                
+
 29%|██▉       | 66/227 [04:47<10:21,  3.86s/it]
 30%|██▉       | 67/227 [04:50<10:37,  3.99s/it]
                                                
+
 30%|██▉       | 67/227 [04:50<10:37,  3.99s/it]
 30%|██▉       | 68/227 [04:50<08:25,  3.18s/it]
                                                
+
 30%|██▉       | 68/227 [04:50<08:25,  3.18s/it]
                                                
+
 30%|██▉       | 68/227 [04:50<08:25,  3.18s/it]
                                                
+
 30%|██▉       | 68/227 [04:50<08:25,  3.18s/it]
 31%|███▏      | 71/227 [04:50<04:28,  1.72s/it]
                                                
+
 31%|███▏      | 71/227 [04:50<04:28,  1.72s/it]
 32%|███▏      | 72/227 [04:51<03:42,  1.44s/it]
                                                
+
 32%|███▏      | 72/227 [04:51<03:42,  1.44s/it]
                                                
+
 32%|███▏      | 72/227 [04:51<03:42,  1.44s/it]
                                                
+
 32%|███▏      | 72/227 [05:01<03:42,  1.44s/it]
 32%|███▏      | 73/227 [05:06<11:14,  4.38s/it]
                                                
+
 32%|███▏      | 73/227 [05:08<11:14,  4.38s/it]
 33%|███▎      | 74/227 [05:11<11:14,  4.41s/it]
                                                
+
 33%|███▎      | 74/227 [05:11<11:14,  4.41s/it]
                                                
+
 33%|███▎      | 74/227 [05:11<11:14,  4.41s/it]
 33%|███▎      | 76/227 [05:11<06:52,  2.73s/it]
                                                
+
 33%|███▎      | 76/227 [05:11<06:52,  2.73s/it]
 34%|███▍      | 77/227 [05:11<05:24,  2.16s/it]
                                                
+
 34%|███▍      | 77/227 [05:11<05:24,  2.16s/it]
                                                
+
 34%|███▍      | 77/227 [05:11<05:24,  2.16s/it]
                                                
+
 34%|███▍      | 77/227 [05:17<05:24,  2.16s/it]
 35%|███▌      | 80/227 [05:22<07:03,  2.88s/it]
                                                
+
 35%|███▌      | 80/227 [05:24<07:03,  2.88s/it]
 36%|███▌      | 81/227 [05:26<07:40,  3.16s/it]
                                                
+
 36%|███▌      | 81/227 [05:26<07:40,  3.16s/it]
                                                
+
 36%|███▌      | 81/227 [05:26<07:40,  3.16s/it]
                                                
+
 36%|███▌      | 81/227 [05:26<07:40,  3.16s/it]
                                                
+
 36%|███▌      | 81/227 [05:27<07:40,  3.16s/it]
 37%|███▋      | 85/227 [05:27<03:41,  1.56s/it]
                                                
+
 37%|███▋      | 85/227 [05:27<03:41,  1.56s/it]
 38%|███▊      | 86/227 [05:27<03:09,  1.34s/it]
                                                
+
 38%|███▊      | 86/227 [05:27<03:09,  1.34s/it]
                                                
+
 38%|███▊      | 86/227 [05:27<03:09,  1.34s/it]
                                                
+
 38%|███▊      | 86/227 [05:38<03:09,  1.34s/it]
 38%|███▊      | 87/227 [05:43<09:14,  3.96s/it]
                                                
+
 38%|███▊      | 87/227 [05:46<09:14,  3.96s/it]
 39%|███▉      | 88/227 [05:49<10:20,  4.47s/it]
                                                
+
 39%|███▉      | 88/227 [05:49<10:20,  4.47s/it]
                                                
+
 39%|███▉      | 88/227 [05:49<10:20,  4.47s/it]
 40%|███▉      | 90/227 [05:49<06:32,  2.87s/it]
                                                
+
 40%|███▉      | 90/227 [05:49<06:32,  2.87s/it]
 40%|████      | 91/227 [05:49<05:12,  2.30s/it]
                                                
+
 40%|████      | 91/227 [05:49<05:12,  2.30s/it]
                                                
+
 40%|████      | 91/227 [05:49<05:12,  2.30s/it]
                                                
+
 40%|████      | 91/227 [05:49<05:12,  2.30s/it]
                                                
+
 40%|████      | 91/227 [05:50<05:12,  2.30s/it]
                                                
+
 40%|████      | 91/227 [06:04<05:12,  2.30s/it]
 41%|████▏     | 94/227 [06:09<09:24,  4.25s/it]
                                                
+
 41%|████▏     | 94/227 [06:14<09:24,  4.25s/it]
 42%|████▏     | 95/227 [06:17<10:47,  4.91s/it]
                                                
+
 42%|████▏     | 95/227 [06:17<10:47,  4.91s/it]
                                                
+
 42%|████▏     | 95/227 [06:17<10:47,  4.91s/it]
 43%|████▎     | 97/227 [06:17<07:05,  3.27s/it]
                                                
+
 43%|████▎     | 97/227 [06:17<07:05,  3.27s/it]
 43%|████▎     | 98/227 [06:17<05:42,  2.66s/it]
                                                
+
 43%|████▎     | 98/227 [06:17<05:42,  2.66s/it]
                                                
+
 43%|████▎     | 98/227 [06:17<05:42,  2.66s/it]
                                                
+
 43%|████▎     | 98/227 [06:26<05:42,  2.66s/it]
 44%|████▍     | 101/227 [06:31<07:25,  3.54s/it]
                                                 
+
 44%|████▍     | 101/227 [06:33<07:25,  3.54s/it]
 45%|████▍     | 102/227 [06:36<07:51,  3.77s/it]
                                                 
+
 45%|████▍     | 102/227 [06:36<07:51,  3.77s/it]
                                                 
+
 45%|████▍     | 102/227 [06:36<07:51,  3.77s/it]
                                                 
+
 45%|████▍     | 102/227 [06:36<07:51,  3.77s/it]
                                                 
+
 45%|████▍     | 102/227 [06:36<07:51,  3.77s/it]
 47%|████▋     | 106/227 [06:36<03:50,  1.90s/it]
                                                 
+
 47%|████▋     | 106/227 [06:36<03:50,  1.90s/it]
 47%|████▋     | 107/227 [06:36<03:16,  1.64s/it]
                                                 
+
 47%|████▋     | 107/227 [06:36<03:16,  1.64s/it]
                                                 
+
 47%|████▋     | 107/227 [06:37<03:16,  1.64s/it]
                                                 
+
 47%|████▋     | 107/227 [06:50<03:16,  1.64s/it]
 48%|████▊     | 108/227 [06:55<09:20,  4.71s/it]
                                                 
+
 48%|████▊     | 108/227 [07:00<09:20,  4.71s/it]
 48%|████▊     | 109/227 [07:02<10:20,  5.26s/it]
                                                 
+
 48%|████▊     | 109/227 [07:02<10:20,  5.26s/it]
                                                 
+
 48%|████▊     | 109/227 [07:02<10:20,  5.26s/it]
 49%|████▉     | 111/227 [07:03<06:32,  3.38s/it]
                                                 
+
 49%|████▉     | 111/227 [07:03<06:32,  3.38s/it]
 49%|████▉     | 112/227 [07:03<05:12,  2.71s/it]
                                                 
+
 49%|████▉     | 112/227 [07:03<05:12,  2.71s/it]
                                                 
+
 49%|████▉     | 112/227 [07:03<05:12,  2.71s/it]
                                                 
+
 49%|████▉     | 112/227 [07:20<05:12,  2.71s/it]
 51%|█████     | 115/227 [07:25<09:20,  5.01s/it]
                                                 
+
 51%|█████     | 115/227 [07:32<09:20,  5.01s/it]
 51%|█████     | 116/227 [07:34<10:33,  5.71s/it]
                                                 
+
 51%|█████     | 116/227 [07:34<10:33,  5.71s/it]
 52%|█████▏    | 117/227 [07:34<08:20,  4.55s/it]
                                                 
+
 52%|█████▏    | 117/227 [07:34<08:20,  4.55s/it]
                                                 
+
 52%|█████▏    | 117/227 [07:34<08:20,  4.55s/it]
                                                 
+
 52%|█████▏    | 117/227 [07:35<08:20,  4.55s/it]
 53%|█████▎    | 120/227 [07:35<04:21,  2.45s/it]
                                                 
+
 53%|█████▎    | 120/227 [07:35<04:21,  2.45s/it]
 53%|█████▎    | 121/227 [07:35<03:34,  2.03s/it]
                                                 
+
 53%|█████▎    | 121/227 [07:35<03:34,  2.03s/it]
                                                 
+
 53%|█████▎    | 121/227 [07:36<03:34,  2.03s/it]
                                                 
+
 53%|█████▎    | 121/227 [07:56<03:34,  2.03s/it]
 54%|█████▎    | 122/227 [08:02<12:30,  7.15s/it]
                                                 
+
 54%|█████▎    | 122/227 [08:09<12:30,  7.15s/it]
 54%|█████▍    | 123/227 [08:12<13:32,  7.81s/it]
                                                 
+
 54%|█████▍    | 123/227 [08:12<13:32,  7.81s/it]
 55%|█████▍    | 124/227 [08:12<10:09,  5.92s/it]
                                                 
+
 55%|█████▍    | 124/227 [08:12<10:09,  5.92s/it]
 55%|████��▌    | 125/227 [08:12<07:32,  4.44s/it]
                                                 
+
 55%|█████▌    | 125/227 [08:12<07:32,  4.44s/it]
 56%|█████▌    | 126/227 [08:12<05:31,  3.28s/it]
                                                 
+
 56%|█████▌    | 126/227 [08:12<05:31,  3.28s/it]
                                                 
+
 56%|█████▌    | 126/227 [08:12<05:31,  3.28s/it]
                                                 
+
 56%|█████▌    | 126/227 [08:24<05:31,  3.28s/it]
 57%|█████▋    | 129/227 [08:28<07:14,  4.43s/it]
                                                 
+
 57%|█████▋    | 129/227 [08:30<07:14,  4.43s/it]
 57%|█████▋    | 130/227 [08:33<07:13,  4.46s/it]
                                                 
+
 57%|█████▋    | 130/227 [08:33<07:13,  4.46s/it]
                                                 
+
 57%|█████▋    | 130/227 [08:33<07:13,  4.46s/it]
                                                 
+
 57%|█████▋    | 130/227 [08:33<07:13,  4.46s/it]
                                                 
+
 57%|█████▋    | 130/227 [08:33<07:13,  4.46s/it]
 59%|█████▉    | 134/227 [08:33<03:15,  2.11s/it]
                                                 
+
 59%|█████▉    | 134/227 [08:33<03:15,  2.11s/it]
 59%|█████▉    | 135/227 [08:33<02:44,  1.79s/it]
                                                 
+
 59%|█████▉    | 135/227 [08:33<02:44,  1.79s/it]
                                                 
+
 59%|█████▉    | 135/227 [08:34<02:44,  1.79s/it]
                                                 
+
 59%|█████▉    | 135/227 [08:44<02:44,  1.79s/it]
 60%|█████▉    | 136/227 [08:49<06:38,  4.38s/it]
                                                 
+
 60%|█████▉    | 136/227 [08:51<06:38,  4.38s/it]
 60%|██████    | 137/227 [08:53<06:33,  4.37s/it]
                                                 
+
 60%|██████    | 137/227 [08:53<06:33,  4.37s/it]
                                                 
+
 60%|██████    | 137/227 [08:54<06:33,  4.37s/it]
 61%|██████    | 139/227 [08:54<04:05,  2.78s/it]
                                                 
+
 61%|██████    | 139/227 [08:54<04:05,  2.78s/it]
 62%|██████▏   | 140/227 [08:54<03:13,  2.23s/it]
                                                 
+
 62%|██████▏   | 140/227 [08:54<03:13,  2.23s/it]
                                                 
+
 62%|██████▏   | 140/227 [08:54<03:13,  2.23s/it]
                                                 
+
 62%|██████▏   | 140/227 [08:54<03:13,  2.23s/it]
                                                 
+
 62%|██████▏   | 140/227 [08:54<03:13,  2.23s/it]
                                                 
+
 62%|██████▏   | 140/227 [09:05<03:13,  2.23s/it]
 63%|██████▎   | 143/227 [09:10<05:11,  3.70s/it]
                                                 
+
 63%|██████▎   | 143/227 [09:12<05:11,  3.70s/it]
 63%|██████▎   | 144/227 [09:14<05:20,  3.87s/it]
                                                 
+
 63%|██████▎   | 144/227 [09:14<05:20,  3.87s/it]
 64%|██████▍   | 145/227 [09:15<04:12,  3.08s/it]
                                                 
+
 64%|██████▍   | 145/227 [09:15<04:12,  3.08s/it]
 64%|██████▍   | 146/227 [09:15<03:16,  2.43s/it]
                                                 
+
 64%|██████▍   | 146/227 [09:15<03:16,  2.43s/it]
 65%|██████▍   | 147/227 [09:15<02:29,  1.87s/it]
                                                 
+
 65%|██████▍   | 147/227 [09:15<02:29,  1.87s/it]
                                                 
+
 65%|██████▍   | 147/227 [09:15<02:29,  1.87s/it]
                                                 
+
 65%|██████▍   | 147/227 [09:21<02:29,  1.87s/it]
 66%|██████▌   | 150/227 [09:26<03:37,  2.83s/it]
                                                 
+
 66%|██████▌   | 150/227 [09:28<03:37,  2.83s/it]
 67%|██████▋   | 151/227 [09:31<03:58,  3.14s/it]
                                                 
+
 67%|██████▋   | 151/227 [09:31<03:58,  3.14s/it]
                                                 
+
 67%|██████▋   | 151/227 [09:31<03:58,  3.14s/it]
                                                 
+
 67%|██████▋   | 151/227 [09:31<03:58,  3.14s/it]
                                                 
+
 67%|██████▋   | 151/227 [09:31<03:58,  3.14s/it]
 68%|██████▊   | 155/227 [09:31<01:49,  1.52s/it]
                                                 
+
 68%|██████▊   | 155/227 [09:31<01:49,  1.52s/it]
 69%|██████▊   | 156/227 [09:31<01:32,  1.30s/it]
                                                 
+
 69%|██████▊   | 156/227 [09:31<01:32,  1.30s/it]
                                                 
+
 69%|██████▊   | 156/227 [09:32<01:32,  1.30s/it]
                                                 
+
 69%|██████▊   | 156/227 [09:43<01:32,  1.30s/it]
 69%|██████▉   | 157/227 [09:48<04:51,  4.17s/it]
                                                 
+
 69%|██████▉   | 157/227 [09:53<04:51,  4.17s/it]
 70%|██████▉   | 158/227 [09:55<05:37,  4.90s/it]
                                                 
+
 70%|██████▉   | 158/227 [09:56<05:37,  4.90s/it]
 70%|███████   | 159/227 [09:56<04:18,  3.80s/it]
                                                 
+
 70%|███████   | 159/227 [09:56<04:18,  3.80s/it]
 70%|███████   | 160/227 [09:56<03:15,  2.92s/it]
                                                 
+
 70%|███████   | 160/227 [09:56<03:15,  2.92s/it]
 71%|███████   | 161/227 [09:56<02:25,  2.20s/it]
                                                 
+
 71%|███████   | 161/227 [09:56<02:25,  2.20s/it]
                                                 
+
 71%|███████   | 161/227 [09:56<02:25,  2.20s/it]
                                                 
+
 71%|███████   | 161/227 [10:11<02:25,  2.20s/it]
 72%|███████▏  | 164/227 [10:16<04:45,  4.53s/it]
                                                 
+
 72%|███████▏  | 164/227 [10:22<04:45,  4.53s/it]
 73%|███████▎  | 165/227 [10:24<05:30,  5.34s/it]
                                                 
+
 73%|███████▎  | 165/227 [10:24<05:30,  5.34s/it]
 73%|███████▎  | 166/227 [10:25<04:14,  4.17s/it]
                                                 
+
 73%|███████▎  | 166/227 [10:25<04:14,  4.17s/it]
                                                 
+
 73%|███████▎  | 166/227 [10:25<04:14,  4.17s/it]
                                                 
+
 73%|███████▎  | 166/227 [10:25<04:14,  4.17s/it]
 74%|███████▍  | 169/227 [10:25<02:06,  2.17s/it]
                                                 
+
 74%|███████▍  | 169/227 [10:25<02:06,  2.17s/it]
 75%|███████▍  | 170/227 [10:25<01:42,  1.79s/it]
                                                 
+
 75%|███████▍  | 170/227 [10:25<01:42,  1.79s/it]
                                                 
+
 75%|███████▍  | 170/227 [10:26<01:42,  1.79s/it]
                                                 
+
 75%|███████▍  | 170/227 [10:45<01:42,  1.79s/it]
 75%|███████▌  | 171/227 [10:51<06:23,  6.85s/it]
                                                 
+
 75%|███████▌  | 171/227 [10:53<06:23,  6.85s/it]
 76%|███████▌  | 172/227 [10:55<05:50,  6.38s/it]
                                                 
+
 76%|███████▌  | 172/227 [10:55<05:50,  6.38s/it]
 76%|███████▌  | 173/227 [10:55<04:19,  4.81s/it]
                                                 
+
 76%|███████▌  | 173/227 [10:56<04:19,  4.81s/it]
 77%|███████▋  | 174/227 [10:56<03:11,  3.61s/it]
                                                 
+
 77%|███████▋  | 174/227 [10:56<03:11,  3.61s/it]
 77%|███████▋  | 175/227 [10:56<02:18,  2.67s/it]
                                                 
+
 77%|███████▋  | 175/227 [10:56<02:18,  2.67s/it]
                                                 
+
 77%|███████▋  | 175/227 [10:56<02:18,  2.67s/it]
                                                 
+
 77%|███████▋  | 175/227 [10:56<02:18,  2.67s/it]
                                                 
+
 77%|███████▋  | 175/227 [10:56<02:18,  2.67s/it]
                                                 
+
 77%|███████▋  | 175/227 [11:09<02:18,  2.67s/it]
 78%|███████▊  | 178/227 [11:14<03:40,  4.50s/it]
                                                 
+
 78%|███████▊  | 178/227 [11:16<03:40,  4.50s/it]
 79%|███████▉  | 179/227 [11:19<03:36,  4.51s/it]
                                                 
+
 79%|███████▉  | 179/227 [11:19<03:36,  4.51s/it]
                                                 
+
 79%|███████▉  | 179/227 [11:19<03:36,  4.51s/it]
 80%|███████▉  | 181/227 [11:19<02:13,  2.91s/it]
                                                 
+
 80%|███████▉  | 181/227 [11:19<02:13,  2.91s/it]
 80%|████████  | 182/227 [11:19<01:45,  2.34s/it]
                                                 
+
 80%|████████  | 182/227 [11:19<01:45,  2.34s/it]
                                                 
+
 80%|████████  | 182/227 [11:19<01:45,  2.34s/it]
                                                 
+
 80%|████████  | 182/227 [11:24<01:45,  2.34s/it]
 81%|████████▏ | 185/227 [11:28<01:52,  2.67s/it]
                                                 
+
 81%|████████▏ | 185/227 [11:30<01:52,  2.67s/it]
 82%|████████▏ | 186/227 [11:33<02:02,  2.98s/it]
                                                 
+
 82%|████████▏ | 186/227 [11:33<02:02,  2.98s/it]
                                                 
+
 82%|████████▏ | 186/227 [11:33<02:02,  2.98s/it]
                                                 
+
 82%|████████▏ | 186/227 [11:33<02:02,  2.98s/it]
                                                 
+
 82%|████████▏ | 186/227 [11:33<02:02,  2.98s/it]
 84%|████████▎ | 190/227 [11:33<00:55,  1.50s/it]
                                                 
+
 84%|████████▎ | 190/227 [11:33<00:55,  1.50s/it]
 84%|████████▍ | 191/227 [11:33<00:46,  1.29s/it]
                                                 
+
 84%|████████▍ | 191/227 [11:33<00:46,  1.29s/it]
                                                 
+
 84%|████████▍ | 191/227 [11:33<00:46,  1.29s/it]
 85%|████████▌ | 193/227 [11:33<00:31,  1.07it/s]
                                                 
+
 85%|████████▌ | 193/227 [11:33<00:31,  1.07it/s]
 85%|████████▌ | 194/227 [11:33<00:26,  1.26it/s]
                                                 
+
 85%|████████▌ | 194/227 [11:33<00:26,  1.26it/s]
                                                 
+
 85%|████████▌ | 194/227 [11:34<00:26,  1.26it/s]
                                                 
+
 85%|████████▌ | 194/227 [11:35<00:26,  1.26it/s]
                                                 
+
 85%|████████▌ | 194/227 [11:39<00:26,  1.26it/s]
 86%|████████▌ | 195/227 [11:39<00:54,  1.71s/it]
                                                 
+
 86%|████████▌ | 195/227 [11:39<00:54,  1.71s/it]
                                                 
+
 86%|████████▌ | 195/227 [11:44<00:54,  1.71s/it]
 87%|████████▋ | 197/227 [11:49<01:31,  3.04s/it]
                                                 
+
 87%|████████▋ | 197/227 [11:51<01:31,  3.04s/it]
 87%|████████▋ | 198/227 [11:54<01:37,  3.37s/it]
                                                 
+
 87%|████████▋ | 198/227 [11:54<01:37,  3.37s/it]
 88%|████████▊ | 199/227 [11:54<01:13,  2.62s/it]
                                                 
+
 88%|████████▊ | 199/227 [11:54<01:13,  2.62s/it]
                                                 
+
 88%|████████▊ | 199/227 [11:54<01:13,  2.62s/it]
                                                 
+
 88%|████████▊ | 199/227 [11:54<01:13,  2.62s/it]
 89%|████████▉ | 202/227 [11:54<00:34,  1.36s/it]
                                                 
+
 89%|████████▉ | 202/227 [11:54<00:34,  1.36s/it]
 89%|████████▉ | 203/227 [11:55<00:27,  1.13s/it]
                                                 
+
 89%|████████▉ | 203/227 [11:55<00:27,  1.13s/it]
                                                 
+
 89%|████████▉ | 203/227 [11:55<00:27,  1.13s/it]
 90%|█████████ | 205/227 [11:55<00:17,  1.29it/s]
                                                 
+
 90%|█████████ | 205/227 [11:55<00:17,  1.29it/s]
 91%|█████████ | 206/227 [11:55<00:13,  1.54it/s]
                                                 
+
 91%|█████████ | 206/227 [11:55<00:13,  1.54it/s]
                                                 
+
 91%|█████████ | 206/227 [11:56<00:13,  1.54it/s]
                                                 
+
 91%|█████████ | 206/227 [12:04<00:13,  1.54it/s]
 91%|█████████ | 207/227 [12:09<01:13,  3.65s/it]
                                                 
+
 91%|█████████ | 207/227 [12:11<01:13,  3.65s/it]
 92%|█████████▏| 208/227 [12:14<01:13,  3.88s/it]
                                                 
+
 92%|█████████▏| 208/227 [12:14<01:13,  3.88s/it]
                                                 
+
 92%|█████████▏| 208/227 [12:14<01:13,  3.88s/it]
                                                 
+
 92%|█████████▏| 208/227 [12:14<01:13,  3.88s/it]
                                                 
+
 92%|█████████▏| 208/227 [12:27<01:13,  3.88s/it]
 93%|█████████▎| 211/227 [12:32<01:19,  4.98s/it]
                                                 
+
 93%|█████████▎| 211/227 [12:37<01:19,  4.98s/it]
 93%|█████████▎| 212/227 [12:40<01:24,  5.65s/it]
                                                 
+
 93%|█████████▎| 212/227 [12:40<01:24,  5.65s/it]
                                                 
+
 93%|█████████▎| 212/227 [12:40<01:24,  5.65s/it]
 94%|█████████▍| 214/227 [12:41<00:48,  3.69s/it]
                                                 
+
 94%|█████████▍| 214/227 [12:41<00:48,  3.69s/it]
 95%|█████████▍| 215/227 [12:41<00:35,  2.97s/it]
                                                 
+
 95%|█████████▍| 215/227 [12:41<00:35,  2.97s/it]
                                                 
+
 95%|█████████▍| 215/227 [12:41<00:35,  2.97s/it]
                                                 
+
 95%|█████████▍| 215/227 [12:54<00:35,  2.97s/it]
 96%|█████████▌| 218/227 [12:59<00:40,  4.47s/it]
                                                 
+
 96%|█████████▌| 218/227 [13:06<00:40,  4.47s/it]
 96%|█████████▋| 219/227 [13:08<00:42,  5.32s/it]
                                                 
+
 96%|█████████▋| 219/227 [13:08<00:42,  5.32s/it]
 97%|█████████▋| 220/227 [13:08<00:29,  4.25s/it]
                                                 
+
 97%|█████████▋| 220/227 [13:08<00:29,  4.25s/it]
                                                 
+
 97%|█████████▋| 220/227 [13:08<00:29,  4.25s/it]
                                                 
+
 97%|█████████▋| 220/227 [13:09<00:29,  4.25s/it]
 98%|█████████▊| 223/227 [13:09<00:09,  2.29s/it]
                                                 
+
 98%|█████████▊| 223/227 [13:09<00:09,  2.29s/it]
 99%|█████████▊| 224/227 [13:09<00:05,  1.90s/it]
                                                 
+
 99%|█████████▊| 224/227 [13:09<00:05,  1.90s/it]
                                                 
+
 99%|█████████▊| 224/227 [13:09<00:05,  1.90s/it]
                                                 
+
+[2024-06-06 22:39:06] INFO huggingface_loader.py:197: Unloading HF weight file: /models/Mixtral-8x7B-Instruct-v0.1/model-00004-of-00019.safetensors
+[2024-06-06 22:39:06] INFO huggingface_loader.py:197: Unloading HF weight file: /models/Mixtral-8x7B-Instruct-v0.1/model-00005-of-00019.safetensors
+[2024-06-06 22:39:07] INFO stats.py:77: Time usage: HF loading: 108.338 sec; Pre-quantization mapping: 421.469 sec; Quantization: 0.000 sec
+[2024-06-06 22:39:07] INFO stats.py:91: RAM usage: Peak RAM: 18.563 GB. Total bytes loaded from disk: 210.951 GB
+[2024-06-06 22:39:07] INFO convert_weight.py:155: Parameter size after quantization: 86.991 GB
+[2024-06-06 22:39:07] INFO convert_weight.py:160: Total parameters: 56,626,802,688
+[2024-06-06 22:39:07] INFO convert_weight.py:161: Bits per parameter: 13.196
+[2024-06-06 22:39:07] INFO convert_weight.py:166: Saved to directory: /models/mlc-delivery/hf/mlc-ai/Mixtral-8x7B-Instruct-v0.1-q0f16-MLC
+
+All finished, 131 total shards committed, record saved to /models/mlc-delivery/hf/mlc-ai/Mixtral-8x7B-Instruct-v0.1-q0f16-MLC/ndarray-cache.json

mlc-chat-config.json

@@ -0,0 +1,79 @@
+{
+  "version": "0.1.0",
+  "model_type": "mixtral",
+  "quantization": "q0f16",
+  "model_config": {
+    "hidden_size": 4096,
+    "intermediate_size": 14336,
+    "num_attention_heads": 32,
+    "num_hidden_layers": 32,
+    "rms_norm_eps": 1e-05,
+    "vocab_size": 32000,
+    "position_embedding_base": 1000000.0,
+    "context_window_size": 32768,
+    "prefill_chunk_size": 2048,
+    "num_key_value_heads": 8,
+    "head_dim": 128,
+    "tensor_parallel_shards": 1,
+    "max_batch_size": 80,
+    "num_local_experts": 8,
+    "num_experts_per_tok": 2
+  },
+  "vocab_size": 32000,
+  "context_window_size": 32768,
+  "sliding_window_size": -1,
+  "prefill_chunk_size": 2048,
+  "attention_sink_size": -1,
+  "tensor_parallel_shards": 1,
+  "temperature": 1.0,
+  "presence_penalty": 0.0,
+  "frequency_penalty": 0.0,
+  "repetition_penalty": 1.0,
+  "top_p": 1.0,
+  "tokenizer_files": [
+    "tokenizer.model",
+    "tokenizer.json",
+    "tokenizer_config.json"
+  ],
+  "tokenizer_info": {
+    "token_postproc_method": "byte_fallback",
+    "prepend_space_in_encode": true,
+    "strip_space_in_decode": true
+  },
+  "conv_template": {
+    "name": "mistral_default",
+    "system_template": "[INST] {system_message}",
+    "system_message": "Always assist with care, respect, and truth. Respond with utmost utility yet securely. Avoid harmful, unethical, prejudiced, or negative content. Ensure replies promote fairness and positivity.",
+    "system_prefix_token_ids": [
+      1
+    ],
+    "add_role_after_system_message": false,
+    "roles": {
+      "user": "[INST]",
+      "assistant": "[/INST]",
+      "tool": "[INST]"
+    },
+    "role_templates": {
+      "user": "{user_message}",
+      "assistant": "{assistant_message}",
+      "tool": "{tool_message}"
+    },
+    "messages": [],
+    "seps": [
+      " "
+    ],
+    "role_content_sep": " ",
+    "role_empty_sep": "",
+    "stop_str": [
+      "</s>"
+    ],
+    "stop_token_ids": [
+      2
+    ],
+    "function_string": "",
+    "use_function_calling": false
+  },
+  "pad_token_id": 0,
+  "bos_token_id": 1,
+  "eos_token_id": 2
+}

params_shard_0.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:16101cbb74b54cda9ebc07ca3c762e3263a56efb3cc011156184b95807d7cf13
+size 262144000

params_shard_1.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5240690f3dd0075eae3ead12dd6dbf6fa02dd4587e6292bf1e1331d0f432fc92
+size 1879048192

params_shard_10.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7d4091b58ec9586383abedc191fe314d6be3329afd13755c7b676291fb5bf1ba
+size 50331648

params_shard_100.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9ab7a6222479b173cb8966eda88f7c26baf941e54bce9db7bb554f2da51d5803
+size 50331648

params_shard_101.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5dc3d3a05f9f7729509147fd09c16fb53f85f520cdab5cb69abf4bae3fd460c7
+size 33554432

params_shard_102.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71b3356d283f32777cc2de6ceeb015f1ff473cd21088e7f2a656035461089238
+size 1879048192

params_shard_103.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:516d3f8abaedb01b9916a4b67d4672159769138ef2850158bc1b32c41e31f0e8
+size 939524096

params_shard_104.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a2d597efa830a1be9539d362fae1a447e9613d722d0cc3cbe53f663ea7008967
+size 50331648

params_shard_105.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9b5fdedd32d39ef46a22cca7cd5355d7b93bd07ea305f466a8aad6ca5a4f3778
+size 33554432

params_shard_106.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b5a3be964bde9720b76e8e46c1b5a41ae8934b0b1605c39a61ac789c9567569
+size 1879048192

params_shard_107.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:03a3386e4f0b75a28c5608e23b2de8f0de25f21954e4aa7fc343431bde9db07e
+size 939524096

params_shard_108.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3e183c20b0d4a628facfebfb53f1d8dbdede047c9998bc1b306606ef00cfa5fc
+size 50331648

params_shard_109.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4f650a71efb150d1f24cd4d114d4187bf570ac424da3b92ea6455abdf1aea705
+size 33554432

params_shard_11.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c5f754c855e262e8d4c94c6fbbb57af06399dc0e170d7d99a1a17fc9aab9227
+size 33554432

params_shard_110.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4bbe17ff9d86e9c9186aa198aada0587cb2a235157663724c20986a7e149ca92
+size 50331648

params_shard_111.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9b44378714d784c5ef9ab604359091baca4e0ec222afa139b7f840eaefb371fd
+size 33554432

params_shard_112.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:894dbc5afb70b3a367a603b91157e4905368b47bbc716fdc684ef7b7dbcfa9cd
+size 1879048192

params_shard_113.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d291bb656aae77947d4b525e2819bf4112afece53ff31de9dab999af1f65f9c4
+size 939524096

params_shard_114.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b3f41d4fb4ed0aaa58e4e1d5f4d37d26f3affa8540af608e172ef662c6683200
+size 50331648

params_shard_115.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d98e4a062d2631d9c315f1990d5f6ca9a88e7e0e46387f611ccb0353f876aa12
+size 33554432

params_shard_116.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:16776b74f17c0fac77ddd32330ad15ba1dc3aa036107e320ce6a3d23e81f00fa
+size 50331648

params_shard_117.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4a25662c46979a29600ed77e1907cf81fb16ef30e724c155444e54ccb76af481
+size 33554432

params_shard_118.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3024ea96d33eaf6f0db6c492923b5a4628580207a53667d5abfa8d061bf05d14
+size 1879048192

params_shard_119.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c4b7a57a42b5ac0a8ae27dcd5cb2646d7a7cc7123126d44a56ab128e85f60b13
+size 939524096

params_shard_12.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:07e37851ecf20d9a9684661c500a99662e62e258b7638c0e1aa1a072a0a25fee
+size 1879048192

params_shard_120.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7df07b62c3719fbf70eaacd0d1e19e885baca0c337b9814fc5b84e5c5d8a362b
+size 1879048192

params_shard_121.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ac9cd7db67a2ef0d2b5def86873673d05e48d49d147dd944469dbb8e2d4c46f6
+size 939524096

params_shard_122.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ceb57ce3dea39a6366de150b7596231d6b8ccf3d2831d6b74c8bc96167121820
+size 50331648

params_shard_123.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f3c834a8d0027370350e2b6294d95434d31432e57be6313b013c15a56303d61c
+size 33554432

params_shard_124.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:86d1e67baa279a445d09247e134c4b7a1ba2fd0bb6eb6253028820c49dd3ab6b
+size 1879048192

params_shard_125.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:856c6811945c7b0fa461ca17811cfa43436b4cdf5326bad23cbc30883486d7cc
+size 939524096

params_shard_126.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:49098eab1c0a4702085c2ca6e966f5441425c26f913f92763a26266c338bd352
+size 50331648

params_shard_127.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5367f05ac3bb49ef8745ba5902e1bdd4442415a3ebff2c7e1a3918d7be6fe948
+size 33554432

params_shard_128.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:65bef3498b4ca3e28ad929737688796b97bc98eee1a3da45b2bbff4095de567e
+size 50331648

params_shard_129.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e44a4722acb3b521b81d0b910f8ca2f6c286d874a92ddd02150566454061699
+size 33554432

params_shard_13.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:949da94a3c0f375160672a979e85f7def284264b10d48d038238aad5f5ece793
+size 939524096

params_shard_130.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b3b6d6fd4ff6b0f30fbe20ff03af57340c0bddc620ddc3503135884c80cedfd4
+size 2629632

params_shard_14.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:51fa0502c0425d8e76ed3e53926a34add0fd498f6ac1a562c49a9918625bec2f
+size 50331648

params_shard_15.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b4b2520794d54113e86c8ff678eacfc62e35be4395a594a6c8c22b4383ebcc0c
+size 33554432

params_shard_16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c995d68b48876940a84f6f249c3684d3c361d69adc6f7f5028f4931708fd77b4
+size 1879048192

params_shard_17.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ecdc2b5a8b504ef0a7833acff47d69b0c1fa9c22126de1bb120ff5e48c3d6e2c
+size 939524096

params_shard_18.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e4b64abad86185bfa048ee8dd867b8ecb6462128530427dd604a4d80a70747b4
+size 50331648

params_shard_19.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0f03099ba1ef342ea61af9cd71d028123bbd8b1dd7d7fd9b509aef77815427d9
+size 33554432

params_shard_2.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dd672cc71e82abf05064a18121b8e55fe1a4f19bc1d7cb9a142f4add54bc336e
+size 939524096

params_shard_20.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ab14b70189a85c7c2b15d8faa980cd8321fbdd757206ed9e2d783d5f6931cfad
+size 1879048192

params_shard_21.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:530c3ab44ae4d66e8afa4d10c153ba5dfcdfb7321989a988e62e9d12e7234625
+size 939524096

params_shard_22.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3af7f2cf889a92545136e3efda1756ea8bd01d3911aa570edb762a45ea2e884
+size 50331648