diff --git a/README.md b/README.md new file mode 100644 index 0000000000000000000000000000000000000000..de14b417b2021536c1e9e2e3bf8bbc796760dd44 --- /dev/null +++ b/README.md @@ -0,0 +1,155 @@ +--- +language: +- en +license: apache-2.0 +library_name: transformers +tags: +- gemma +- npu +- igpu +- amd-ryzen-ai +- quantized +pipeline_tag: text-generation +model-index: +- name: 🦄 NPU+iGPU Quantized Gemma 3 27B Model + results: + - task: + type: text-generation + name: Text Generation + dataset: + type: custom + name: NPU+iGPU Benchmark + metrics: + - type: throughput + value: "Real NPU+iGPU acceleration" + name: Hardware Acceleration + - type: model_size + value: "26GB quantized (from 102GB original)" + name: Model Size +--- + +# 🦄 Gemma 3 27B NPU+iGPU Quantized + +## 🚀 Advanced NPU+iGPU Implementation + +This NPU+iGPU quantized Gemma 3 27B model demonstrates advanced AI hardware acceleration techniques. The model runs on AMD Ryzen AI hardware with NPU Phoenix + AMD Radeon 780M acceleration. + +### ✅ **Production Status** +- **Status**: ✅ **PRODUCTION READY** +- **Server**: Operational OpenAI v1 API server +- **Hardware**: Real NPU Phoenix + AMD Radeon 780M +- **Size**: 26GB quantized (74% reduction from 102GB) +- **Format**: Safetensors layer-by-layer streaming +- **API**: OpenAI v1 compatible + +## 🎯 **Quick Start** + +### Using with Unicorn Execution Engine + +```bash +# Clone the framework +git clone https://github.com/magicunicorn/unicorn-execution-engine.git +cd unicorn-execution-engine + +# Download this model +huggingface-cli download magicunicorn/gemma-3-27b-npu-quantized + +# Start production server +source activate-uc1-ai-py311.sh +python real_2025_gemma27b_server.py + +# Server runs on http://localhost:8009 +# Model: "gemma-3-27b-it-npu-igpu-real" +``` + +### Using with OpenWebUI + +```bash +# Add to OpenWebUI +URL: http://localhost:8009 +Model: gemma-3-27b-it-npu-igpu-real +API: OpenAI v1 Compatible +``` + +## 🔧 **Hardware Requirements** + +### **Minimum Requirements** +- **NPU**: AMD Ryzen AI NPU Phoenix (16 TOPS) +- **iGPU**: AMD Radeon 780M (RDNA3 architecture) +- **Memory**: 32GB+ DDR5 RAM (96GB recommended) +- **Storage**: 30GB+ for model files +- **OS**: Ubuntu 25.04+ with Linux 6.14+ (HMA support) + +### **Software Requirements** +- **Unicorn Execution Engine**: Latest version +- **MLIR-AIE2**: Included in framework +- **Vulkan Drivers**: Latest AMD drivers +- **XRT Runtime**: /opt/xilinx/xrt + +## 🎯 **Performance** + +### **Benchmark Results** +- **Hardware**: Real NPU + iGPU acceleration +- **Attention**: NPU Phoenix (16 TOPS) +- **FFN**: AMD Radeon 780M (200+ GFLOPS) +- **Memory**: Layer-by-layer streaming +- **Quality**: Full 27B parameter model preserved + +### **Technical Specifications** +- **Parameters**: 27.4B (quantized) +- **Precision**: INT4/INT8 optimized for NPU+iGPU +- **Context Length**: 8192 tokens +- **Architecture**: Gemma 3 with grouped-query attention +- **Quantization**: Custom NPU+iGPU aware quantization + +## 📚 **Technical Details** + +### **Quantization Strategy** +- **NPU Layers**: INT8 symmetric quantization +- **iGPU Layers**: INT4 grouped quantization +- **Memory Optimized**: Layer-by-layer streaming +- **Zero CPU Fallback**: Pure hardware acceleration + +### **Hardware Acceleration** +- **NPU Phoenix**: Attention computation (16 TOPS) +- **AMD Radeon 780M**: FFN processing (RDNA3) +- **MLIR-AIE2**: Real NPU kernel compilation +- **Vulkan**: Direct iGPU compute shaders + +## 🦄 **About This Implementation** + +This model demonstrates advanced NPU+iGPU AI acceleration techniques, showing how consumer AMD Ryzen AI hardware can run large language models with hardware acceleration. + +**Framework**: [Unicorn Execution Engine](https://unicorncommander.com) +**Date**: July 10, 2025 +**Company**: [Magic Unicorn Unconventional Technology & Stuff Inc](https://magicunicorn.tech) +**Platform**: [Unicorn Commander](https://unicorncommander.com) + +## 📖 **Citation** + +```bibtex +@software{unicorn_execution_engine_gemma_27b_2025, + title={Gemma 3 27B NPU+iGPU Quantized: NPU+iGPU Large Language Model}, + author={Unicorn Commander}, + year={2025}, + url={https://huggingface.co/magicunicorn/gemma-3-27b-npu-quantized}, + note={Production NPU+iGPU quantized large language model} +} +``` + +## 📚 **Related Resources** + +- **Framework**: [Unicorn Execution Engine](https://unicorncommander.com) +- **Company**: [Magic Unicorn Unconventional Technology & Stuff Inc](https://magicunicorn.tech) +- **Platform**: [Unicorn Commander](https://unicorncommander.com) +- **Documentation**: Complete guides in framework repository + +## 🔒 **License** + +This model is released under the Apache 2.0 License, following the original Gemma 3 license terms. + +--- + +*🦄 NPU+iGPU Large Language Model* +*⚡ Powered by Unicorn Execution Engine* +*🏢 Magic Unicorn Unconventional Technology & Stuff Inc* diff --git a/model-00001-of-00012_layer_0.safetensors b/model-00001-of-00012_layer_0.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..bc6bb8ce2d82a9fb7904211fbd8669a4830a2285 --- /dev/null +++ b/model-00001-of-00012_layer_0.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:77d957219582674c4bf62dc5753a5d5622c58510f41ae5c06bf84171ca580171 +size 433721938 diff --git a/model-00001-of-00012_layer_1.safetensors b/model-00001-of-00012_layer_1.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..e860c6123a9738b5a4f2c1d21c1c7d605710b65d --- /dev/null +++ b/model-00001-of-00012_layer_1.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:75c3fdbc091f13ebac4a89693b3dbe2b32fefff9ab6566abd3e892b033b49814 +size 198874770 diff --git a/model-00001-of-00012_layer_10.safetensors b/model-00001-of-00012_layer_10.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a6f170bf8c98dafe7268f2356a8e230905772e7a --- /dev/null +++ b/model-00001-of-00012_layer_10.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cb8221a00a6bac985a15a47725035e35520b51494381e7cfe9d39f6d16f8902e +size 15400102 diff --git a/model-00001-of-00012_layer_11.safetensors b/model-00001-of-00012_layer_11.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..700cdd35b5cd120f8abef3b8d0278bd394de7c08 --- /dev/null +++ b/model-00001-of-00012_layer_11.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cc554f80bfa28f7134b9fbf262d23d42e777839df0a14ca12988ff4042f1ac7e +size 15400102 diff --git a/model-00001-of-00012_layer_12.safetensors b/model-00001-of-00012_layer_12.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c316d5c78f803234d66ae4004a69ec10caa295d9 --- /dev/null +++ b/model-00001-of-00012_layer_12.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:49c9ca7ececa0a52a87014f60a388da5009e79033ff87f8ed16f34ec636cb4df +size 15400102 diff --git a/model-00001-of-00012_layer_13.safetensors b/model-00001-of-00012_layer_13.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..17a24757894724b482b7815e033209a20554fecc --- /dev/null +++ b/model-00001-of-00012_layer_13.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0fc84c6b4da58f3b0e5b362abdcd1072d50e1311e9a06671e3453cd1b3a7f89f +size 15400102 diff --git a/model-00001-of-00012_layer_14.safetensors b/model-00001-of-00012_layer_14.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..6e40b6668e4f8633c9186ebafdfbf656f9426d4b --- /dev/null +++ b/model-00001-of-00012_layer_14.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cd811e1d556d76b4c7416a92442aaa603f5e65627a121e9647a7596267432135 +size 15400102 diff --git a/model-00001-of-00012_layer_15.safetensors b/model-00001-of-00012_layer_15.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..7401c17dec14b9968280f7d425a8948b95fb4782 --- /dev/null +++ b/model-00001-of-00012_layer_15.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9b341e08f5eb94922ceae056d9a1dd8cb661034200d28482d83649de1061961e +size 15400102 diff --git a/model-00001-of-00012_layer_16.safetensors b/model-00001-of-00012_layer_16.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c345a4008df63253dc961833afdf6ad22652b30f --- /dev/null +++ b/model-00001-of-00012_layer_16.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e545118726209ec1f6aa35ef0f2345c7272ceb0d92c2573fbbd5a05143a45d60 +size 15400102 diff --git a/model-00001-of-00012_layer_17.safetensors b/model-00001-of-00012_layer_17.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..b5761cbd475274df737c82bc41ebb6e988b836cf --- /dev/null +++ b/model-00001-of-00012_layer_17.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a5cedf0fea7a6dc5df2940f78895622ebd4daf9ef883ffd3888b06a11a11dcd4 +size 15400102 diff --git a/model-00001-of-00012_layer_18.safetensors b/model-00001-of-00012_layer_18.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..61598f96c06e7f1e0c6a2f98b3d9c64087751e3f --- /dev/null +++ b/model-00001-of-00012_layer_18.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:90c270442c2cf2f9fab5d4e32e7fa129f9405eb862fa425169c7cbe07e52119c +size 15400102 diff --git a/model-00001-of-00012_layer_19.safetensors b/model-00001-of-00012_layer_19.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..1a941addf54fe86dde826484c8ffc5f0196a62ab --- /dev/null +++ b/model-00001-of-00012_layer_19.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b956bc27cfdfb40976110e46e92f7094fc3ba2bb3a45c33ea9bd45c327882e5 +size 15400102 diff --git a/model-00001-of-00012_layer_2.safetensors b/model-00001-of-00012_layer_2.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..09a2781e31a033126ae1b928e7157150f9731f8f --- /dev/null +++ b/model-00001-of-00012_layer_2.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d883e3d5a7a3145e78ad9d85c69963b0c01b0f013a3765abee6b0e6b603e720c +size 15400054 diff --git a/model-00001-of-00012_layer_20.safetensors b/model-00001-of-00012_layer_20.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..f36754ade60e46866cf90165a440e6dd25b31b72 --- /dev/null +++ b/model-00001-of-00012_layer_20.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:efb31503c628e9c46c41fa2c560d8ee105d7df7aa15eab173d51f631959c5a0a +size 15400102 diff --git a/model-00001-of-00012_layer_21.safetensors b/model-00001-of-00012_layer_21.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a1f1072a8f5c80c76781bcb7efee7662c2b85804 --- /dev/null +++ b/model-00001-of-00012_layer_21.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:20db98cded6e69b89734045601cfc07ca4a8a6da2f5d936ed87a59a392901ed8 +size 15400102 diff --git a/model-00001-of-00012_layer_22.safetensors b/model-00001-of-00012_layer_22.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..3cbc2c5496dd77b9078e2494ad787f6b5216429b --- /dev/null +++ b/model-00001-of-00012_layer_22.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:512b03c9011b6bd57a479d177d8f0fb49703bb2cd30d2d41ba83fd0906ec7ce7 +size 15400102 diff --git a/model-00001-of-00012_layer_23.safetensors b/model-00001-of-00012_layer_23.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..5966e67e9041d8e4e3ef86f06eb6f3e0d65caa55 --- /dev/null +++ b/model-00001-of-00012_layer_23.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3900cde90d11958b1b05dddc45c3154058d4d0bd770b93057546f5b984b2420d +size 15400102 diff --git a/model-00001-of-00012_layer_24.safetensors b/model-00001-of-00012_layer_24.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..6be9ea9ff35cd5a2425459b081c631592c26cab0 --- /dev/null +++ b/model-00001-of-00012_layer_24.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fb1571e701ff480674ca0c7dafcc842510655a987c78bd00cb8131af036a03b1 +size 15400102 diff --git a/model-00001-of-00012_layer_25.safetensors b/model-00001-of-00012_layer_25.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..f068b489aa3894b41269672c663f2ce442d9c594 --- /dev/null +++ b/model-00001-of-00012_layer_25.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d3a8de70284fecdb3ab919372e53b2ede26f660b777635899dc513505b7cc2b8 +size 15400102 diff --git a/model-00001-of-00012_layer_26.safetensors b/model-00001-of-00012_layer_26.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..3a701b90440136a5d99207afbd7c56a63f03ce44 --- /dev/null +++ b/model-00001-of-00012_layer_26.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8bb09bb82247e13eb1de4955bf59f4a7f035920200a4b40f543e9dc8613e7be8 +size 15400102 diff --git a/model-00001-of-00012_layer_3.safetensors b/model-00001-of-00012_layer_3.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..27e8d5e7d37210cb7bef26ddea8f8ac5fd504f16 --- /dev/null +++ b/model-00001-of-00012_layer_3.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:16e74b22f02c5fd283572458df983830c8179716386921945d0dc91d14a3d91b +size 15400054 diff --git a/model-00001-of-00012_layer_4.safetensors b/model-00001-of-00012_layer_4.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..f0adf7a5df7a48f0a8d38032dd17a00f1e4877ea --- /dev/null +++ b/model-00001-of-00012_layer_4.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8464e164d2d531f88782c68f9e00d333021e6558fcd4e3ecf587e55531baae91 +size 15400054 diff --git a/model-00001-of-00012_layer_5.safetensors b/model-00001-of-00012_layer_5.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..b6dbd6350b3bc4b2cb36854fa495928127b18c1f --- /dev/null +++ b/model-00001-of-00012_layer_5.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3ab69b9fa7067f8b559fd3cfd30af8f03cd2e6c66ed7433b88c0aa3c5af78c5b +size 15400054 diff --git a/model-00001-of-00012_layer_6.safetensors b/model-00001-of-00012_layer_6.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..dd13e755c0d49942b0cefeae909761694eaf3919 --- /dev/null +++ b/model-00001-of-00012_layer_6.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fa6b1987f3777ade6790cb950e02eb485bd5cc333abe7256680e238b792b5ce8 +size 15400054 diff --git a/model-00001-of-00012_layer_7.safetensors b/model-00001-of-00012_layer_7.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..42b9e5623bf919de586c5c901f0be3651ce8436a --- /dev/null +++ b/model-00001-of-00012_layer_7.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b48dcd583fb5206705800cf4e2d8b82ff6ce5032ef08094f890c2e5eafc74dca +size 15400054 diff --git a/model-00001-of-00012_layer_8.safetensors b/model-00001-of-00012_layer_8.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..d398ac55af19cf01bc8ae8ca92196a0e4c00ce6d --- /dev/null +++ b/model-00001-of-00012_layer_8.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0f01aa5823f2ffeb897a7caf3bb11942e6fb03810d9016eff2f88b8cd7a4b37e +size 15400054 diff --git a/model-00001-of-00012_layer_9.safetensors b/model-00001-of-00012_layer_9.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..b113c3f02f76222effda4d9b4e646996a0b1fae2 --- /dev/null +++ b/model-00001-of-00012_layer_9.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:949ad221271da70a3953e07cb4f8621d11dbf771c36ede3f2e15c5c2280b9c48 +size 15400054 diff --git a/model-00001-of-00012_shared.safetensors b/model-00001-of-00012_shared.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..863e98fbbca4d32c4ca33828d4b0362bb5dc91c2 --- /dev/null +++ b/model-00001-of-00012_shared.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:98139ad1c9309c69bea1f0826ac6416f8cf577ef396f8182b8accebd3c501398 +size 1421226480 diff --git a/model-00002-of-00012_layer_1.safetensors b/model-00002-of-00012_layer_1.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..1666c280e66c8ecacddb55d66d538126937a0893 --- /dev/null +++ b/model-00002-of-00012_layer_1.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a3888d8869dd99137db6c5548a7da71cee987351e6acddfa2a0659df7e617fd6 +size 234847184 diff --git a/model-00002-of-00012_layer_2.safetensors b/model-00002-of-00012_layer_2.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..ceb359ffd301a4f047f47cba1d5479cfda077fe0 --- /dev/null +++ b/model-00002-of-00012_layer_2.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a99adc80868c94734571d377f96f92c7bfb9c9b1b5724fb55fd1648b6453d482 +size 418321836 diff --git a/model-00002-of-00012_layer_3.safetensors b/model-00002-of-00012_layer_3.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..b22f75e045ac9a7b50ed7e876339376486919660 --- /dev/null +++ b/model-00002-of-00012_layer_3.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ddfe4610681a126949d66824671c361e593651c45b5825f58c4714b4961f7b23 +size 418321836 diff --git a/model-00002-of-00012_layer_4.safetensors b/model-00002-of-00012_layer_4.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..e12186027cbe2ee9643ef09b545c214a7222c887 --- /dev/null +++ b/model-00002-of-00012_layer_4.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0199476f546378a9c7b1ff074ab13dac87676d0b8cacae6d2ab9608e47a87e56 +size 418321836 diff --git a/model-00002-of-00012_layer_5.safetensors b/model-00002-of-00012_layer_5.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..d8a15f8b8f05ca6b3324e37fd6a8604ef2d64b9f --- /dev/null +++ b/model-00002-of-00012_layer_5.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8eb837b6a146d7e63226fcf628c5f83fad2d7d52798ae8d96165119236f33011 +size 418321836 diff --git a/model-00002-of-00012_layer_6.safetensors b/model-00002-of-00012_layer_6.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..ea01cae5e120791b5dc25d6dea991d0650511e67 --- /dev/null +++ b/model-00002-of-00012_layer_6.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eae5762b0d6156136068d7fe842f55d64a5095b2a7b06a04871cd5f3a2599021 +size 418321836 diff --git a/model-00002-of-00012_layer_7.safetensors b/model-00002-of-00012_layer_7.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..1c6641bb9796d8cc9c43670bd600b2f82acf28d7 --- /dev/null +++ b/model-00002-of-00012_layer_7.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2d79d8d972bea1f7b242a57772ecfbc238b8b06b0b6164e48b292fdb8851518b +size 183474668 diff --git a/model-00003-of-00012_layer_10.safetensors b/model-00003-of-00012_layer_10.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c9a172df62f9acbbfa8176d496d2c08f2a926eb3 --- /dev/null +++ b/model-00003-of-00012_layer_10.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ad12fb2b11155017d7c1b4689151685414b9db6ddb25329edab08a15e87fb6b +size 418321876 diff --git a/model-00003-of-00012_layer_11.safetensors b/model-00003-of-00012_layer_11.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c55b5810efb59e97fcc095ee24b1c3edc8e2071a --- /dev/null +++ b/model-00003-of-00012_layer_11.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b846bdc051b7b4db79998dafc243eb196eb8615438bf24b212d633d2f77cbfdb +size 418321876 diff --git a/model-00003-of-00012_layer_12.safetensors b/model-00003-of-00012_layer_12.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..17bd7cec4811f14d897b387cdb197ba13b7105ac --- /dev/null +++ b/model-00003-of-00012_layer_12.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7ebd8ce459de3866a77b6ffd7aba4c5f7fc351ec3b826ed1b48e74c1b296f6e9 +size 418321876 diff --git a/model-00003-of-00012_layer_13.safetensors b/model-00003-of-00012_layer_13.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..1fded4b2bdb481e1437a986530532688b5befcb6 --- /dev/null +++ b/model-00003-of-00012_layer_13.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b28a914543c6839327c1ca92bf00c25de162529e786a0f23f03a633f78cfc01d +size 183474692 diff --git a/model-00003-of-00012_layer_7.safetensors b/model-00003-of-00012_layer_7.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..e8715dcef4da749a48cda0ca02ba9b8c13f4548f --- /dev/null +++ b/model-00003-of-00012_layer_7.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dff3d3b865a3e5415204d83eef09fe58184776fdec29e2369179a7168e82a017 +size 234847184 diff --git a/model-00003-of-00012_layer_8.safetensors b/model-00003-of-00012_layer_8.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..5c0d6acce523d202e6aecd901d42d55b08c81c68 --- /dev/null +++ b/model-00003-of-00012_layer_8.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fe66a767decc0687e0d3016817fb57590d85da10d9dfcb159eb8afeeab8abe85 +size 418321836 diff --git a/model-00003-of-00012_layer_9.safetensors b/model-00003-of-00012_layer_9.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..44ea634b62b4ec98b0802e5cd6e8b2ff881c39e2 --- /dev/null +++ b/model-00003-of-00012_layer_9.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bf01bc960c21911ef869ca3a933818444ecb6e2e0f62ae396638962ee672222e +size 418321836 diff --git a/model-00004-of-00012_layer_13.safetensors b/model-00004-of-00012_layer_13.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..e370fed79ec901509f1f5fc3e07f832c73ac6ee0 --- /dev/null +++ b/model-00004-of-00012_layer_13.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:29b522bcd268dc05f478716f0900cb4c1fa3fa91dc63e3a74e2da0ebd16c7745 +size 234847208 diff --git a/model-00004-of-00012_layer_14.safetensors b/model-00004-of-00012_layer_14.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..883fd77693acbb3a3878ce3833afc8961f1b45b3 --- /dev/null +++ b/model-00004-of-00012_layer_14.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e580dbbe3cd6da36365468d855b22d14198c85a1c6b1eaefd01300f601461791 +size 418321876 diff --git a/model-00004-of-00012_layer_15.safetensors b/model-00004-of-00012_layer_15.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..0766d447980ce0fe0650b460917bbf561f76f952 --- /dev/null +++ b/model-00004-of-00012_layer_15.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9e297633d4963dbcceab854023fb7b87dc70f50b46f4f12efdc17dc6337fe794 +size 418321876 diff --git a/model-00004-of-00012_layer_16.safetensors b/model-00004-of-00012_layer_16.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..6b502d47b93cb2bcde61e90c5ae733243fc34b1e --- /dev/null +++ b/model-00004-of-00012_layer_16.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bd2b50442f998625786a10d898f5469e501853db96e133f3a49c5ff7f3ad00f6 +size 418321876 diff --git a/model-00004-of-00012_layer_17.safetensors b/model-00004-of-00012_layer_17.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..d85a73062dbf0738cce0b3ef7bc795a0d64f84b6 --- /dev/null +++ b/model-00004-of-00012_layer_17.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ac773ed2de04abca2b110dbe83853226bf2ee16c2931608d9834724c29f81f08 +size 418321876 diff --git a/model-00004-of-00012_layer_18.safetensors b/model-00004-of-00012_layer_18.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..f3cc9bf64db64a767237cf0f6426da4dc6d1497e --- /dev/null +++ b/model-00004-of-00012_layer_18.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bec716c95672a7c161a7a1627df799c28f95e07f493a4cc051caec122fc84c50 +size 418321876 diff --git a/model-00004-of-00012_layer_19.safetensors b/model-00004-of-00012_layer_19.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..7b5c33237ef026e58aab83f2ec94015268ffee52 --- /dev/null +++ b/model-00004-of-00012_layer_19.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:394cf52204492994a6822a6dc1c19193191b60839dfb9ad8ac4dcb45a39e3237 +size 183474692 diff --git a/model-00005-of-00012_layer_19.safetensors b/model-00005-of-00012_layer_19.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..1f4e26b4b6e01146d2c0e8262ba2d9f307770479 --- /dev/null +++ b/model-00005-of-00012_layer_19.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:053b3dddebffbeede169df0ca81c88f54bbfb2a740876cf14f0da080de56beae +size 234847208 diff --git a/model-00005-of-00012_layer_20.safetensors b/model-00005-of-00012_layer_20.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..9ef9b4b19ce8a5446706711f5e697d327a361d73 --- /dev/null +++ b/model-00005-of-00012_layer_20.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e2fb3e5505960f18a0cf3ada7fed90a0329847f1dd22b12e64b7dddeef849ccb +size 418321876 diff --git a/model-00005-of-00012_layer_21.safetensors b/model-00005-of-00012_layer_21.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..90b975597938b2263df5b5421ea593b6bd74a7e1 --- /dev/null +++ b/model-00005-of-00012_layer_21.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6e9fe2b8fb14003094367c34bf792a28a911a406cbd0ddf6f20e7ea723b8942a +size 418321876 diff --git a/model-00005-of-00012_layer_22.safetensors b/model-00005-of-00012_layer_22.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..93ffc1fefedb463fd7a15ac1435c66bce742a423 --- /dev/null +++ b/model-00005-of-00012_layer_22.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e4e47198aafd6c71d9760f8e3501a925cfc37dd9704f0457033154ac8fe41ce2 +size 418321876 diff --git a/model-00005-of-00012_layer_23.safetensors b/model-00005-of-00012_layer_23.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..682b9f006f4869b1482e749205643231b27a76ad --- /dev/null +++ b/model-00005-of-00012_layer_23.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d8b449cb62578051cc423f309baf45840e70140fc81d3df967f4f84621a0a13b +size 418321876 diff --git a/model-00005-of-00012_layer_24.safetensors b/model-00005-of-00012_layer_24.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..039fac1c884bc326223425be68d2120dd4bebefd --- /dev/null +++ b/model-00005-of-00012_layer_24.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a20c19691223ea368bc192b0e72b4c9b2e4913d942345dd8812715afe559e221 +size 418321876 diff --git a/model-00005-of-00012_layer_25.safetensors b/model-00005-of-00012_layer_25.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..23acdbe93dcdff880f2e3ac0ef1cce01fc897588 --- /dev/null +++ b/model-00005-of-00012_layer_25.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:99a9329a6289661e8141fa21f06e9e5b44906d8773a2066ec5d9acde3cd29ce4 +size 183474692 diff --git a/model-00006-of-00012_layer_25.safetensors b/model-00006-of-00012_layer_25.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..6a26ea97514edcc7c7164d40790eb9627a0d8930 --- /dev/null +++ b/model-00006-of-00012_layer_25.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fb6fac95feac5f8e8dd639ff0d83801c8befeb1a81a1461b867ba65669313afa +size 234847208 diff --git a/model-00006-of-00012_layer_26.safetensors b/model-00006-of-00012_layer_26.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..e313f9b1fa724c9a9178b313eacbfe9f3596335d --- /dev/null +++ b/model-00006-of-00012_layer_26.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d22cd595e7837b3ee8ccb259fd116793174ed0202f976d3d6508eeec6d9bedb0 +size 418321876 diff --git a/model-00006-of-00012_layer_27.safetensors b/model-00006-of-00012_layer_27.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..64ff28d96c90cd62d58831c74d5f942a5fb089bc --- /dev/null +++ b/model-00006-of-00012_layer_27.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d3e07ae74dbba81cb8030f1bf83ff4a7ab1ca820e0b4bab42312dccc8c75425c +size 418321876 diff --git a/model-00006-of-00012_layer_28.safetensors b/model-00006-of-00012_layer_28.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a459f7074692e57da8c0495ef2e6b22fcc16ebb6 --- /dev/null +++ b/model-00006-of-00012_layer_28.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:32e95410919f39fa7800657bad54f84fc172d4fcd508366d5d4e59d27175ea15 +size 418321876 diff --git a/model-00006-of-00012_layer_29.safetensors b/model-00006-of-00012_layer_29.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..cd186a2e97a16ffecc5e70cbd0c3bb2146d06711 --- /dev/null +++ b/model-00006-of-00012_layer_29.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3a0590954caa2e344a831ac4886066c6042edc604b027780e998f05ef5409fc4 +size 418321876 diff --git a/model-00006-of-00012_layer_30.safetensors b/model-00006-of-00012_layer_30.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..bb55a1f9301269d91811de319d635f0d7e89874f --- /dev/null +++ b/model-00006-of-00012_layer_30.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8aabf78b57fc91253e2ee527e92d71ad746e57d935e5143270768b1af5feea23 +size 418321876 diff --git a/model-00006-of-00012_layer_31.safetensors b/model-00006-of-00012_layer_31.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..bc94de72097f1d66ba2182a735008b4927b936c2 --- /dev/null +++ b/model-00006-of-00012_layer_31.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c622824345801744a643e359a9a4a21aa612dac9bba60aa4d3877e5cee5e8556 +size 183474692 diff --git a/model-00007-of-00012_layer_31.safetensors b/model-00007-of-00012_layer_31.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..f0abd1527b29d629aea9082e303c586415ce80cd --- /dev/null +++ b/model-00007-of-00012_layer_31.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4fa5e76fd1de7345b54e102dd3cf74696444b0fac2fe59f8d4519dbec5b21a8a +size 234847208 diff --git a/model-00007-of-00012_layer_32.safetensors b/model-00007-of-00012_layer_32.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..8086c8e1c4b6b2ac58cc0ddd2a95e154ab0df2e3 --- /dev/null +++ b/model-00007-of-00012_layer_32.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cb8f9cceab3aa27321521aa09cc5ebd78df3b1a8a3e99c5f9fb9e1394a5e7f0d +size 418321876 diff --git a/model-00007-of-00012_layer_33.safetensors b/model-00007-of-00012_layer_33.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..ba26033c2ab956254b5393ad75eb771570f16986 --- /dev/null +++ b/model-00007-of-00012_layer_33.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7d1f818df4a48b53fdfa1c1334e7d8a96a77f5d835d2de36a267e06b13f6a00b +size 418321876 diff --git a/model-00007-of-00012_layer_34.safetensors b/model-00007-of-00012_layer_34.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..29519068af51a594552d779f89e20c718f615da5 --- /dev/null +++ b/model-00007-of-00012_layer_34.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7947e11d787683e7a826866bca20fcd9805950dd266243edd5337ca9f534711b +size 418321876 diff --git a/model-00007-of-00012_layer_35.safetensors b/model-00007-of-00012_layer_35.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..d62eace056e8ec4a6ea746c7a734dedcfb4c4813 --- /dev/null +++ b/model-00007-of-00012_layer_35.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ada6ee1eb66a41539e12c0ddb96be931dbf66380643be90f6e7e317b0b45272d +size 418321876 diff --git a/model-00007-of-00012_layer_36.safetensors b/model-00007-of-00012_layer_36.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..026c347d8f63ee91cf664eaccb9fd02124a09b34 --- /dev/null +++ b/model-00007-of-00012_layer_36.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:10be7b531275e97c72bc9c4e5d801b567d5664332fe4b748b8d53ab6636efac6 +size 418321876 diff --git a/model-00007-of-00012_layer_37.safetensors b/model-00007-of-00012_layer_37.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..ba0d5a2ab59cc60b6616258f5d56cbe2315ad9d3 --- /dev/null +++ b/model-00007-of-00012_layer_37.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b7612e438d682acfcd447d8d44fb31d7ecf1535747791a8b653e127bf71caadf +size 183474692 diff --git a/model-00008-of-00012_layer_37.safetensors b/model-00008-of-00012_layer_37.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..b27e594d92a0261c75fd00afa9106f0a291d6017 --- /dev/null +++ b/model-00008-of-00012_layer_37.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9c0a87f6b513e788cb6ddef55d32adefe9f24040eb9d548f80aacf616ebd58c4 +size 234847208 diff --git a/model-00008-of-00012_layer_38.safetensors b/model-00008-of-00012_layer_38.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..4c109df87e70fbb25c587d5e0469bc8900cc9fa1 --- /dev/null +++ b/model-00008-of-00012_layer_38.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8e909e7a08018d18fd3ccc9f530ca01c4c60290b2281197e9fa0622ad6e72c40 +size 418321876 diff --git a/model-00008-of-00012_layer_39.safetensors b/model-00008-of-00012_layer_39.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..5be00e2813997b5acdb5a6f652b9c3eb5b2e59b2 --- /dev/null +++ b/model-00008-of-00012_layer_39.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8ae60e6c6e745007bb78be3297ecf7a005500d48b468a8861787e1761f46f167 +size 418321876 diff --git a/model-00008-of-00012_layer_40.safetensors b/model-00008-of-00012_layer_40.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..1e34b9220606f61ec8ac9921f57f059d08d01822 --- /dev/null +++ b/model-00008-of-00012_layer_40.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:af6fcef07683bdc38859457bea1109baf518e96502412c0400160f07012ef15b +size 418321876 diff --git a/model-00008-of-00012_layer_41.safetensors b/model-00008-of-00012_layer_41.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..e3bf4fda2948317736f59de9b19e80abe1d92735 --- /dev/null +++ b/model-00008-of-00012_layer_41.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f8d113dbe49ff0051ed08cc77472fbd543b2750f33d81be98bdf16b0c255dfea +size 418321876 diff --git a/model-00008-of-00012_layer_42.safetensors b/model-00008-of-00012_layer_42.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..807f6d8412488c1bb3ad1fe178cd986ef6c81f08 --- /dev/null +++ b/model-00008-of-00012_layer_42.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e65faf89307bdb8e002c79a8f0d7bb3420b05a6fad130d044077cfbd5c0647a0 +size 418321876 diff --git a/model-00008-of-00012_layer_43.safetensors b/model-00008-of-00012_layer_43.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..ee4d5651f4e6c13e542b68ab1f9ae6260d01a836 --- /dev/null +++ b/model-00008-of-00012_layer_43.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1246eaed21aaed7cecb2f062ab5ccf9a0f29ad6f59b01431ea2e8b2ad2fc8eeb +size 183474692 diff --git a/model-00009-of-00012_layer_43.safetensors b/model-00009-of-00012_layer_43.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..dd33f571be93fd757672a3075acd7a0d0dcb6861 --- /dev/null +++ b/model-00009-of-00012_layer_43.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa3c9a93ec37fc857d7212f0889fc923db0b5931cf93df57b097ee4b6d1fff98 +size 234847208 diff --git a/model-00009-of-00012_layer_44.safetensors b/model-00009-of-00012_layer_44.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..10c43dafd71a4ff92aff3580a8a7e6a5f3efab4e --- /dev/null +++ b/model-00009-of-00012_layer_44.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa763d58acfc076f22e7441839b1e88c76b8f4fee4b400aca5dd3518967856d7 +size 418321876 diff --git a/model-00009-of-00012_layer_45.safetensors b/model-00009-of-00012_layer_45.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..3eec430bdb338d251c34adb1a0fce28b7334a239 --- /dev/null +++ b/model-00009-of-00012_layer_45.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cad62a3a4692709e0c2153b23fe5ca9e5be588d3353a6b70872f7575076e2b32 +size 418321876 diff --git a/model-00009-of-00012_layer_46.safetensors b/model-00009-of-00012_layer_46.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..f958d3d87f55c07c28af226a6e9d5d3ff2678467 --- /dev/null +++ b/model-00009-of-00012_layer_46.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ccae379d154fb43cb48889cefba9eb4ece57c2b9a93caa7a780becfb901f8f8b +size 418321876 diff --git a/model-00009-of-00012_layer_47.safetensors b/model-00009-of-00012_layer_47.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..2a7c737f6355cecdbbede0b15bd2a1e947b8c7f9 --- /dev/null +++ b/model-00009-of-00012_layer_47.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8f22e36d8229249dbd336d5a8a94241d29a32d8d37af9fdfb336da0bc68fe8a6 +size 418321876 diff --git a/model-00009-of-00012_layer_48.safetensors b/model-00009-of-00012_layer_48.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..748263806c969818b52bcb2c845b01e952c66e8d --- /dev/null +++ b/model-00009-of-00012_layer_48.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3ea19edbac2faffc30dcf775c2424d24fa4c999c6717fe11a7dda0efe1b2e73c +size 418321876 diff --git a/model-00009-of-00012_layer_49.safetensors b/model-00009-of-00012_layer_49.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..797fa666d0c67e9861b6660766cd6fcd7802d6a1 --- /dev/null +++ b/model-00009-of-00012_layer_49.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:146f28a7a9e97b4e5a86deb9882d99afb73d5ca0abf6ebc31c2d087ef17e26ea +size 183474692 diff --git a/model-00010-of-00012_layer_49.safetensors b/model-00010-of-00012_layer_49.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..108452e3c5af1f170e0e18daf99c4515f6284489 --- /dev/null +++ b/model-00010-of-00012_layer_49.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9706174c17161723cf4af708cf27507aaaa5af4425eb09742e16883784e2ebf0 +size 234847208 diff --git a/model-00010-of-00012_layer_50.safetensors b/model-00010-of-00012_layer_50.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..dcb4aadc4ddf23b9898aec44283d686a572b103c --- /dev/null +++ b/model-00010-of-00012_layer_50.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:beabf9910db7e004ae1afb12336b2a57101e5290d98a9d8ead0bc24c5840fa99 +size 418321876 diff --git a/model-00010-of-00012_layer_51.safetensors b/model-00010-of-00012_layer_51.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..e4850e2ecd64e32ffd84868babc88056ce3a451e --- /dev/null +++ b/model-00010-of-00012_layer_51.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:22a65d2e60dcea0cab2edc736428ef414fed72d7167f5a4618df6a356de60c8a +size 418321876 diff --git a/model-00010-of-00012_layer_52.safetensors b/model-00010-of-00012_layer_52.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..5168de0cc5dad75a8e3696f41d2ac1e8dc3f19d3 --- /dev/null +++ b/model-00010-of-00012_layer_52.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f6b7950d3d64b572b25f2efd63d4948057176025ae22a967b34ec58fb0ecfe6e +size 418321876 diff --git a/model-00010-of-00012_layer_53.safetensors b/model-00010-of-00012_layer_53.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..d39f8f158d8dd7c1451bae1e0c4371ce78e6b9f2 --- /dev/null +++ b/model-00010-of-00012_layer_53.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:edae42a5a1ba5910348b4483e5b2c7e739b0fe3560804620246dce3bf6515634 +size 418321876 diff --git a/model-00010-of-00012_layer_54.safetensors b/model-00010-of-00012_layer_54.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..06efcb0356325ed3c2904cb7828702df1e53e12a --- /dev/null +++ b/model-00010-of-00012_layer_54.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:173c7514f9011aeeaf0d356181fadc7a35280d781b7b1ed3301db211cb81ff53 +size 418321876 diff --git a/model-00010-of-00012_layer_55.safetensors b/model-00010-of-00012_layer_55.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..36ee9212ef8ac7180fccbaa391a352b95f8aede0 --- /dev/null +++ b/model-00010-of-00012_layer_55.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4ff81a88d454b3036fe1b96bad939507c82ec77459c8d519abbe3d8c0544d5fc +size 183474692 diff --git a/model-00011-of-00012_layer_55.safetensors b/model-00011-of-00012_layer_55.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..637ae3ba7b299ca92cb33180eaf42c8ab80d6ed2 --- /dev/null +++ b/model-00011-of-00012_layer_55.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c8a39528d46830c070a4f4bc0849e87588a1c4c25f27245061662cf4e2005425 +size 234847208 diff --git a/model-00011-of-00012_layer_56.safetensors b/model-00011-of-00012_layer_56.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..8da17731d81efc6983de4f68801731cef3d9801a --- /dev/null +++ b/model-00011-of-00012_layer_56.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ac196ec2f811ce5ac9132d491cacbfca9460eff6f5dba9026ff5919e7a74d2ee +size 418321876 diff --git a/model-00011-of-00012_layer_57.safetensors b/model-00011-of-00012_layer_57.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..35ce64661a28c70d652f902544a34059bd06b73c --- /dev/null +++ b/model-00011-of-00012_layer_57.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d03a0b98c4e255c6dea26b0fc3512005271941874aa918108db8b82293a620c1 +size 418321876 diff --git a/model-00011-of-00012_layer_58.safetensors b/model-00011-of-00012_layer_58.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..734b5453fd5dcdcd100f10ae8ba99e43b63db6f6 --- /dev/null +++ b/model-00011-of-00012_layer_58.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d65b47b9dda0ed43fda109d1aa8af8e6d528cf60569b507276159f1f2d83fc5c +size 418321876 diff --git a/model-00011-of-00012_layer_59.safetensors b/model-00011-of-00012_layer_59.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..57dc3f896a92225f4e60e629cbb67c315b46ba04 --- /dev/null +++ b/model-00011-of-00012_layer_59.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:25eabd65ad23d5e151b829ab36a017778791cb042aaa55a6af947657209cd4fc +size 418321876 diff --git a/model-00011-of-00012_layer_60.safetensors b/model-00011-of-00012_layer_60.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..431a2e1a90451094409d4156f0dce6259c30a9c8 --- /dev/null +++ b/model-00011-of-00012_layer_60.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b3c2d215558bc6a604598647ff194e2cb3ed848ca854971abcddf21aded3bf50 +size 418321876 diff --git a/model-00011-of-00012_layer_61.safetensors b/model-00011-of-00012_layer_61.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..e948f4241f62d95d3c1bd030ee7f78ca4b988212 --- /dev/null +++ b/model-00011-of-00012_layer_61.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ea40a14e5ca3c42ea5ad4ac9266210d769b3f4ecb31b57ef18ca55421375aac2 +size 183474692 diff --git a/model-00012-of-00012_layer_61.safetensors b/model-00012-of-00012_layer_61.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..6a72f97bfc19014ba8a0704f846830788c488af5 --- /dev/null +++ b/model-00012-of-00012_layer_61.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1666c57271e103ec646ab7b7caecc85b0917677b56c2a1d074f8748998c2c53d +size 234847208 diff --git a/model-00012-of-00012_shared.safetensors b/model-00012-of-00012_shared.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..32d1e80ea122cb969c4d9ba83533f1059fea36f6 --- /dev/null +++ b/model-00012-of-00012_shared.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1033514ac349c47d97983c597ab8d2a982763e1c1a835c2fb2be2440ef57cf5d +size 5648 diff --git a/quantization_results.json b/quantization_results.json new file mode 100644 index 0000000000000000000000000000000000000000..45df7f519eab7451072384f39fb73e7b0b96f5db --- /dev/null +++ b/quantization_results.json @@ -0,0 +1,14 @@ +{ + "model": "gemma-3-27b-it", + "quantization_method": "layer_by_layer_16_cores", + "quantization_time_minutes": 62.06072829167048, + "cpu_cores_used": 16, + "original_size_gb": 102.1936783194542, + "quantized_size_gb": 15.410733871161938, + "memory_reduction": 0.8492007125627823, + "peak_memory_usage_mb": 7657.48828125, + "fits_in_16gb_igpu": true, + "layers_processed": 100, + "tensors_processed": 1247, + "files_processed": 12 +} \ No newline at end of file