Create README.md

README.md

@@ -0,0 +1,66 @@
+---
+license: apache-2.0
+datasets:
+- JetBrains/KExercises
+base_model: JetBrains/deepseek-coder-1.3B-kexer
+results:
+- task:
+    type: text-generation
+  dataset:
+    name: MultiPL-HumanEval (Kotlin)
+    type: openai_humaneval
+  metrics:
+  - name: pass@1
+    type: pass@1
+    value: 36.65
+tags:
+- code
+---
+
+# Deepseek-Coder-1.3B-kexer-GGUF
+This is quantized version of [JetBrains/deepseek-coder-1.3B-kexer](https://huggingface.co/JetBrains/deepseek-coder-1.3B-kexer) created using llama.cpp
+
+# Kexer models
+
+Kexer models are a collection of open-source generative text models fine-tuned on the [Kotlin Exercices](https://huggingface.co/datasets/JetBrains/KExercises) dataset. 
+This is a repository for the fine-tuned **Deepseek-coder-1.3b** model in the *Hugging Face Transformers* format. 
+
+# How to use
+
+As with the base model, we can use FIM. To do this, the following format must be used: 
+```
+'<｜fim▁begin｜>' + prefix + '<｜fim▁hole｜>' + suffix + '<｜fim▁end｜>'
+```
+
+# Training setup
+
+The model was trained on one A100 GPU with following hyperparameters:
+
+|         **Hyperparameter**           |             **Value**              |
+|:---------------------------:|:----------------------------------------:|
+|           `warmup`            |           10%            |
+|        `max_lr`        |          1e-4          |
+|        `scheduler`        |          linear          |
+|        `total_batch_size`        |          256 (~130K tokens per step)          |
+|        `num_epochs`        |          4          |
+
+More details about fine-tuning can be found in the technical report (coming soon!).
+
+# Fine-tuning data
+
+For tuning this model, we used 15K exmaples from the synthetically generated [Kotlin Exercices](https://huggingface.co/datasets/JetBrains/KExercises) dataset. Every example follows the HumanEval format. In total, the dataset contains about 3.5M tokens. 
+
+# Evaluation 
+
+For evaluation, we used the [Kotlin HumanEval](https://huggingface.co/datasets/JetBrains/Kotlin_HumanEval) dataset, which contains all 161 tasks from HumanEval translated into Kotlin by human experts. You can find more details about the pre-processing necessary to obtain our results, including the code for running, on the [datasets's page](https://huggingface.co/datasets/JetBrains/Kotlin_HumanEval).
+
+Here are the results of our evaluation:
+
+|         **Model name**           |             **Kotlin HumanEval Pass Rate**              |
+|:---------------------------:|:----------------------------------------:|
+|           `Deepseek-coder-1.3B`            |           26.71            |
+|        `Deepseek-coder-1.3B-Kexer`        |          **36.65**         |
+
+# Ethical considerations and limitations
+
+Deepseek-coder-1.3B-Kexer is a new technology that carries risks with use. The testing conducted to date has not covered, nor could it cover all scenarios. For these reasons, as with all LLMs, Deepseek-coder-1.3B-Kexer's potential outputs cannot be predicted in advance, and the model may in some instances produce inaccurate or objectionable responses to user prompts. The model was fine-tuned on a specific data format (Kotlin tasks), and deviation from this format can also lead to inaccurate or undesirable responses to user queries. Therefore, before deploying any applications of Deepseek-coder-1.3B-Kexer, developers should perform safety testing and tuning tailored to their specific applications of the model.