Update README.md

README.md

@@ -22,4 +22,14 @@ widget:
 3. [Limitations](##limitations)
 4. [Training](##training)
 5. [License](##license)
-6. [Citation](##citation)
+6. [Citation](##citation)
+
+## Model Summary
+
+The JavaCoder models are !B parameter models trained on 80+ programming languages from [The Stack (v1.2)](https://huggingface.co/datasets/bigcode/the-stack), with opt-out requests excluded. The model uses [Multi Query Attention](https://arxiv.org/abs/1911.02150), [a context window of 8192 tokens](https://arxiv.org/abs/2205.14135),  and was trained using the [Fill-in-the-Middle objective](https://arxiv.org/abs/2207.14255) on 1 trillion tokens. 
+
+- **Repository:** 
+- **Project Website:** 
+- **Paper:** 
+- **Point of Contact:** 
+- **Languages:** 80+ Programming languages