Update README.md

README.md

@@ -136,15 +136,16 @@ The NT-Java-1.1B model has been trained on publicly available datasets and is of
 
 ## Model
 
-- **Architecture:** GPT-2 model with Multi-Query Attention and Fill-in-the-Middle objective
-- **Pretraining steps:** 50k
-- **Pretraining tokens:** 22 Billion
+- **Architecture:** GPT-2 model with Multi-Query Attention and Fill-in-the-Middle objective.
+- **Pretraining steps:** 100k
+- **Context length:** 8K tokens
+- **Pretraining tokens:** 22 billion
 - **Precision:** bfloat16
 
 ## Hardware
 
 - **GPUs:** 6 NVIDIA A100 80GB 
-- **Training time:**  4 days
+- **Training time:**  10 days
 
 ## Software