Add new SentenceTransformer model

1_Pooling/config.json

@@ -1,7 +1,7 @@
 {
     "word_embedding_dimension": 768,
-    "pooling_mode_cls_token": true,
-    "pooling_mode_mean_tokens": false,
+    "pooling_mode_cls_token": false,
+    "pooling_mode_mean_tokens": true,
     "pooling_mode_max_tokens": false,
     "pooling_mode_mean_sqrt_len_tokens": false,
     "pooling_mode_weightedmean_tokens": false,

README.md

@@ -14,7 +14,7 @@ tags:
 - generated_from_trainer
 - dataset_size:1451941
 - loss:MultipleNegativesRankingLoss
-base_model: Alibaba-NLP/gte-modernbert-base
+base_model: answerdotai/ModernBERT-base
 widget:
 - source_sentence: Gocharya ji authored Krishna Cahrit Manas in the poetic form describing
     about the full life of Lord Krishna ( from birth to Nirvana ) .
@@ -76,34 +76,34 @@ model-index:
       type: train
     metrics:
     - type: cosine_accuracy@1
-      value: 0.5578696687594717
+      value: 0.37778739987010174
       name: Cosine Accuracy@1
     - type: cosine_precision@1
-      value: 0.5578696687594717
+      value: 0.37778739987010174
       name: Cosine Precision@1
     - type: cosine_recall@1
-      value: 0.53589188426978
+      value: 0.36103963757730806
       name: Cosine Recall@1
     - type: cosine_ndcg@10
-      value: 0.7523955452910316
+      value: 0.5622280163193171
       name: Cosine Ndcg@10
     - type: cosine_mrr@1
-      value: 0.5578696687594717
+      value: 0.37778739987010174
       name: Cosine Mrr@1
     - type: cosine_map@100
-      value: 0.6976030263836698
+      value: 0.5081953861443469
       name: Cosine Map@100
 ---
 
 # Redis fine-tuned BiEncoder model for semantic caching on LangCache
 
-This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [Alibaba-NLP/gte-modernbert-base](https://huggingface.co/Alibaba-NLP/gte-modernbert-base) on the [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v1) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for sentence pair similarity.
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on the [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v1) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for sentence pair similarity.
 
 ## Model Details
 
 ### Model Description
 - **Model Type:** Sentence Transformer
-- **Base model:** [Alibaba-NLP/gte-modernbert-base](https://huggingface.co/Alibaba-NLP/gte-modernbert-base) <!-- at revision e7f32e3c00f91d699e8c43b53106206bcc72bb22 -->
+- **Base model:** [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) <!-- at revision 8949b909ec900327062f0ebf497f51aef5e6f0c8 -->
 - **Maximum Sequence Length:** 100 tokens
 - **Output Dimensionality:** 768 dimensions
 - **Similarity Function:** Cosine Similarity
@@ -123,7 +123,7 @@ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [A
 ```
 SentenceTransformer(
   (0): Transformer({'max_seq_length': 100, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
-  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
 )
 ```
 
@@ -156,9 +156,9 @@ print(embeddings.shape)
 # Get the similarity scores for the embeddings
 similarities = model.similarity(embeddings, embeddings)
 print(similarities)
-# tensor([[0.9961, 0.9922, 0.9961],
-#         [0.9922, 1.0000, 0.9922],
-#         [0.9961, 0.9922, 1.0078]], dtype=torch.bfloat16)
+# tensor([[0.9961, 0.9922, 0.9922],
+#         [0.9922, 1.0000, 0.9961],
+#         [0.9922, 0.9961, 1.0000]], dtype=torch.bfloat16)
 ```
 
 <!--
@@ -196,12 +196,12 @@ You can finetune this model on your own dataset.
 
 | Metric             | Value      |
 |:-------------------|:-----------|
-| cosine_accuracy@1  | 0.5579     |
-| cosine_precision@1 | 0.5579     |
-| cosine_recall@1    | 0.5359     |
-| **cosine_ndcg@10** | **0.7524** |
-| cosine_mrr@1       | 0.5579     |
-| cosine_map@100     | 0.6976     |
+| cosine_accuracy@1  | 0.3778     |
+| cosine_precision@1 | 0.3778     |
+| cosine_recall@1    | 0.361      |
+| **cosine_ndcg@10** | **0.5622** |
+| cosine_mrr@1       | 0.3778     |
+| cosine_map@100     | 0.5082     |
 
 <!--
 ## Bias, Risks and Limitations
@@ -274,7 +274,7 @@ You can finetune this model on your own dataset.
 ### Training Logs
 | Epoch | Step | train_cosine_ndcg@10 |
 |:-----:|:----:|:--------------------:|
-| -1    | -1   | 0.7524               |
+| -1    | -1   | 0.5622               |
 
 
 ### Framework Versions

config_sentence_transformers.json

@@ -1,4 +1,5 @@
 {
+  "model_type": "SentenceTransformer",
   "__version__": {
     "sentence_transformers": "5.1.0",
     "transformers": "4.56.0",
@@ -9,6 +10,5 @@
     "document": ""
   },
   "default_prompt_name": null,
-  "similarity_fn_name": "cosine",
-  "model_type": "SentenceTransformer"
+  "similarity_fn_name": "cosine"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b3afa42cdb95ced7c718fe75726bfca0e1498534ec7971397384ec7c0d5546ed
+oid sha256:49130ca9bb82456b8d7d77dc9819d74b11864b9d854ef1eff2ed157e37bc1afe
 size 298041696

tokenizer_config.json

@@ -938,7 +938,7 @@
     "input_ids",
     "attention_mask"
   ],
-  "model_max_length": 1000000000000000019884624838656,
+  "model_max_length": 8192,
   "pad_token": "[PAD]",
   "sep_token": "[SEP]",
   "tokenizer_class": "PreTrainedTokenizerFast",