Add new SentenceTransformer model

1_Pooling/config.json

@@ -1,7 +1,7 @@
 {
     "word_embedding_dimension": 768,
-    "pooling_mode_cls_token": true,
-    "pooling_mode_mean_tokens": false,
+    "pooling_mode_cls_token": false,
+    "pooling_mode_mean_tokens": true,
     "pooling_mode_max_tokens": false,
     "pooling_mode_mean_sqrt_len_tokens": false,
     "pooling_mode_weightedmean_tokens": false,

README.md

@@ -12,9 +12,9 @@ tags:
 - retrieval
 - reranking
 - generated_from_trainer
-- dataset_size:3119809
-- loss:ArcTripletLoss
-base_model: Alibaba-NLP/gte-modernbert-base
+- dataset_size:9233417
+- loss:ArcFaceInBatchLoss
+base_model: answerdotai/ModernBERT-base
 widget:
 - source_sentence: Hayley Vaughan portrayed Ripa on the ABC daytime soap opera , ``
     All My Children `` , between 1990 and 2002 .
@@ -79,34 +79,34 @@ model-index:
       type: test
     metrics:
     - type: cosine_accuracy@1
-      value: 0.5861241448475948
+      value: 0.4126938643934238
       name: Cosine Accuracy@1
     - type: cosine_precision@1
-      value: 0.5861241448475948
+      value: 0.4126938643934238
       name: Cosine Precision@1
     - type: cosine_recall@1
-      value: 0.5679885764966713
+      value: 0.39900881466078997
       name: Cosine Recall@1
     - type: cosine_ndcg@10
-      value: 0.7729838064849864
+      value: 0.5950456720106155
       name: Cosine Ndcg@10
     - type: cosine_mrr@1
-      value: 0.5861241448475948
+      value: 0.4126938643934238
       name: Cosine Mrr@1
     - type: cosine_map@100
-      value: 0.7216697804426214
+      value: 0.543168962594735
       name: Cosine Map@100
 ---
 
 # Redis fine-tuned BiEncoder model for semantic caching on LangCache
 
-This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [Alibaba-NLP/gte-modernbert-base](https://huggingface.co/Alibaba-NLP/gte-modernbert-base) on the [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for sentence pair similarity.
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on the [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for sentence pair similarity.
 
 ## Model Details
 
 ### Model Description
 - **Model Type:** Sentence Transformer
-- **Base model:** [Alibaba-NLP/gte-modernbert-base](https://huggingface.co/Alibaba-NLP/gte-modernbert-base) <!-- at revision e7f32e3c00f91d699e8c43b53106206bcc72bb22 -->
+- **Base model:** [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) <!-- at revision 8949b909ec900327062f0ebf497f51aef5e6f0c8 -->
 - **Maximum Sequence Length:** 100 tokens
 - **Output Dimensionality:** 768 dimensions
 - **Similarity Function:** Cosine Similarity
@@ -126,7 +126,7 @@ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [A
 ```
 SentenceTransformer(
   (0): Transformer({'max_seq_length': 100, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
-  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
 )
 ```
 
@@ -159,9 +159,9 @@ print(embeddings.shape)
 # Get the similarity scores for the embeddings
 similarities = model.similarity(embeddings, embeddings)
 print(similarities)
-# tensor([[1.0000, 0.9961, 0.9922],
-#         [0.9961, 1.0000, 0.9961],
-#         [0.9922, 0.9961, 0.9961]], dtype=torch.bfloat16)
+# tensor([[0.9961, 0.9922, 0.9922],
+#         [0.9922, 1.0000, 1.0000],
+#         [0.9922, 1.0000, 1.0000]], dtype=torch.bfloat16)
 ```
 
 <!--
@@ -199,12 +199,12 @@ You can finetune this model on your own dataset.
 
 | Metric             | Value     |
 |:-------------------|:----------|
-| cosine_accuracy@1  | 0.5861    |
-| cosine_precision@1 | 0.5861    |
-| cosine_recall@1    | 0.568     |
-| **cosine_ndcg@10** | **0.773** |
-| cosine_mrr@1       | 0.5861    |
-| cosine_map@100     | 0.7217    |
+| cosine_accuracy@1  | 0.4127    |
+| cosine_precision@1 | 0.4127    |
+| cosine_recall@1    | 0.399     |
+| **cosine_ndcg@10** | **0.595** |
+| cosine_mrr@1       | 0.4127    |
+| cosine_map@100     | 0.5432    |
 
 <!--
 ## Bias, Risks and Limitations
@@ -238,7 +238,14 @@ You can finetune this model on your own dataset.
   | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>how can I get financial freedom as soon as possible?</code>                                                                             |
   | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                          | <code>The older Punts are still very much in existence today and race in the same fleets as the newer boats .</code>                          |
   | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , , was located at Turner Valley Bar N Ranch Airport , southwest of Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code> |
-* Loss: <code>losses.ArcTripletLoss</code>
+* Loss: <code>losses.ArcFaceInBatchLoss</code> with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim",
+      "gather_across_devices": false
+  }
+  ```
 
 ### Evaluation Dataset
 
@@ -258,12 +265,19 @@ You can finetune this model on your own dataset.
   | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>how can I get financial freedom as soon as possible?</code>                                                                             |
   | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                          | <code>The older Punts are still very much in existence today and race in the same fleets as the newer boats .</code>                          |
   | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , , was located at Turner Valley Bar N Ranch Airport , southwest of Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code> |
-* Loss: <code>losses.ArcTripletLoss</code>
+* Loss: <code>losses.ArcFaceInBatchLoss</code> with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim",
+      "gather_across_devices": false
+  }
+  ```
 
 ### Training Logs
 | Epoch | Step | test_cosine_ndcg@10 |
 |:-----:|:----:|:-------------------:|
-| -1    | -1   | 0.7730              |
+| -1    | -1   | 0.5950              |
 
 
 ### Framework Versions

config_sentence_transformers.json

@@ -1,4 +1,5 @@
 {
+  "model_type": "SentenceTransformer",
   "__version__": {
     "sentence_transformers": "5.1.0",
     "transformers": "4.56.0",
@@ -9,6 +10,5 @@
     "document": ""
   },
   "default_prompt_name": null,
-  "similarity_fn_name": "cosine",
-  "model_type": "SentenceTransformer"
+  "similarity_fn_name": "cosine"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:70526a089aa4ae10bbca991b49a06b81c24ee97c21af11978c64ebf764b60aaf
+oid sha256:49130ca9bb82456b8d7d77dc9819d74b11864b9d854ef1eff2ed157e37bc1afe
 size 298041696

tokenizer_config.json

@@ -938,7 +938,7 @@
     "input_ids",
     "attention_mask"
   ],
-  "model_max_length": 1000000000000000019884624838656,
+  "model_max_length": 8192,
   "pad_token": "[PAD]",
   "sep_token": "[SEP]",
   "tokenizer_class": "PreTrainedTokenizerFast",