Add new SentenceTransformer model

README.md

@@ -12,54 +12,51 @@ tags:
 - retrieval
 - reranking
 - generated_from_trainer
-- dataset_size:400
+- dataset_size:3119809
 - loss:CustomBCELoss
 base_model: Alibaba-NLP/gte-modernbert-base
 widget:
-- source_sentence: The aversive or evitative case ( abbreviated ) is a grammatical
-    case that is found in Australian Aboriginal languages and indicates that the marked
-    noun is avoided or feared .
+- source_sentence: Hayley Vaughan portrayed Ripa on the ABC daytime soap opera , ``
+    All My Children `` , between 1990 and 2002 .
   sentences:
-  - The aversive or evitative case ( abbreviated ) is a grammatical case that is found
-    in Australian Aboriginal languages and indicates that the marked noun is avoided
-    or feared .
-  - He was born in Ryno , Johannesburg , died in North West .
-  - The aversive or evitative case ( abbreviated ) is a marked case found in Australian
-    Aboriginal languages that indicates that the grammatical noun is avoided or feared
-    .
-- source_sentence: Three ships of the Royal Australian Navy ( RAN ) were named after
-    Perth , the capital city of Western Australia , as HMAS `` Perth `` .
+  - Traxxpad is a music application for Sony 's PlayStation Portable published by
+    Definitive Studios and developed by Eidos Interactive .
+  - Between 1990 and 2002 , Hayley Vaughan Ripa portrayed in the ABC soap opera ``
+    All My Children `` .
+  - Between 1990 and 2002 , Ripa Hayley portrayed Vaughan in the ABC soap opera ``
+    All My Children `` .
+- source_sentence: Olivella monilifera is a species of dwarf sea snail , small gastropod
+    mollusk in the family Olivellidae , the marine olives .
   sentences:
-  - Three ships of the Royal Australian Navy ( RAN ) have been named HMAS `` Western
-    Australia `` after Perth , the capital city of Perth .
-  - Three ships of the Royal Australian Navy ( RAN ) were named after Perth , the
-    capital city of Western Australia , as HMAS `` Perth `` .
-  - He lost the title to Rees after Iestyn Rees purchased his title shot at PWE Jingle
-    All The Galloway .
-- source_sentence: Oxynoe azuropunctata is a kind of small sea snail or sea snail
-    , a bubble snail , a marine gastropod mollusk in the Oxynoidae family .
+  - Olivella monilifera is a species of the dwarf - sea snail , small gastropod mollusk
+    in the Olivellidae family , the marine olives .
+  - He was cut by the Browns after being signed by the Bills in 2013 . He was later
+    released .
+  - Olivella monilifera is a kind of sea snail , marine gastropod mollusk in the Olivellidae
+    family , the dwarf olives .
+- source_sentence: Hayashi said that Mackey `` is a sort of `` of the original model
+    for Tenchi .
   sentences:
-  - It is located at Ellison Bay , in the town of Liberty Grove , Wisconsin .
-  - Oxynoe azuropunctata is a kind of small sea snail or sea snail , a bubble snail
-    , a marine gastropod mollusk in the Oxynoidae family .
-  - Oxynoe azuropunctata is a species of marine sea snail or sea slug , a bubble snail
-    , a small gastropod mollusk in the family Oxynoidae .
-- source_sentence: It included the original six tracks , re-worked with new vocals
-    and live drums , three remixes , and new two tracks .
+  - In the summer of 2009 , Ellick shot a documentary about Malala Yousafzai .
+  - Hayashi said that Mackey is `` sort of `` the original model for Tenchi .
+  - Mackey said that Hayashi is `` sort of `` the original model for Tenchi .
+- source_sentence: Much of the film was shot on location in Los Angeles and in nearby
+    Burbank and Glendale .
   sentences:
-  - It included the original six tracks , overhauled with new vocals and live drums
-    , three remixes and two new tracks .
-  - Punish Lichfield , garrison Birmingham , and clear the country as far as possible
-    .
-  - Antoninus , or known as Antoninus , was a Roman who lived in the 1st century .
-- source_sentence: It is known from Australia , including South Australia , Tasmania
-    , Queensland , New South Wales and Victoria .
+  - Much of the film was shot on location in Los Angeles and in nearby Burbank and
+    Glendale .
+  - Much of the film was shot on site in Burbank and Glendale and in the nearby Los
+    Angeles .
+  - Traxxpad is a music application for the Sony PlayStation Portable developed by
+    the Definitive Studios and published by Eidos Interactive .
+- source_sentence: According to him , the earth is the carrier of his artistic work
+    , which is only integrated into the creative process by minimal changes .
   sentences:
-  - It is famous from Australia , including South Australia , Tasmania , Queensland
-    , New South Wales and Victoria .
-  - In 1995 Franz married Joanie Zeck , whom he met in 1982 .
-  - In 1792 , the family moved to Kingston in Toronto and then York ( later renamed
-    Upper Canada ) .
+  - National players are Bold players .
+  - According to him , earth is the carrier of his artistic work being integrated
+    into the creative process only by minimal changes .
+  - According to him , earth is the carrier of his creative work being integrated
+    into the artistic process only by minimal changes .
 datasets:
 - redis/langcache-sentencepairs-v2
 pipeline_tag: sentence-similarity
@@ -151,9 +148,9 @@ from sentence_transformers import SentenceTransformer
 model = SentenceTransformer("redis/langcache-embed-v3")
 # Run inference
 sentences = [
-    'It is known from Australia , including South Australia , Tasmania , Queensland , New South Wales and Victoria .',
-    'It is famous from Australia , including South Australia , Tasmania , Queensland , New South Wales and Victoria .',
-    'In 1792 , the family moved to Kingston in Toronto and then York ( later renamed Upper Canada ) .',
+    'According to him , the earth is the carrier of his artistic work , which is only integrated into the creative process by minimal changes .',
+    'According to him , earth is the carrier of his artistic work being integrated into the creative process only by minimal changes .',
+    'According to him , earth is the carrier of his creative work being integrated into the artistic process only by minimal changes .',
 ]
 embeddings = model.encode(sentences)
 print(embeddings.shape)
@@ -162,9 +159,9 @@ print(embeddings.shape)
 # Get the similarity scores for the embeddings
 similarities = model.similarity(embeddings, embeddings)
 print(similarities)
-# tensor([[1.0078, 0.9531, 0.5898],
-#         [0.9531, 0.9961, 0.5898],
-#         [0.5898, 0.5898, 0.9922]], dtype=torch.bfloat16)
+# tensor([[1.0000, 0.9961, 0.9922],
+#         [0.9961, 1.0000, 0.9961],
+#         [0.9922, 0.9961, 0.9961]], dtype=torch.bfloat16)
 ```
 
 <!--
@@ -228,19 +225,19 @@ You can finetune this model on your own dataset.
 #### LangCache Sentence Pairs (all)
 
 * Dataset: [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2)
-* Size: 199 training samples
+* Size: 126,938 training samples
 * Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
-* Approximate statistics based on the first 199 samples:
+* Approximate statistics based on the first 1000 samples:
   |         | anchor                                                                            | positive                                                                          | negative                                                                          |
   |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
   | type    | string                                                                            | string                                                                            | string                                                                            |
-  | details | <ul><li>min: 9 tokens</li><li>mean: 26.47 tokens</li><li>max: 42 tokens</li></ul> | <ul><li>min: 9 tokens</li><li>mean: 26.47 tokens</li><li>max: 42 tokens</li></ul> | <ul><li>min: 9 tokens</li><li>mean: 25.93 tokens</li><li>max: 42 tokens</li></ul> |
+  | details | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 48 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 26.54 tokens</li><li>max: 61 tokens</li></ul> |
 * Samples:
-  | anchor                                                                                                                                      | positive                                                                                                                                    | negative                                                                                                                                          |
-  |:--------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------|
-  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>He was at the Westminster School under Richard Busby and studied at Christ Church , Oxford with Henry Aldrich .</code>                      |
-  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>Richard Cheyne was the son and heir of Robert Cralle of Shurland and Margery , daughter and coheiress of Cheyne of Cralle , Sussex .</code> |
-  | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code>     |
+  | anchor                                                                                                                                      | positive                                                                                                                                      | negative                                                                                                                                      |
+  |:--------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>how can I get financial freedom as soon as possible?</code>                                                                             |
+  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                          | <code>The older Punts are still very much in existence today and race in the same fleets as the newer boats .</code>                          |
+  | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , , was located at Turner Valley Bar N Ranch Airport , southwest of Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code> |
 * Loss: <code>losses.CustomBCELoss</code>
 
 ### Evaluation Dataset
@@ -248,19 +245,19 @@ You can finetune this model on your own dataset.
 #### LangCache Sentence Pairs (all)
 
 * Dataset: [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2)
-* Size: 199 evaluation samples
+* Size: 126,938 evaluation samples
 * Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
-* Approximate statistics based on the first 199 samples:
+* Approximate statistics based on the first 1000 samples:
   |         | anchor                                                                            | positive                                                                          | negative                                                                          |
   |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
   | type    | string                                                                            | string                                                                            | string                                                                            |
-  | details | <ul><li>min: 9 tokens</li><li>mean: 26.47 tokens</li><li>max: 42 tokens</li></ul> | <ul><li>min: 9 tokens</li><li>mean: 26.47 tokens</li><li>max: 42 tokens</li></ul> | <ul><li>min: 9 tokens</li><li>mean: 25.93 tokens</li><li>max: 42 tokens</li></ul> |
+  | details | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 48 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 26.54 tokens</li><li>max: 61 tokens</li></ul> |
 * Samples:
-  | anchor                                                                                                                                      | positive                                                                                                                                    | negative                                                                                                                                          |
-  |:--------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------|
-  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>He was at the Westminster School under Richard Busby and studied at Christ Church , Oxford with Henry Aldrich .</code>                      |
-  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>Richard Cheyne was the son and heir of Robert Cralle of Shurland and Margery , daughter and coheiress of Cheyne of Cralle , Sussex .</code> |
-  | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code>     |
+  | anchor                                                                                                                                      | positive                                                                                                                                      | negative                                                                                                                                      |
+  |:--------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>how can I get financial freedom as soon as possible?</code>                                                                             |
+  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                          | <code>The older Punts are still very much in existence today and race in the same fleets as the newer boats .</code>                          |
+  | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , , was located at Turner Valley Bar N Ranch Airport , southwest of Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code> |
 * Loss: <code>losses.CustomBCELoss</code>
 
 ### Training Logs