Add new SentenceTransformer model

README.md

@@ -12,54 +12,50 @@ tags:
 - retrieval
 - reranking
 - generated_from_trainer
-- dataset_size:2200421
-- loss:CoSENTLoss
+- dataset_size:3587
+- loss:ArcTripletLoss
 base_model: Alibaba-NLP/gte-modernbert-base
 widget:
-- source_sentence: They are sometimes called Marg or also Path in Hindi .
+- source_sentence: Hunter College was originally Lehman College 's uptown campus .
   sentences:
-  - Largs was born in Brisbane House in Noddsdale , near Brisbane in Ayrshire , Scotland
-    , the son of Sir Thomas Brisbane and Dame Eleanora Brisbane .
-  - Its smallest radius is 1.4 ( 131 thousand light years ) and largest 0.7 angle
-    minutes ( 65 thousand light years ) .
-  - They are also called Marg or sometimes the path in the Hindi .
-- source_sentence: The main mode of play in `` Crash Bash `` is the Adventure Mode
-    , in which one or two players must win all 28 levels to complete .
+  - Acquired programming includes the Irish soap `` Fair City `` and Finnish drama
+    `` Black Widows `` .
+  - According to the United States Census Bureau , the town has a total area of ;
+    of the area is land and 0.66 % is water .
+  - Hunter College originally was Lehman College Uptown Campus .
+- source_sentence: He hoped to defeat them and then marry Ravonna .
   sentences:
-  - Parkton is a city in Robeson County , North Carolina , in the Lumberton Metro
-    area , in the United States .
-  - The CANTAB tests were developed by Professor Barbara Sahakian and Professor Trevor
-    Robbins .
-  - The main mode in `` Crash Bash `` is the adventure mode in which one or two players
-    must complete all 28 levels to win .
-- source_sentence: It was formed in December 2014 from elements of the disbanded 51st
-    Mechanized Brigade and newly mobilized units .
+  - Stillwater Creek received its official name in 1884 when William L. Couch established
+    his `` boomer colony `` on its banks .
+  - Note that the invertible of a matrix is always an exponential matrix .
+  - He hoped to defeat them and marry Ravonna .
+- source_sentence: Born on February 2 , 1984 , Abrar Khan is a professional Pakistani
+    international Kabaddi player .
   sentences:
-  - It had branches in feature films , television , physical and digital publishing
-    , merchandise , recorded music , digital and online media applications and mobile
-    and social games .
-  - Notts County and Arsenal were relegated to the Second Division ; Preston North
-    End and Burnley were promoted to the First Division .
-  - It was formed in December 2014 from elements of the dissolved 51st Mechanized
-    Brigade and newly mobilized units .
-- source_sentence: The band pursued `` signals `` in January 2012 in three weeks ,
-    and drums were recorded in a day and a half .
+  - Born on February 2 , 1984 , Abrar Khan is a professional Pakistani international
+    Kabaddi player .
+  - Together , the paired mylohyoid muscles form a muscular floor for the oral cavity
+    of the mouth .
+  - Abrar Khan born 2 February 1984 is a Pakistani professional international Kabaddi
+    player .
+- source_sentence: Certainly , `` Lucy was nothing like flat `` in physical form ,
+    social condition , and personality .
   sentences:
-  - Kearsarge Lakes , Kearsarge Pass Trail , and Rae Lakes all have a maximum 2 nights
-    stay , and Bullfrog Lake along the Charlotte Lake is closed to camping .
-  - The band tracked `` Signals `` in three weeks in January 2012 . Drums were recorded
-    in a day and a half .
-  - From 1954 to 1961 , he was married to Stella Caralis and from 1978 until his death
-    with Nina Bohlen .
-- source_sentence: A special case is of the Country B loyalist who controls agents
-    or provides managerial supporting or other functions against Country A .
+  - The real number is called the `` imaginary part `` of the real number ; the real
+    number is called the `` complex part `` of .
+  - From the Celebes lake , the captain Bullock observed the appearance of the corona
+    , while Gustav Fritsch accompanied an expedition to Aden .
+  - Certainly `` Lucy was , in physical form , social condition and personality ,
+    nothing like Shallow `` .
+- source_sentence: The trio has performed besides Gesaffelstein , Justice , Bob Moses
+    and Lee Foss .
   sentences:
-  - A special case is the loyalist of Country B , who controls agents or provides
-    management support or other functions against Country A .
-  - Music Story is a music service website and international music data provider that
-    curates , aggregates and analyses metadata for digital music services .
-  - These six cars were painted in the same lacquering as the buffet cars , silver
-    with red lines and text .
+  - The trio has performed besides Gesaffelstein , Justice , Bob Moses and Lee Foss
+    .
+  - The suttas generally contain educational content , while other early Buddhist
+    texts deal with monastic discipline or vinaya .
+  - The trio has performed alongside Bob Moses , Justice , Gesaffelstein and Lee Foss
+    .
 datasets:
 - redis/langcache-sentencepairs-v2
 pipeline_tag: sentence-similarity
@@ -151,9 +147,9 @@ from sentence_transformers import SentenceTransformer
 model = SentenceTransformer("redis/langcache-embed-v3")
 # Run inference
 sentences = [
-    'A special case is of the Country B loyalist who controls agents or provides managerial supporting or other functions against Country A .',
-    'A special case is the loyalist of Country B , who controls agents or provides management support or other functions against Country A .',
-    'Music Story is a music service website and international music data provider that curates , aggregates and analyses metadata for digital music services .',
+    'The trio has performed besides Gesaffelstein , Justice , Bob Moses and Lee Foss .',
+    'The trio has performed besides Gesaffelstein , Justice , Bob Moses and Lee Foss .',
+    'The trio has performed alongside Bob Moses , Justice , Gesaffelstein and Lee Foss .',
 ]
 embeddings = model.encode(sentences)
 print(embeddings.shape)
@@ -162,9 +158,9 @@ print(embeddings.shape)
 # Get the similarity scores for the embeddings
 similarities = model.similarity(embeddings, embeddings)
 print(similarities)
-# tensor([[1.0000, 0.9844, 0.5195],
-#         [0.9844, 0.9922, 0.5078],
-#         [0.5195, 0.5078, 0.9922]], dtype=torch.bfloat16)
+# tensor([[0.9961, 0.9961, 0.9844],
+#         [0.9961, 0.9961, 0.9844],
+#         [0.9844, 0.9844, 0.9961]], dtype=torch.bfloat16)
 ```
 
 <!--
@@ -228,52 +224,40 @@ You can finetune this model on your own dataset.
 #### LangCache Sentence Pairs (all)
 
 * Dataset: [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2)
-* Size: 72,021 training samples
-* Columns: <code>sentence_a</code>, <code>sentence_b</code>, and <code>label</code>
+* Size: 1,922 training samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
 * Approximate statistics based on the first 1000 samples:
-  |         | sentence_a                                                                        | sentence_b                                                                        | label                                           |
-  |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:------------------------------------------------|
-  | type    | string                                                                            | string                                                                            | int                                             |
-  | details | <ul><li>min: 8 tokens</li><li>mean: 27.46 tokens</li><li>max: 53 tokens</li></ul> | <ul><li>min: 9 tokens</li><li>mean: 27.36 tokens</li><li>max: 52 tokens</li></ul> | <ul><li>0: ~50.30%</li><li>1: ~49.70%</li></ul> |
+  |         | anchor                                                                            | positive                                                                          | negative                                                                          |
+  |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
+  | type    | string                                                                            | string                                                                            | string                                                                            |
+  | details | <ul><li>min: 8 tokens</li><li>mean: 27.26 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 27.24 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 9 tokens</li><li>mean: 27.09 tokens</li><li>max: 49 tokens</li></ul> |
 * Samples:
-  | sentence_a                                                                                                                                  | sentence_b                                                                                                                                    | label          |
-  |:--------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|:---------------|
-  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>1</code> |
-  | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code> | <code>0</code> |
-  | <code>After losing his second election , he resigned as opposition leader and was replaced by Geoff Pearsall .</code>                       | <code>Max Bingham resigned as opposition leader after losing his second election , and was replaced by Geoff Pearsall .</code>                | <code>1</code> |
-* Loss: [<code>CoSENTLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cosentloss) with these parameters:
-  ```json
-  {
-      "scale": 20.0,
-      "similarity_fct": "pairwise_cos_sim"
-  }
-  ```
+  | anchor                                                                                                                                      | positive                                                                                                                                    | negative                                                                                                                                                   |
+  |:--------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>At that time , on June 22 , 1754 , Edward Bentham married Bentham Elizabeth Bates ( d . 1790 ) from Hampshire in the nearby county of Alton .</code> |
+  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>In 2012 , Cornell 5th and Lehigh 8th , Cornell was also 4th in 2013 and 7th in 2014 .</code>                                                         |
+  | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code>              |
+* Loss: <code>losses.ArcTripletLoss</code>
 
 ### Evaluation Dataset
 
 #### LangCache Sentence Pairs (all)
 
 * Dataset: [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2)
-* Size: 72,021 evaluation samples
-* Columns: <code>sentence_a</code>, <code>sentence_b</code>, and <code>label</code>
+* Size: 1,922 evaluation samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
 * Approximate statistics based on the first 1000 samples:
-  |         | sentence_a                                                                        | sentence_b                                                                        | label                                           |
-  |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:------------------------------------------------|
-  | type    | string                                                                            | string                                                                            | int                                             |
-  | details | <ul><li>min: 8 tokens</li><li>mean: 27.46 tokens</li><li>max: 53 tokens</li></ul> | <ul><li>min: 9 tokens</li><li>mean: 27.36 tokens</li><li>max: 52 tokens</li></ul> | <ul><li>0: ~50.30%</li><li>1: ~49.70%</li></ul> |
+  |         | anchor                                                                            | positive                                                                          | negative                                                                          |
+  |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
+  | type    | string                                                                            | string                                                                            | string                                                                            |
+  | details | <ul><li>min: 8 tokens</li><li>mean: 27.26 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 27.24 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 9 tokens</li><li>mean: 27.09 tokens</li><li>max: 49 tokens</li></ul> |
 * Samples:
-  | sentence_a                                                                                                                                  | sentence_b                                                                                                                                    | label          |
-  |:--------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|:---------------|
-  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>1</code> |
-  | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code> | <code>0</code> |
-  | <code>After losing his second election , he resigned as opposition leader and was replaced by Geoff Pearsall .</code>                       | <code>Max Bingham resigned as opposition leader after losing his second election , and was replaced by Geoff Pearsall .</code>                | <code>1</code> |
-* Loss: [<code>CoSENTLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cosentloss) with these parameters:
-  ```json
-  {
-      "scale": 20.0,
-      "similarity_fct": "pairwise_cos_sim"
-  }
-  ```
+  | anchor                                                                                                                                      | positive                                                                                                                                    | negative                                                                                                                                                   |
+  |:--------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>At that time , on June 22 , 1754 , Edward Bentham married Bentham Elizabeth Bates ( d . 1790 ) from Hampshire in the nearby county of Alton .</code> |
+  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>In 2012 , Cornell 5th and Lehigh 8th , Cornell was also 4th in 2013 and 7th in 2014 .</code>                                                         |
+  | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code>              |
+* Loss: <code>losses.ArcTripletLoss</code>
 
 ### Training Logs
 | Epoch | Step | test_cosine_ndcg@10 |
@@ -307,17 +291,6 @@ You can finetune this model on your own dataset.
 }
 ```
 
-#### CoSENTLoss
-```bibtex
-@online{kexuefm-8847,
-    title={CoSENT: A more efficient sentence vector scheme than Sentence-BERT},
-    author={Su Jianlin},
-    year={2022},
-    month={Jan},
-    url={https://kexue.fm/archives/8847},
-}
-```
-
 <!--
 ## Glossary
 

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2e01abd77d4c0c664940beac5b2b312b66055c81265195500fecb712466ddfc9
+oid sha256:95d02211c4cca89113f9f3e93ed91f5176bf50170faa2cb835f7bfea15bb9dd2
 size 298041696