Update BM25S model

README.md

@@ -11,7 +11,7 @@ tags:
 
 # BM25S Index
 
-This is a BM25S index created with the [`bm25s` library](https://github.com/xhluca/bm25s) (version `0.2.6`), an ultra-fast implementation of BM25. It can be used for lexical retrieval tasks.
+This is a BM25S index created with the [`bm25s` library](https://github.com/xhluca/bm25s) (version `0.2.7post1`), an ultra-fast implementation of BM25. It can be used for lexical retrieval tasks.
 
 BM25S Related Links:
 
@@ -26,10 +26,10 @@ BM25S Related Links:
 You can install the `bm25s` library with `pip`:
 
 ```bash
-pip install "bm25s==0.2.6"
+pip install "bm25s==0.2.7post1"
 
 # Include extra dependencies like stemmer
-pip install "bm25s[full]==0.2.6"
+pip install "bm25s[full]==0.2.7post1"
 
 # For huggingface hub usage
 pip install huggingface_hub
@@ -123,9 +123,9 @@ This dataset was created using the following data:
 
 | Statistic | Value |
 | --- | --- |
-| Number of documents | 831507 |
-| Number of tokens | 8338070 |
-| Average tokens per document | 10.03 |
+| Number of documents | 750312 |
+| Number of tokens | 7592215 |
+| Average tokens per document | 10.12 |
 
 ## Parameters
 

corpus.jsonl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:16164bf429cfc58ca04d9782582ab594274462760bc2eb0cc776e07d095cc5d5
-size 85381127
+oid sha256:2b999015937322493801414a7628aea03373b140623efa2d7e247af03e4eb2b2
+size 73690346

data.csc.index.npy

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9c698db1df7ff3cb81bc33c0e162561368ebbc3dd40cf3bc4e1ea747d1234407
-size 33352408
+oid sha256:e30a1c11c7cc998cca6c57896b569da0e32ca94e6c59b92d14648706c2d670aa
+size 30368988

indices.csc.index.npy

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f1c9a4c9f1c7423f165ff28fbff534b9cb486281f7aa29246899c9eda84521dc
-size 33352408
+oid sha256:5b2f427f0d29bab6a4744d4d14cad7f6205617efb8f2381fa0e82664698e1f92
+size 30368988

indptr.csc.index.npy

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:03d05dfbd9c6cf91f4b4d3f7047f44c573bd55fadee26ee6a4fbefc25b920fe8
-size 1408676
+oid sha256:e01faf6b39cfa30b9e13fb00c062117e7487e6a6e8b4539522a37f6b30591a52
+size 559348

params.index.json

@@ -6,7 +6,7 @@
     "idf_method": "lucene",
     "dtype": "float32",
     "int_dtype": "int32",
-    "num_docs": 831507,
-    "version": "0.2.6",
+    "num_docs": 750312,
+    "version": "0.2.7post1",
     "backend": "numpy"
 }

vocab.index.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:736514f073d877676ddb3bb40b61362d0d9974b4e0826c84ed13ccd47e59b414
-size 6301373
+oid sha256:d224cd8071210250b768abb4e03969c446bef1a2d382ad711325ad63c54af4c9
+size 2283889