Update BM25S model

README.md

@@ -11,7 +11,7 @@ tags:
 
 # BM25S Index
 
-This is a BM25S index created with the [`bm25s` library](https://github.com/xhluca/bm25s) (version `0.2.3`), an ultra-fast implementation of BM25. It can be used for lexical retrieval tasks.
+This is a BM25S index created with the [`bm25s` library](https://github.com/xhluca/bm25s) (version `0.2.6`), an ultra-fast implementation of BM25. It can be used for lexical retrieval tasks.
 
 BM25S Related Links:
 
@@ -26,10 +26,10 @@ BM25S Related Links:
 You can install the `bm25s` library with `pip`:
 
 ```bash
-pip install "bm25s==0.2.3"
+pip install "bm25s==0.2.6"
 
 # Include extra dependencies like stemmer
-pip install "bm25s[full]==0.2.3"
+pip install "bm25s[full]==0.2.6"
 
 # For huggingface hub usage
 pip install huggingface_hub
@@ -123,9 +123,9 @@ This dataset was created using the following data:
 
 | Statistic | Value |
 | --- | --- |
-| Number of documents | 791616 |
-| Number of tokens | 8818694 |
-| Average tokens per document | 11.14 |
+| Number of documents | 210801 |
+| Number of tokens | 1247449 |
+| Average tokens per document | 5.92 |
 
 ## Parameters
 

corpus.jsonl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:26b3f17468ce27a2a2624bd67aceaaaf9d1363f10cd8482f0aa1e71b414a4e83
-size 87071998
+oid sha256:34a38e542a64bfd8e7e4f75c31ec7f9cae03b26196701e40904bc580cd971150
+size 14491479

data.csc.index.npy

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f124c4c4d9beb8eedc20bf8ea6f452c2ce8472aeab724a46970182e3ffbea3d9
-size 35274904
+oid sha256:99d46b75c6d39fd6b858be4b194d6385f77073896e33955d707086366a09801c
+size 4989924

indices.csc.index.npy

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9e7e82d8f583b6dc5948c9c9faf2898bd9467db795477481ec1e2bc1bc4d1499
-size 35274904
+oid sha256:6d615201000cc91e6961a8b2a102d79cffbfa87610645fbfe414753bcc592d6e
+size 4989924

indptr.csc.index.npy

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:80cd1256b07bb59e9b8c2e5dbb706fff27da0daf336b77e4af3c6c4b38a8d6b6
-size 2249916
+oid sha256:ee295a3f6f37a7988013298b018103c98aef8d5861590e4d87391285d40d266c
+size 248616

params.index.json

@@ -6,7 +6,7 @@
     "idf_method": "lucene",
     "dtype": "float32",
     "int_dtype": "int32",
-    "num_docs": 791616,
-    "version": "0.2.3",
+    "num_docs": 210801,
+    "version": "0.2.6",
     "backend": "numpy"
 }

vocab.index.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:baa46f4faa9fbd28089112f6903af07248635544d37bf4240ecdcd39b2bf684b
-size 11550214
+oid sha256:03d5613c6c043f095d746de405aab145523713820d2756469e919e871e02f5e4
+size 995887