Set HF token when initializing BM25 retriever and tokenizer 888df00 verified singletongue commited on Feb 14
Support NAYOSE for span entities using BM25 of entity name sub-tokens 6234321 verified singletongue commited on Feb 14
Fix a bug where input text is not unicode-normalized 17276eb verified singletongue commited on Feb 13
Use ja-v0.3 model, introduce entity span sensitivity aaaa32a verified singletongue commited on Feb 13
Use ja-v0.2 model, ignore categories of some patterns c5df237 verified singletongue commited on Jan 20
