# Tokenizer used for all BLOOM models

Tokenizer information are provided at [https://huggingface.co/bigscience/bloom#preprocessing](https://huggingface.co/bigscience/bloom#preprocessing)

TODO: point to paper once it comes out with extra details on the tokenizer
{"license": "bigscience-bloom-rail-1.0"}
license:bigscience-bloom-rail-1.0 has_space region:us
TAGS
#license-bigscience-bloom-rail-1.0 #has_space #region-us 

# Tokenizer used for all BLOOM models

Tokenizer information are provided at URL

TODO: point to paper once it comes out with extra details on the tokenizer
# Tokenizer used for all BLOOM models

Tokenizer information are provided at URL

TODO: point to paper once it comes out with extra details on the tokenizer
TAGS
#license-bigscience-bloom-rail-1.0 #has_space #region-us 
 # Tokenizer used for all BLOOM models

Tokenizer information are provided at URL

TODO: point to paper once it comes out with extra details on the tokenizer
passage: TAGS
#license-bigscience-bloom-rail-1.0 #has_space #region-us 
# Tokenizer used for all BLOOM models

Tokenizer information are provided at URL

TODO: point to paper once it comes out with extra details on the tokenizer