If u dont mind slower token gen &amp; some perplexity loss, then u can run 32b even on x64 cpus in one's computer/laptop if one has 16GB (for upto 22B models) and 32GB for upto 60B models

Look at using suitable adaptive quantized version of models in this case 

#Ai
#Ai