Commits · Luigi/ZeroGPU-LLM-Inference

bugfix to Error: "str" object has no attribute "pad_token_id"

889f080

Luigi commited on Apr 30

add taiwan elm 1.1b & 270m instruct

c8399e3

Luigi commited on Apr 30

add type in qwen3 0.6b repo id

76d4d60

Luigi commited on Apr 29

add qwen3

fe395ab

Luigi commited on Apr 29

Add Smollm2 360m instruct fine-tuned on TaiwanChat

7308211

Luigi commited on Apr 28

keep debug message

37f7787

Luigi commited on Apr 22

add debug to show web resarch result

a2f07a4

Luigi commited on Apr 22

give 1 second for web search to grab data

9ad3ffd

Luigi commited on Apr 22

inject web search result if web search enabled

bc257ff

Luigi commited on Apr 22

refactor(app): improve streaming, background search, dtype fallback, and cleanup :contentReference[oaicite:0]{index=0}

293686e

Luigi commited on Apr 22

bugfixc: not using pipeline for response generation

939895d

Luigi commited on Apr 22

Add original SmolLM2 135M Instruct for comparaison

423dc1a

Luigi commited on Apr 22

Add SmolLM2-135M-Instruct-TaiwanChat

38fcc03

Luigi commited on Apr 22

Add SmolLM2-135M TaiwanChat

0d642b7

Luigi commited on Apr 22

Update README.md

34cf84a
verified

Luigi commited on Apr 22

default to gemma-3-4b

88a6a62

Luigi commited on Apr 12

model repo_id typo fix

89372fa

Luigi commited on Apr 12

enable web search by default

6235e63

Luigi commited on Apr 12

remove tinyllama which has bad response quality

a22cf42

Luigi commited on Apr 12

make streaming response

5ea073d

Luigi commited on Apr 12

apply history flatten before it goint to prompt

ef361b0

Luigi commited on Apr 12

better management on system prompt

5f6306a

Luigi commited on Apr 12

add accelerate

5ed3cb3

Luigi commited on Apr 12

usue chat pipeline instead of model and tokenizer individually

ac8e9cc

Luigi commited on Apr 12

bugfix to padding-related issues

f248fec

Luigi commited on Apr 12

add attention mask

b6b3940

Luigi commited on Apr 12

Clean model description

4731160

Luigi commited on Apr 12

pin torch to 2.4.0

4c6b4c5

Luigi commited on Apr 12

add sentencepiece tokenzier

4afc958

Luigi commited on Apr 12

update requirements

51e3e3c

Luigi commited on Apr 12

enable zerogpu with decorator

c5b2897

Luigi commited on Apr 12

Apply ZeroGPU

d181b45

Luigi commited on Apr 12

add apt.txt

5dd835a

Luigi commited on Apr 12

adjust requirements

e85692d

Luigi commited on Apr 12

adjust requirements.txt

931fd49

Luigi commited on Apr 12

specify gpu build for llama cpp python

49a4dad

Luigi commited on Apr 12

Update README.md

d6f7cc4
verified

Luigi commited on Apr 12

fix readme

c62b652

Luigi commited on Apr 12

switch to gradio version for stability reason

a703203

Luigi commited on Apr 12

add taiwan tinyllama

794ee70

Luigi commited on Apr 11

Improve responsiveness by asynchronously retrieving web search context

acda3f1

Luigi commited on Apr 11

update requirements

12731c2

Luigi commited on Apr 11

specify wheel of llama cpp python

f200cb7

Luigi commited on Apr 11

openblas build of llam acpp filed

66a3cb6

Luigi commited on Apr 11

specify to build llama cpp with openblas

e883a1b

Luigi commited on Apr 11

add llama 3.2 taiwan 3b

b1544e2

Luigi commited on Apr 11

add minicpm3 4b

f5c0811

Luigi commited on Apr 11

increase xt length to max

629495e

Luigi commited on Apr 11

remove all moe

fafc8cb

Luigi commited on Apr 11

remove qwen 1.5 moe

6735035

Luigi commited on Apr 11

Commit History

bugfix to Error: "str" object has no attribute "pad_token_id" 889f080

add taiwan elm 1.1b & 270m instruct c8399e3

add type in qwen3 0.6b repo id 76d4d60

add qwen3 fe395ab

Add Smollm2 360m instruct fine-tuned on TaiwanChat 7308211

keep debug message 37f7787

add debug to show web resarch result a2f07a4

give 1 second for web search to grab data 9ad3ffd

inject web search result if web search enabled bc257ff

refactor(app): improve streaming, background search, dtype fallback, and cleanup :contentReference[oaicite:0]{index=0} 293686e

bugfixc: not using pipeline for response generation 939895d

Add original SmolLM2 135M Instruct for comparaison 423dc1a

Add SmolLM2-135M-Instruct-TaiwanChat 38fcc03

Add SmolLM2-135M TaiwanChat 0d642b7

Update README.md 34cf84a verified

default to gemma-3-4b 88a6a62

model repo_id typo fix 89372fa

enable web search by default 6235e63

remove tinyllama which has bad response quality a22cf42

make streaming response 5ea073d

apply history flatten before it goint to prompt ef361b0

better management on system prompt 5f6306a

add accelerate 5ed3cb3

usue chat pipeline instead of model and tokenizer individually ac8e9cc

bugfix to padding-related issues f248fec

add attention mask b6b3940

Clean model description 4731160

pin torch to 2.4.0 4c6b4c5

add sentencepiece tokenzier 4afc958

update requirements 51e3e3c

enable zerogpu with decorator c5b2897

Apply ZeroGPU d181b45

add apt.txt 5dd835a

adjust requirements e85692d

adjust requirements.txt 931fd49

specify gpu build for llama cpp python 49a4dad

Update README.md d6f7cc4 verified

fix readme c62b652

switch to gradio version for stability reason a703203

add taiwan tinyllama 794ee70

Improve responsiveness by asynchronously retrieving web search context acda3f1

update requirements 12731c2

specify wheel of llama cpp python f200cb7

openblas build of llam acpp filed 66a3cb6

specify to build llama cpp with openblas e883a1b

add llama 3.2 taiwan 3b b1544e2

add minicpm3 4b f5c0811

increase xt length to max 629495e

remove all moe fafc8cb

remove qwen 1.5 moe 6735035

bugfix to Error: "str" object has no attribute "pad_token_id"

889f080

add taiwan elm 1.1b & 270m instruct

c8399e3

add type in qwen3 0.6b repo id

76d4d60

add qwen3

fe395ab

Add Smollm2 360m instruct fine-tuned on TaiwanChat

7308211

keep debug message

37f7787

add debug to show web resarch result

a2f07a4

give 1 second for web search to grab data

9ad3ffd

inject web search result if web search enabled

bc257ff

refactor(app): improve streaming, background search, dtype fallback, and cleanup :contentReference[oaicite:0]{index=0}

293686e

bugfixc: not using pipeline for response generation

939895d

Add original SmolLM2 135M Instruct for comparaison

423dc1a

Add SmolLM2-135M-Instruct-TaiwanChat

38fcc03

Add SmolLM2-135M TaiwanChat

0d642b7

Update README.md

34cf84a
verified

default to gemma-3-4b

88a6a62

model repo_id typo fix

89372fa

enable web search by default

6235e63

remove tinyllama which has bad response quality

a22cf42

make streaming response

5ea073d

apply history flatten before it goint to prompt

ef361b0

better management on system prompt

5f6306a

add accelerate

5ed3cb3

usue chat pipeline instead of model and tokenizer individually

ac8e9cc

bugfix to padding-related issues

f248fec

add attention mask

b6b3940

Clean model description

4731160

pin torch to 2.4.0

4c6b4c5

add sentencepiece tokenzier

4afc958

update requirements

51e3e3c

enable zerogpu with decorator

c5b2897

Apply ZeroGPU

d181b45

add apt.txt

5dd835a

adjust requirements

e85692d

adjust requirements.txt

931fd49

specify gpu build for llama cpp python

49a4dad

Update README.md

d6f7cc4
verified

fix readme

c62b652

switch to gradio version for stability reason

a703203

add taiwan tinyllama

794ee70

Improve responsiveness by asynchronously retrieving web search context

acda3f1

update requirements

12731c2

specify wheel of llama cpp python

f200cb7

openblas build of llam acpp filed

66a3cb6

specify to build llama cpp with openblas

e883a1b

add llama 3.2 taiwan 3b

b1544e2

add minicpm3 4b

f5c0811

increase xt length to max

629495e

remove all moe

fafc8cb

remove qwen 1.5 moe

6735035