neo

neo-benjamin's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in TheBloke/Llama-2-13B-chat-GPTQ over 1 year ago

torch.cuda.OutOfMemoryError: CUDA out of memory.

#50 opened over 1 year ago by

neo-benjamin

New activity in TheBloke/CodeLlama-13B-Instruct-GPTQ over 1 year ago

GPTQ first

4

#1 opened over 1 year ago by

rabidaught

New activity in bigcode/starcoder over 1 year ago

Can you run starcoder in a Mac book pro machine?

3

#83 opened over 1 year ago by

neo-benjamin

New activity in TheBloke/Llama-2-70B-Chat-GPTQ over 1 year ago

How to set max_split_size_mb?

1

#30 opened over 1 year ago by

neo-benjamin

Load into 2 GPUs

3

#28 opened over 1 year ago by

sauravm8

70TB with multiple A5000

6

#21 opened over 1 year ago by

nashid

Why the input prompt is part of the output?

3

#25 opened over 1 year ago by

neo-benjamin

What does it mean by the inject_fused_attention disabled for 70B model?

1

#24 opened over 1 year ago by

neo-benjamin

70TB with multiple A5000

6

#21 opened over 1 year ago by

nashid