Spaces:

5to9
/

bot-royale

Running on Zero

5to9 commited on Sep 27, 2024

Commit

58cb5ad

1 Parent(s): 65118fd

0.24 remove 8-bit to previous state

Files changed (1) hide show

app.py CHANGED Viewed

@@ -64,7 +64,6 @@ def load_model_a(model_id):
             model_id,
             torch_dtype=torch.float16,
             device_map="auto",
-            load_in_8bit=True,
             trust_remote_code=True,
         )
     except Exception as e:
@@ -81,7 +80,6 @@ def load_model_b(model_id):
             model_id,
             torch_dtype=torch.float16,
             device_map="auto",
-            load_in_8bit=True,
             trust_remote_code=True,
         )
     except Exception as e:

             model_id,
             torch_dtype=torch.float16,
             device_map="auto",
             trust_remote_code=True,
         )
     except Exception as e:
             model_id,
             torch_dtype=torch.float16,
             device_map="auto",
             trust_remote_code=True,
         )
     except Exception as e: