WizardLM-13B-V1.0-Uncensored-GGML

Runtime error

ffreemt commited on Jul 6, 2023

Commit

6f60f08

1 Parent(s): e81dbf8

Update AutoConfig.from_pretrained('TheBloke/WizardLM-13B-V1.0-Uncensored-GGML')

Files changed (1) hide show

app.py CHANGED Viewed

@@ -234,7 +234,7 @@ LLM = AutoModelForCausalLM.from_pretrained(
     # "TheBloke/WizardCoder-15B-1.0-GGML",
     DESTINATION_FOLDER,  # model_path_or_repo_id: str required
     model_file=_,
-    model_type="starcoder",
     threads=os.cpu_count() // 2,  # type: ignore
 )

     # "TheBloke/WizardCoder-15B-1.0-GGML",
     DESTINATION_FOLDER,  # model_path_or_repo_id: str required
     model_file=_,
+    # model_type=None,   # "starcoder",  AutoConfig.from_pretrained("TheBloke/WizardLM-13B-V1.0-Uncensored-GGML")
     threads=os.cpu_count() // 2,  # type: ignore
 )