OpenVINO
/

open_llama_3b_v2-int4-ov

Text Generation

Inference Endpoints

Model card Files Files and versions Community

katuni4ka commited on Jul 24, 2024

Commit

d46e397

·

verified ·

1 Parent(s): 5b9d25e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -82,7 +82,7 @@ import openvino_genai as ov_genai
 device = "CPU"
 pipe = ov_genai.LLMPipeline(model_path, device)
-print(pipe.generate("What is OpenVINO?"))
 ## Limitations

 device = "CPU"
 pipe = ov_genai.LLMPipeline(model_path, device)
+print(pipe.generate("What is OpenVINO?", max_length=200))
 ## Limitations