--- license: apache-2.0 language: - en base_model: - genmo/mochi-1-preview pipeline_tag: text-to-video tags: - mochi - t5 - gguf-comfy - gguf-node widget: - text: >- a fox moving quickly in a beautiful winter scenery nature trees sunset tracking camera output: url: samples\ComfyUI_00001_.webp - text: same prompt as 1st one output: url: samples\ComfyUI_00002_.webp - text: same prompt as 1st one; but with new workflow to bypass oom output: url: samples\ComfyUI_00003_.webp --- # **gguf quantized version of mochi (test pack for gguf-node)** ![screenshot](https://raw.githubusercontent.com/calcuis/comfy/master/mochi.gif) ## **setup (once)** - drag mochi-q3_k_m.gguf [[4.31GB](https://huggingface.co/calcuis/mochi/blob/main/mochi-q3_k_m.gguf)] to > ./ComfyUI/models/diffusion_models - drag t5xxl_fp16-q4_0.gguf [[2.9GB](https://huggingface.co/calcuis/mochi/blob/main/t5xxl_fp16-q4_0.gguf)] to > ./ComfyUI/models/text_encoders - drag mochi_vae_fp8_e4m3fn.safetensors [[460MB](https://huggingface.co/calcuis/mochi/blob/main/mochi_vae_fp8_e4m3fn.safetensors)] to > ./ComfyUI/models/vae ## **run it straight (no installation needed way)** - run the .bat file in the main directory (assuming you are using the gguf-node pack below) - drag the workflow json file (below) to > your browser ### **workflow** - example workflow (with [gguf](https://huggingface.co/calcuis/mochi/blob/main/workflow-mochi-gguf.json) encoder) - example workflow ([safetensors](https://huggingface.co/calcuis/mochi/blob/main/workflow-mochi-safetensors.json)) ### **review** - revised workflow to bypass oom issue and around 50% faster with the new fp8_e4m3fn file - t5xxl works fine as text encoder; more quantized versions of t5xxl can be found [here](https://huggingface.co/chatpig/t5xxl/tree/main) - gguf with pig architecture is working right away; welcome to test ### **reference** - base model from [genmo](https://huggingface.co/genmo/mochi-1-preview) - pig architecture from [connector](https://huggingface.co/connector) - comfyui from [comfyanonymous](https://github.com/comfyanonymous/ComfyUI) - gguf-node ([pypi](https://pypi.org/project/gguf-node)|[repo](https://github.com/calcuis/gguf)|[pack](https://github.com/calcuis/gguf/releases)) ### prompt test# ![screenshot](https://raw.githubusercontent.com/calcuis/comfy/master/mochi.webp) prompt: "a fox moving quickly in a beautiful winter scenery nature trees sunset tracking camera"