Apple Silicon compatibility

#6
by justinxhen - opened

Hello, thank you for sharing this model! I’m very interested in it, but I’m not sure if it can run on Apple Silicon (e.g., M4pro). I tried loading the model using LM Studio, but it failed. Could you please confirm if this model supports Apple Silicon? If there are any suggestions or considerations, please let me know. Thank you!

I don't think you can run image or video generation models in LM studio. For that stuff you should check out ComfyUI but this is a pretty resource intensive model and I don't think you can run it on a CPU.

I did get this working with the basic workflow from https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/example%20workflows_Wan2.1. Using the safetensor files I get the float16 vs 32 MPS not supported errors, but with the GGUF loader in the above workflow I'm able to get videos going!

This comment has been hidden (marked as Off-Topic)

I did get this working with the basic workflow from https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/example%20workflows_Wan2.1. Using the safetensor files I get the float16 vs 32 MPS not supported errors, but with the GGUF loader in the above workflow I'm able to get videos going!

Success! Using the GGUF loader from the workflow you shared finally got it running—thank you! Though it took ~5 minutes to generate 2 seconds of low-res video. Any tips for improving speed/output quality? Wondering if tweaking parameters like steps/resolution would help without crashing. Appreciate your insights!

I don't think you can run image or video generation models in LM studio. For that stuff you should check out ComfyUI but this is a pretty resource intensive model and I don't think you can run it on a CPU.

Thanks for the suggestion! I tried ComfyUI (both the CPU version and the client), and while it technically runs, the generation speed is extremely slow (several minutes for just 2 seconds of video). Looks like this model might indeed need more specialized hardware than Apple Silicon's CPU can provide. Appreciate the guidance though!

Sign up or log in to comment