Sampler-is-all-you-need-Maybe it can give you some inspiration.
#3
by
win10
- opened
https://ko-fi.com/post/Sampler-is-all-you-need-NO-train-Y8Y41AIF37
I mainly solve the problem of r1 class model in generation and propose a general sampler method to truly extend the inference time.
Really scaling edge models to a more powerful level.
Maybe it can give you some inspiration.