Is the training code details released
#4
by
Milo11
- opened
Hello, I am very excited to see your project. May I ask if the training code for the project can be released? Thank you.
My methods for this model were quite scattered and I didn’t document them well. If you’re curious about how to make an MoE in general, look at the meegekit GitHub.
I’m working on a new project that will be ready in ~2 weeks, at which point I will share more detailed instructions on how to replicate it. I appreciate your interest!
Thank you very much for your reply! Looking forward to the details of your new job being released.