Long-VITA-16K

Github: https://github.com/VITA-MLLM/Long-VITA

  • This is the converted weight from https://huggingface.co/VITA-MLLM/Long-VITA-1M.
  • The original weight is trained on Ascend NPU with MindSpeed.
  • This weight supports inference and evaluation with Megatron and Transformer Engine on Nvidia GPUs.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Collection including VITA-MLLM/Long-VITA-1M_MG