woodchen7
commited on
Commit
·
817a9c0
1
Parent(s):
1580b9f
update ReadMe
Browse files
README.md
CHANGED
|
@@ -34,6 +34,8 @@ library_name: transformers
|
|
| 34 |
|
| 35 |
Welcome to the official repository of **Hunyuan-A13B**, an innovative and open-source large language model (LLM) built on a fine-grained Mixture-of-Experts (MoE) architecture. Designed for efficiency and scalability, Hunyuan-A13B delivers cutting-edge performance with minimal computational overhead, making it an ideal choice for advanced reasoning and general-purpose applications, especially in resource-constrained environments.
|
| 36 |
|
|
|
|
|
|
|
| 37 |
## Model Introduction
|
| 38 |
|
| 39 |
With the rapid advancement of artificial intelligence technology, large language models (LLMs) have achieved remarkable progress in natural language processing, computer vision, and scientific tasks. However, as model scales continue to expand, optimizing resource consumption while maintaining high performance has become a critical challenge. To address this, we have explored Mixture of Experts (MoE) architectures. The newly introduced Hunyuan-A13B model features a total of 80 billion parameters with 13 billion active parameters. It not only delivers high-performance results but also achieves optimal resource efficiency, successfully balancing computational power and resource utilization.
|
|
|
|
| 34 |
|
| 35 |
Welcome to the official repository of **Hunyuan-A13B**, an innovative and open-source large language model (LLM) built on a fine-grained Mixture-of-Experts (MoE) architecture. Designed for efficiency and scalability, Hunyuan-A13B delivers cutting-edge performance with minimal computational overhead, making it an ideal choice for advanced reasoning and general-purpose applications, especially in resource-constrained environments.
|
| 36 |
|
| 37 |
+
**Hunyuan-A13B-Instruct-GPTQ-Int4** is produced by [**AngelSlim**](https://github.com/Tencent/AngelSlim) , a more user-friendly, comprehensive and efficient model compression toolkit for models.
|
| 38 |
+
|
| 39 |
## Model Introduction
|
| 40 |
|
| 41 |
With the rapid advancement of artificial intelligence technology, large language models (LLMs) have achieved remarkable progress in natural language processing, computer vision, and scientific tasks. However, as model scales continue to expand, optimizing resource consumption while maintaining high performance has become a critical challenge. To address this, we have explored Mixture of Experts (MoE) architectures. The newly introduced Hunyuan-A13B model features a total of 80 billion parameters with 13 billion active parameters. It not only delivers high-performance results but also achieves optimal resource efficiency, successfully balancing computational power and resource utilization.
|