Update README.md
Browse files
README.md
CHANGED
@@ -41,7 +41,7 @@ LWM-v1.1 is designed to be seamlessly integrated into downstream tasks as a sour
|
|
41 |
For example, the following figure demonstrates the advantages of using **LWM-v1.1-based highly compact CLS embeddings** and **high-dimensional channel embeddings** over raw channels for the LoS/NLoS classification task. The raw dataset is derived from channels of size (128, 32) between BS 3 and 8,299 users in the densified Denver scenario of the DeepMIMO dataset.
|
42 |
|
43 |
<p align="center">
|
44 |
-
<img src="https://huggingface.co/wi-lab/lwm-v1.1/resolve/main/images/los_perf.png" alt="LoS/NLoS Classification Performance" width="
|
45 |
</p>
|
46 |
|
47 |
<p align="center">
|
@@ -50,16 +50,32 @@ For example, the following figure demonstrates the advantages of using **LWM-v1.
|
|
50 |
|
51 |
---
|
52 |
|
53 |
-
|
54 |
-
|
55 |
-
|
56 |
-
|
57 |
-
|
58 |
-
|
59 |
-
|
60 |
-
|
61 |
-
|
62 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
63 |
|
64 |
---
|
65 |
|
|
|
41 |
For example, the following figure demonstrates the advantages of using **LWM-v1.1-based highly compact CLS embeddings** and **high-dimensional channel embeddings** over raw channels for the LoS/NLoS classification task. The raw dataset is derived from channels of size (128, 32) between BS 3 and 8,299 users in the densified Denver scenario of the DeepMIMO dataset.
|
42 |
|
43 |
<p align="center">
|
44 |
+
<img src="https://huggingface.co/wi-lab/lwm-v1.1/resolve/main/images/los_perf.png" alt="LoS/NLoS Classification Performance" width="600"/>
|
45 |
</p>
|
46 |
|
47 |
<p align="center">
|
|
|
50 |
|
51 |
---
|
52 |
|
53 |
+
### **π§© Puzzle Pieces that Redefine LWM-v1.0**
|
54 |
+
|
55 |
+
#### **1οΈβ£ Breaking Barriers**
|
56 |
+
π No Channel Size Limitation
|
57 |
+
π Support for Larger Input Sizes
|
58 |
+
|
59 |
+
#### **2οΈβ£ Smarter Foundations**
|
60 |
+
π A More Diverse Dataset
|
61 |
+
π Tougher Masking Challenges with 40% MCM Ratio
|
62 |
+
|
63 |
+
#### **3οΈβ£ Amplified Power**
|
64 |
+
π’ Expanded Capacity: 2.5M Parameters
|
65 |
+
π Realistic 2D Patch Segmentation
|
66 |
+
|
67 |
+
#### **4οΈβ£ Efficiency Engineered**
|
68 |
+
βοΈ Optimized Training with AdamW + Cosine Decay
|
69 |
+
β‘ Faster Computation with Streamlined Attention Heads
|
70 |
+
|
71 |
+
### **π See the Difference at a Glance**
|
72 |
+
|
73 |
+
| Feature | LWM-v1.0 | **LWM-v1.1** |
|
74 |
+
|-----------------------------|-------------------------|-----------------------|
|
75 |
+
| Channel Size Limitation | Fixed at (32, 32) | **Dynamic, up to (512)** |
|
76 |
+
| Masking Ratio | 15% | **40%** |
|
77 |
+
| Parameters | 600K | **2.5M** |
|
78 |
+
| Sequence Length Support | 128 | **512** |
|
79 |
|
80 |
---
|
81 |
|