Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
Paper
•
2502.07490
•
Published
•
9
•
2
Liu
Shiweiliuiiiiiii
AI & ML interests
LLM, reasoning, ML efficiency
Recent Activity
authored
a paper
10 days ago
OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection for
Memory-Efficient LLM Fine-tuning
authored
a paper
10 days ago
FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed
Forward Skipping
authored
a paper
10 days ago
Found in the Middle: How Language Models Use Long Contexts Better via
Plug-and-Play Positional Encoding
Organizations
None yet
Shiweiliuiiiiiii's activity
commented
a
paper
29 days ago
commented
a
paper
about 2 months ago