Hugging Face's logo
Dr. Joao Paulo Schwarz Schuler's picture
6 7

Dr. Joao Paulo Schwarz Schuler PRO

schuler
MomoRelmo's profile picture marilu64's profile picture Norod78's profile picture
Ā·
https://www.researchgate.net/profile/Joao-Paulo-Schwarz-Schuler

AI & ML interests

artificial intelligence

Recent Activity

updated a model 1 day ago
schuler/experimental-JP47D54C
updated a model 1 day ago
schuler/experimental-JP47D54B
updated a model 1 day ago
schuler/experimental-JP47D54
View all activity

Organizations

None yet

schuler's activity

updated 9 models 1 day ago
posted an update 1 day ago
view post
Post
5754
šŸ“¢ New Research Alert: Making Language Models Smaller & Smarter!

Thrilled to share the latest technical report demonstrating how to reduce language model parameters by 77% while maintaining performance.

The secret? Grouped pointwise convolutions. Yes. We brought a method from computer vision to the transformers arena.

šŸ”‘ Key Findings:
ā€¢ 77% parameter reduction.
ā€¢ Maintained model capabilities.
ā€¢ Improved generalization.

Paper: https://www.researchgate.net/publication/388835829_SAVING_77_OF_THE_PARAMETERS_IN_LARGE_LANGUAGE_MODELS_TECHNICAL_REPORT
Code: https://github.com/joaopauloschuler/less-parameters-llm
published 2 models 4 days ago
published 2 models 5 days ago
updated a model 6 days ago
published a model 6 days ago
updated a model 7 days ago
published a model 7 days ago
updated a model 7 days ago
published a model 7 days ago