ivrit-ai/whisper-large-v3-turbo-ggml
Updated
ā¢
2
Doron Adler PRO
Norod78
AI & ML interests
Fooling around with Generative machine learning models.
Recent Activity
liked
a model
about 12 hours ago
ivrit-ai/whisper-large-v3-turbo-ggml
liked
a dataset
about 14 hours ago
teknium/OpenHermes-2.5
liked
a Space
1 day ago
ginigen/text3d-r1
Organizations
Norod78's activity
liked
a
model
about 12 hours ago
liked
a
dataset
about 14 hours ago
liked
a
Space
1 day ago
reacted to
schuler's
post with š
1 day ago
Post
6010
š¢ New Research Alert: Making Language Models Smaller & Smarter!
Thrilled to share the latest technical report demonstrating how to reduce language model parameters by 77% while maintaining performance.
The secret? Grouped pointwise convolutions. Yes. We brought a method from computer vision to the transformers arena.
š Key Findings:
ā¢ 77% parameter reduction.
ā¢ Maintained model capabilities.
ā¢ Improved generalization.
Paper: https://www.researchgate.net/publication/388835829_SAVING_77_OF_THE_PARAMETERS_IN_LARGE_LANGUAGE_MODELS_TECHNICAL_REPORT
Code: https://github.com/joaopauloschuler/less-parameters-llm
Thrilled to share the latest technical report demonstrating how to reduce language model parameters by 77% while maintaining performance.
The secret? Grouped pointwise convolutions. Yes. We brought a method from computer vision to the transformers arena.
š Key Findings:
ā¢ 77% parameter reduction.
ā¢ Maintained model capabilities.
ā¢ Improved generalization.
Paper: https://www.researchgate.net/publication/388835829_SAVING_77_OF_THE_PARAMETERS_IN_LARGE_LANGUAGE_MODELS_TECHNICAL_REPORT
Code: https://github.com/joaopauloschuler/less-parameters-llm
updated
a
Space
1 day ago
liked
a
dataset
1 day ago
liked
a
model
2 days ago
updated
2
models
3 days ago
upvoted
an
article
3 days ago
Article
Hugging Face partners with Wiz Research to Improve AI Security
ā¢
14
reacted to
grimjim's
post with š
3 days ago
Post
2245
I've made yet another merge of reasoning models with incremental gains on the current Open LLM leaderboard.
open-llm-leaderboard/open_llm_leaderboard
Merging in DeepSeek R1 distillation to Llama 3.1 8B (at 10% task arithmetic weight, using the Llama 3.1 8B base model as the case rather than the instruct model) with a prior best merge resulted in a slightly lower IFEval, but a higher result in every other benchmark save for MMLU-PRO, which went down only marginally. MATH Lvl5 and GPQA went up palpably.
grimjim/DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B
This result is currently my best Llama 3.1 8B merge result to date. The actual R1 distillation itself scored quite badly, so this would seem to be another case of unexpected formatting (reflected in IFEval) hurting the evaluation results, obscuring the strength of a model.
It is also possible to use the text generation feature of this model to generate roleplay completions. Based on informal testing, this model's bias toward problem-solving will subtly impact narration.
open-llm-leaderboard/open_llm_leaderboard
Merging in DeepSeek R1 distillation to Llama 3.1 8B (at 10% task arithmetic weight, using the Llama 3.1 8B base model as the case rather than the instruct model) with a prior best merge resulted in a slightly lower IFEval, but a higher result in every other benchmark save for MMLU-PRO, which went down only marginally. MATH Lvl5 and GPQA went up palpably.
grimjim/DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B
This result is currently my best Llama 3.1 8B merge result to date. The actual R1 distillation itself scored quite badly, so this would seem to be another case of unexpected formatting (reflected in IFEval) hurting the evaluation results, obscuring the strength of a model.
It is also possible to use the text generation feature of this model to generate roleplay completions. Based on informal testing, this model's bias toward problem-solving will subtly impact narration.
Conversion script (PyTorch to CoreML)
9
#1 opened 13 days ago
by
mrdbourke
updated
2
datasets
4 days ago
liked
2
models
5 days ago
liked
a
Space
5 days ago
upvoted
a
collection
5 days ago
liked
a
model
5 days ago
reacted to
merve's
post with š
5 days ago
Post
2134
IBM released
ibm-granite/granite-vision-3.1-2b-preview, a small vision LM with impressive performance on different tasks š®š„
it comes with transformers and vLLM support from the get-go š
you can run it in Colab T4, so I built a notebook to put it to test, find it here: https://github.com/merveenoyan/smol-vision/blob/main/inference_gists/IBM_Granite_Vision.ipynb
it comes with transformers and vLLM support from the get-go š
you can run it in Colab T4, so I built a notebook to put it to test, find it here: https://github.com/merveenoyan/smol-vision/blob/main/inference_gists/IBM_Granite_Vision.ipynb