Open LLM Leaderboard - wrong number of parameters
@open-llm-leaderboard, maybe I missed something or found a bug, but it seems that recently, since about December 17th 2024, the number of parameters is not being reported correctly in Open LLM Leaderboard:huggingface.coOpen LLM Leaderboard - a Hugging Face Space by open-llm-leaderboardTrack, rank and evaluate open LLMs and chatbotsIt seems that the number reported in the table is 2 times too low.If someone from Open LLM Leaderboard read it, can you confirm or fix it?Thanks
2024-12-27T17:30:51Z
Try contacting author inDiscussion.
2024-12-27T17:47:24Z
Thanks for the suggestion. Done. See:huggingface.coopen-llm-leaderboard/open_llm_leaderboard · Wrong number of parameters...Maybe I missed something or found a bug, but it seems that recently, since about December 17th 2024, the number of parameters is not being reported correctly in Open LLM Leaderboard: