Hugging Face's logo
Nicolay Rusnachenko's picture
4 22 29

Nicolay Rusnachenko

nicolay-r
jeffersonqueiroz1's profile picture SamuelMinouri's profile picture Samazzy's profile picture
Ā·
https://nicolay-r.github.io/

AI & ML interests

Information Retrieval惻Medical Multimodal NLP (šŸ–¼+šŸ“) Research Fellow @BU_Research惻software developer http://arekit.io惻PhD in NLP

Recent Activity

reacted to mmhamdy's post with šŸ‘€ about 10 hours ago
ā›“ Evaluating Long Context #2: SCROLLS and ZeroSCROLLS In this series of posts about tracing the history of long context evaluation, we started with Long Range Arena (LRA). Introduced in 2020, Long Range Arens (LRA) is one of the earliest benchmarks designed to tackle the challenge of long context evaluation. But it wasn't introduced to evaluate LLMs, but rather the transformer architecture in general. šŸ“œ The SCROLLS benchmark, introduced in 2022, addresses this gap in NLP/LLM research. SCROLLS challenges models with tasks that require reasoning over extended sequences (according to 2022 standards). So, what does it offer? 1ļøāƒ£ Long Text Focus: SCROLLS (unlike LRA) focus mainly on text and contain inputs with thousands of words, testing models' ability to synthesize information across lengthy documents. 2ļøāƒ£ Diverse Tasks: Includes summarization, question answering, and natural language inference across domains like literature, science, and business. 3ļøāƒ£ Unified Format: All datasets are available in a text-to-text format, facilitating easy evaluation and comparison of models. Building on SCROLLS, ZeroSCROLLS takes long text evaluation to the next level by focusing on zero-shot learning. Other features include: 1ļøāƒ£ New Tasks: Introduces tasks like sentiment aggregation and sorting book chapter summaries. 2ļøāƒ£ Leaderboard: A live leaderboard encourages continuous improvement and competition among researchers. šŸ’” What are some other landmark benchmarks in the history of long context evaluation? Feel free to share your thoughts and suggestions in the comments. - SCROLLS Paper: https://huggingface.co/papers/2201.03533 - ZeroSCROLLS Paper: https://huggingface.co/papers/2305.14196
reacted to sequelbox's post with šŸ§  about 10 hours ago
Raiden is here! 63k creative-reasoning and analytic-reasoning prompts answered by DeepSeek's 685b R1 model! - All prompts from https://huggingface.co/datasets/microsoft/orca-agentinstruct-1M-v1 and all responses from https://huggingface.co/deepseek-ai/DeepSeek-R1 - A deep look at R1's reasoning skills! Use as you will. Get it now: https://huggingface.co/datasets/sequelbox/Raiden-DeepSeek-R1 for everyone :)
reacted to sequelbox's post with šŸ‘€ about 10 hours ago
Raiden is here! 63k creative-reasoning and analytic-reasoning prompts answered by DeepSeek's 685b R1 model! - All prompts from https://huggingface.co/datasets/microsoft/orca-agentinstruct-1M-v1 and all responses from https://huggingface.co/deepseek-ai/DeepSeek-R1 - A deep look at R1's reasoning skills! Use as you will. Get it now: https://huggingface.co/datasets/sequelbox/Raiden-DeepSeek-R1 for everyone :)
View all activity

Organizations

None yet

nicolay-r's activity

liked 2 models 1 day ago
liked a dataset 7 days ago
liked a Space 8 days ago
liked a model 13 days ago
liked a model 16 days ago
liked a Space 28 days ago
liked a model 28 days ago
liked a model 4 months ago
liked a model 7 months ago
liked 6 models 8 months ago
liked 4 models 10 months ago