RAG Foundry: A Framework for Enhancing LLMs for Retrieval Augmented Generation Paper • 2408.02545 • Published Aug 5, 2024 • 36
view article Article Accelerate StarCoder with 🤗 Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding Jan 30, 2024 • 9
An Efficient Sparse Inference Software Accelerator for Transformer-based Language Models on CPUs Paper • 2306.16601 • Published Jun 28, 2023 • 4
Running on CPU Upgrade 12.4k 12.4k Open LLM Leaderboard 🏆 Track, rank and evaluate open LLMs and chatbots
Intel/distilbert-base-uncased-squadv1.1-sparse-80-1x4-block-pruneofa Question Answering • Updated Sep 20, 2022 • 116
Intel/bert-large-uncased-squadv1.1-sparse-80-1x4-block-pruneofa Question Answering • Updated Aug 1, 2022 • 65 • 1
Intel/bert-large-uncased-squadv1.1-sparse-90-unstructured Question Answering • Updated Dec 5, 2021 • 87
Intel/bert-base-uncased-mnli-sparse-70-unstructured-no-classifier Fill-Mask • Updated Jun 29, 2021 • 12