Collections

44

EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameters

Paper • 2402.04252 • Published Feb 6, 2024 • 26
Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models

Paper • 2402.03749 • Published Feb 6, 2024 • 13
ScreenAI: A Vision-Language Model for UI and Infographics Understanding

Paper • 2402.04615 • Published Feb 7, 2024 • 43
EfficientViT-SAM: Accelerated Segment Anything Model Without Performance Loss

Paper • 2402.05008 • Published Feb 7, 2024 • 22

-

1

-

EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameters

Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models

ScreenAI: A Vision-Language Model for UI and Infographics Understanding

EfficientViT-SAM: Accelerated Segment Anything Model Without Performance Loss

Evolving Deeper LLM Thinking

PaSa: An LLM Agent for Comprehensive Academic Paper Search

Multiple Choice Questions: Reasoning Makes Large Language Models (LLMs) More Self-Confident Even When They Are Wrong

ComplexFuncBench: Exploring Multi-Step and Constrained Function Calling under Long-Context Scenario

UltraIF: Advancing Instruction Following from the Wild

Great Models Think Alike and this Undermines AI Oversight

Ola: Pushing the Frontiers of Omni-Modal Language Model with Progressive Modality Alignment

MM-IQ: Benchmarking Human-Like Abstraction and Reasoning in Multimodal Models

DeepRAG: Thinking to Retrieval Step by Step for Large Language Models

ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoning

The Jumping Reasoning Curve? Tracking the Evolution of Reasoning Performance in GPT-[n] and o-[n] Models on Multimodal Puzzles

gpt-omni/mini-omni2

jacklishufan/OmniFlow-v0.5

TinyHelen's First Curriculum: Training and Evaluating Tiny Language Models in a Simpler Language Environment

Ola: Pushing the Frontiers of Omni-Modal Language Model with Progressive Modality Alignment

LLaVA-OneVision: Easy Visual Task Transfer

VILA^2: VILA Augmented VILA

PaliGemma: A versatile 3B VLM for transfer

openbmb/MiniCPM-V-2_6

iVideoGPT: Interactive VideoGPTs are Scalable World Models

Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models

An Introduction to Vision-Language Modeling

Matryoshka Multimodal Models

OLMo: Accelerating the Science of Language Models

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

StarCoder: may the source be with you!

SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling

BLINK: Multimodal Large Language Models Can See but Not Perceive

TextSquare: Scaling up Text-Centric Visual Instruction Tuning

Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Models

InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD

DocLLM: A layout-aware generative language model for multimodal document understanding

COSMO: COntrastive Streamlined MultimOdal Model with Interleaved Pre-Training

LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents

LLaVA-Interactive: An All-in-One Demo for Image Chat, Segmentation, Generation and Editing