README.md

metadata

language:
  - en
license: apache-2.0
datasets:
  - allenai/olmOCR-mix-0225
base_model:
  - Qwen/Qwen2.5-VL-7B-Instruct
library_name: transformers
tags:
  - mlx

mlx-community/olmOCR-7B-0725-8bit

This model was converted to MLX format from allenai/olmOCR-7B-0725 using mlx-vlm version 0.3.2. Refer to the original model card for more details on the model.

Use with mlx

pip install -U mlx-vlm

python -m mlx_vlm.generate --model mlx-community/olmOCR-7B-0725-8bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>