Show HN: GPT-4 with Vision Checkup
When new Large Multimodal Models (LMMs) are released, there is excitement as we explore new capabilities. What can a model do? What can&#x27;t a model do? What strange behaviors does the model exhibit?<p>With that said, such analyses are frozen in time.<p>At a hackathon toward the end of last year, the Roboflow team made a tool that runs the same set of tests with the GPT-4 with Vision API every day. This allows people to see how the model performs over time as updates are made.<p>The last seven days of results are displayed on a web page; the rest of the data is archived in GitHub.<p>We started the site with common vision tasks like OCR, object detection, and object counting. We welcome anyone to submit a PR to add new tasks, too!