Dominik Klotz PRO

programmnix-askui

AI & ML interests

Working on our vision of a better digital world. Prompt-to-Automation. VGQ, Object Detection, Text Detection, Icon Classification, ... Vision โค๏ธ

Recent Activity

Organizations

AskUI's profile picture

programmnix-askui's activity

New activity in maxiw/Qwen2-VL-Detection 9 days ago
New activity in AskUI/PTA-1 12 days ago
New activity in AskUI/PTA-1 about 2 months ago
New activity in deepseek-ai/deepseek-vl2 about 2 months ago
New activity in AskUI/PTA-1 about 2 months ago
New activity in AskUI/PTA-1 2 months ago

Several icons

1
#2 opened 2 months ago by
darkzbaron

Update app.py

1
#1 opened 4 months ago by
Tonic
reacted to merve's post with ๐Ÿ”ฅ 3 months ago
view post
Post
3955
Small yet mighty! ๐Ÿ’ซ

We are releasing SmolVLM: a new 2B small vision language made for on-device use, fine-tunable on consumer GPU, immensely memory efficient ๐Ÿค 

We release three checkpoints under Apache 2.0: SmolVLM-Instruct, SmolVLM-Synthetic and SmolVLM-Base HuggingFaceTB/smolvlm-6740bd584b2dcbf51ecb1f39

Learn more from our blog here: huggingface.co/blog/smolvlm
This release comes with a demo, fine-tuning code, MLX integration and TRL integration for DPO ๐Ÿ’
Try the demo: HuggingFaceTB/SmolVLM
Fine-tuning Recipe: https://github.com/huggingface/smollm/blob/main/finetuning/Smol_VLM_FT.ipynb
Also TRL integration for DPO ๐Ÿ’—
reacted to maxiw's post with ๐Ÿš€ 4 months ago
view post
Post
2308
You can now try out computer use models from the hub to automate your local machine with https://github.com/askui/vision-agent. ๐Ÿ’ป

import time
from askui import VisionAgent

with VisionAgent() as agent:
    agent.tools.webbrowser.open_new("http://www.google.com")
    time.sleep(0.5)
    agent.click("search field in the center of the screen", model_name="Qwen/Qwen2-VL-7B-Instruct")
    agent.type("cats")
    agent.keyboard("enter")
    time.sleep(0.5)
    agent.click("text 'Images'", model_name="AskUI/PTA-1")
    time.sleep(0.5)
    agent.click("second cat image", model_name="OS-Copilot/OS-Atlas-Base-7B")


Currently these models are integrated with Gradio Spaces API. Also planning to add local inference soon!

Currently supported:
- Qwen/Qwen2-VL-7B-Instruct
- Qwen/Qwen2-VL-2B-Instruct
- AskUI/PTA-1
- OS-Copilot/OS-Atlas-Base-7B
ยท