October 3, 2026
AI picks an icon from a description: Cloudflare API helps find where to click
A developer used probabilities from Cloudflare's API to select an icon in response to the command "click the monitor in the menu bar."
ThePrimeagen
@theprimeagen
I'm essentially using Cloudflare's decision-making API to help control a computer. I took the idea behind Noul, raised the probabilities to certain powers, and then applied probabilistic centering. The result is a click on the correct icon. "Click the monitor icon in the menu bar" produces the result you see.
· 2.6K views
On Oct 3, developer ThePrimeagen described a technique for computer control: transform probabilities and use them to determine where to click.
He used the idea behind Noul, raised the probabilities to powers, and applied probabilistic centering. According to his description, this calculation produces a click on the correct icon. Noul returns the probability of a true answer, while the developer derives the coordinates using his own technique.
Now with screenshots. Previously, Cloudflare's Jev model classified only text. Clef, released on Oct 1, accepts images, so users can send it an interface screenshot along with questions. It is a model accessed through an API that needs to be integrated into a computer-control program.
How to connect Clef. In the Cloudflare dashboard, open Workers AI → Use REST API → Create a Workers AI API Token and copy the token along with the Account ID. Send a POST request to `/accounts/{ACCOUNT_ID}/ai/run/@cf/cloudflare/clef` with a Bearer token and the fields `model`, `state`, `questions`. The documentation includes curl, Python, and Workers examples.
Screenshots are sent directly in the request: Clef accepts up to 4 PNG, JPEG, or WebP images. The API does not accept links to remote images.
Cloudflare also published Clef's weights and a Python example for running it locally.
