Notes on Cross-Platform Computer Use Agents for macOS and Windows — Selection with Hermes Agent and cua-driver as of September 2026

Notes from comparing Computer Use agents that can operate native apps on both macOS and Windows as of September 2026. Among official apps, only the ChatGPT and Claude desktop apps clear the bar of two-OS support plus full-OS control. On the open-source side, Nous Research's Hermes Agent paired with trycua's cua-driver is the strongest starting point, with UI-TARS, Agent S, and Open Interpreter as adjacent candidates. This article focuses on what feature-matrix comparisons tend to hide: the actual scope of the 'no-foreground contract' for background operation, TCC and Accessibility on macOS, UIPI and Session 0 on Windows, multi-monitor limits, and Japanese IME behavior.

Reading Cua Driver 0.26.1 Computer Use Internals — Pinning the Window Target and Separating Action Facts from Postconditions

I recently wrote back-to-back code-reading tours of Hermes Agent and Open Interpreter Computer Use. Both delegate the actual OS operations to an external cua-driver, so the natural next question was what happens on that other side of the boundary. This article is that follow-up, pinned to commit b4e3caec of the trycua/cua monorepo and scoped to Cua Driver 0.26.1. It follows one request from MCP, CLI, or the in-process SDK through to the OS input API, and back out through the public ActionResult and verify_state. Along the way it walks through eight design forks: the shared native dispatch, WindowTargetGuard, element_token, ScreenCaptureKit on macOS, WGC / PrintWindow on Windows, X11 / Wayland on Linux, the closed action contract, and the three-layer permission story.

Reading Hermes Agent v2026.9.7 Computer Use Internals — Capture as Target Binding and Background-First Verify → Escalate

I wrote two Hermes Computer Use posts recently (a selection review and a macOS setup log), and while watching the agent drive Calculator in the background I kept wanting to know what a single computer_use call actually does under the hood. This article is that follow-up: a code-reading tour pinned to Git tag v2026.9.7, tracing one model tool call through to a real OS action and back. Along the way it hits the five design forks I found most instructive: capture doubling as sticky-target binding, background-first with verify → escalate, mutation-safe behavior on MCP timeout, the three image return routes, and the two separate approval layers between Hermes and cua-driver.

Notes on Enabling Hermes Agent Computer Use on macOS — Seven Snags Around /Applications and TCC Permissions

As a follow-up to the selection notes I wrote earlier, I actually enabled the Hermes Agent v0.21.1 computer_use toolset on a real macOS Tahoe (26.6) machine. The docs make it look like a single hermes computer-use install command, but the cua-driver macOS installer hard-codes .app placement in /Applications, the Mac is a Jamf-managed device where I started without admin rights, and TCC binds permissions to the driver's own bundle identity. Those pieces combined to trip me up seven times. This article writes each snag down with symptoms, causes, actual log output, and the resolution, so the next person setting this up has something to grep for.

Reading Open Interpreter rust-v0.0.42 Computer Use Internals — From the QA Skill to cua-driver CLI

I recently wrote a code-reading tour of Hermes Agent v2026.9.7 Computer Use. Open Interpreter's README also documents cua-driver usage, so I wanted to know how much of the agent-side implementation is actually shared and where it diverges. This article is that follow-up: a source-only tour pinned to Git tag rust-v0.0.42, tracing one QA request through the qa-testing skill, the cua-driver CLI, and the Cua daemon, then back to the model with the result and screenshot. Along the way it hits six design forks: a QA skill embedded in the binary, delegation to external CLIs instead of a bespoke tool schema, generic command execution and approval, the view_image bridge for images, the three-layer permission story, and the reproducibility gap because pinning the OI tag does not pin the Cua version.