Open-Source Tool 'Hands' Lets AI Agents Control Windows PCs Like Humans, Using Real Chrome
A developer built 'Hands', an open-source Rust MCP/CLI that gives coding agents like Grok, Codex, Claude Code, and OpenCode the ability to see the Windows desktop and interact with a real Chrome profile. It uses tools like observe, click, type, and scroll to move the actual mouse and keyboard, avoiding the need to turn Chrome into an automation browser. The creator wanted a coding agent to use a Windows PC the way a human does, looking at the screen and clicking real UI elements. This bridges the gap between AI agents and GUI automation on Windows, a platform often underserved by such tools.