Zig-native CLI Tool usecomputer Open-sourced, AI Coding Assistants Can Directly Control Desktops

Open-source developer Tommaso De Rossi released usecomputer, a desktop automation CLI tool written in Zig as native binaries without Node.js runtime dependency. It allows AI coding assistants (like Claude Code, Codex, OpenCode) to directly control desktop mouse, keyboard actions and screenshots, compatible with macOS and Linux.

The tool provides CLI commands for screenshots, mouse movement/clicks/drags/scrolls, keyboard input, etc., with a coordinate mapping system to convert screenshot pixel coordinates to actual screen coordinates. Screenshots are scaled to 1568 pixels on the longest side to fit model context, and support Kitty Graphics Protocol for inline screenshots in model context.

Previously, the developer created Playwriter (3200+ GitHub stars), a browser automation tool. usecomputer extends from browser to desktop automation, split from the kimaki repo, offering CLI and Node.js library, with integration examples for OpenAI and Anthropic tools.