Computer Use

io.github.domdomeggPublished by GitHub account domdomeggv1.8.0Updated Oct 24, 2026

Control your computer with screenshots, mouse, and keyboard automation.

VerifiedSTDIODesktop onlyProductivity & WorkflowBrowser Automation

Overview

AI-generated overview

A local MCP server that lets an AI assistant control your desktop through screenshots, mouse and keyboard automation.

What you can do
Take screenshots to see the current desktop state and inspect windows on screen. Move the mouse, click, and type or send keyboard shortcuts to drive applications. Follow a computer-use style workflow with nudges toward keyboard shortcuts over coordinate clicking. Works with common MCP clients such as Claude Code, Claude Desktop, Cursor, Cline and VS Code.
When to use it
Use it when you want an assistant to operate desktop applications on your own machine, for example changing settings or walking through GUI-only tasks. Best suited to supervised or sandboxed sessions rather than unattended use.
Requirements
Runs as a local process on the user's machine, installed via npx from the npm package or as an mcpb bundle. Desktop only; no web executable. No authentication, environment variables or headers are declared. A model good at computer use is recommended, and a small common resolution such as 720p gives better results.
Before you install
The server gives the model complete control of your computer, so mistakes or prompt injection could cause real damage. The README advises close supervision and suggests a sandboxed user account. Actions such as clicks and keystrokes change data and settings on the machine.

Installation

In SourceWeft

  1. Open Computer Use in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Desktop only via STDIO. STDIO servers start a local process, so they need the SourceWeft desktop host.

Other MCP clients

Follow the launch instructions in the repository.

README

computer-use-mcp

💻 A Model Context Protocol server for Claude to control your computer. This is very similar to computer use, but easy to set up and use locally.

Here's Claude Haiku 4.5 changing my desktop background (4x speed):

https://github.com/user-attachments/assets/cd0bc190-52c4-49db-b3bc-4b8a74544789

[!WARNING] At time of writing, models make frequent mistakes and are vulnerable to prompt injections. As this MCP server gives the model complete control of your computer, this could do a lot of damage. You should therefore treat this like giving a hyperactive toddler access to your computer - you probably want to supervise it closely, and consider only doing this in a sandboxed user account.

Installation

Follow the instructions on install-mcp, which generates the right config for your MCP client (Claude Code, Claude Desktop, Cursor, Cline, VS Code, and more).

Tips

This should just work out of the box.

However, to get best results:

  • Use a model good at computer use - I recommend the latest Claude models.
  • Use a small, common resolution - 720p works particularly well. On macOS, you can use displayoverride-mac to do this. If you can't use a different resolution, try zooming in to active windows.
  • Install and enable the Rango browser extension. This enables keyboard navigation for websites, which is far more reliable than Claude trying to click coordinates. You can bump up the font size setting in Rango to make the hints more visible.

How it works

We implement a near identical computer use tool to Anthropic's official computer use guide, with some more nudging to prefer keyboard shortcuts.

This talks to your computer using nut.js

Contributing

Pull requests are welcomed on GitHub! To get started:

  1. Install Git and Node.js
  2. Clone the repository
  3. Install dependencies with npm install
  4. Run npm run test to run tests
  5. Build with npm run build

Releases

Versions follow the semantic versioning spec.

To release:

  1. Use npm version <major | minor | patch> to bump the version
  2. Run git push --follow-tags to push with tags
  3. Wait for GitHub Actions to publish to the NPM registry.

Source: README.md at commit 0c9d517

Tools

0
SourceWeft has not started this package in its sandbox yet, so its tools are not known.

Version history

1
  1. v1.8.0LatestSep 16, 2026

Score

50% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 days25 pts

    Keep the endpoint answering the MCP handshake; SourceWeft probes it every 30 days.

  • Auth declared10 pts

    Declare the credential headers in the registry entry, or keep the endpoint answering the probe so its auth can be classified.

  • Tools listed15 pts

    Answer tools/list without a credential, or ship a package that starts in a sandbox without one.

  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts
  • License10 pts