claw-mouse

Control a Linux X11 desktop by taking screenshots and moving/clicking/typing via xdotool + scrot.

Safety Notice

This listing is from the official public ClawHub registry. Review SKILL.md and referenced scripts before running.

Copy this and send it to your AI assistant to learn

Install skill "claw-mouse" with this command: npx skills add rylena/claw-mouse

claw-mouse

This skill provides a small, scriptable desktop GUI control helper for Linux X11.

It’s intended for “vision loop” automation:

  1. take a screenshot
  2. decide where to click
  3. move/click/type
  4. repeat

Under the hood it wraps:

  • scrot for screenshots
  • xdotool for mouse/keyboard/window control

Files

  • desktopctl.py — the CLI script

Requirements

  • Linux running X11 (not Wayland-only)
  • python3
  • xdotool
  • scrot

Ubuntu/Debian:

sudo apt-get update
sudo apt-get install -y xdotool scrot

Usage

From this skill directory:

python3 desktopctl.py screenshot
python3 desktopctl.py click 500 300
python3 desktopctl.py type "hello"
python3 desktopctl.py key ctrl+l
python3 desktopctl.py windows
python3 desktopctl.py activate "Chromium"

DISPLAY / XAUTHORITY

If you’re running from a daemon/headless shell where DISPLAY isn’t set:

DISPLAY=:0 XAUTHORITY=$HOME/.Xauthority python3 desktopctl.py screenshot

Or use flags:

python3 desktopctl.py --display :0 --xauthority $HOME/.Xauthority screenshot

Safety notes

This can click/type into your real desktop session. Use carefully.

Changelog

  • 0.1.0: Initial published skill.

Source Transparency

This detail page is rendered from real SKILL.md content. Trust labels are metadata-based hints, not a safety guarantee.

Open Registry RecordOpen in ClawHub

Related Skills

Related by shared tags or category signals.

Coding

miaoda-app-chat-sync

Convert Git repository code to structured JSON instructions for AI agents. Fetches code from Git repositories (GitHub, GitLab, etc.), generates structured JS...

Registry SourceRecently Updated
1201xiaoanso
Coding

Golang Modernize

Continuously modernize Golang code to use the latest language features, standard library improvements, and idiomatic patterns. Use this skill whenever writin...

Registry SourceRecently Updated
2040samber
Coding

Reliable Tool Context

Build reliable tool context from command output using artifacts and compact reproducible code queries.

Registry SourceRecently Updated
3401zmaciel
Coding

qwencloud-text

[QwenCloud] Generate text, have conversations, write code, reason, and call functions with Qwen models. TRIGGER when: user asks to chat with Qwen, generate t...

Registry SourceRecently Updated
1430cuixiaoyang123