✓ Verified 🌐 Web Scrapers ✓ Enhanced Data

Guicountrol

Control the Linux desktop GUI using xdotool, wmctrl, and dogtail.

Rating
4.5 (97 reviews)
Downloads
43,979 downloads
Version
1.0.0

Overview

Control the Linux desktop GUI using xdotool, wmctrl, and dogtail.

Complete Documentation

View Source →

Linux GUI Control

This skill provides tools and procedures for automating interactions with the Linux desktop environment.

Quick Start

1. Identify Target Window

Use wmctrl to find the exact name of the window you want to control.
bash
wmctrl -l

2. Inspect UI Hierarchy

For apps supporting accessibility (GNOME apps, Electron apps with --force-renderer-accessibility), use the inspection script to find button names without taking screenshots.
bash
python3 scripts/inspect_ui.py "<app_name>"

3. Perform Actions

Use xdotool via the helper script for common actions.
bash
# Activate window
./scripts/gui_action.sh activate "<window_name>"

# Click coordinates
./scripts/gui_action.sh click 500 500

# Type text
./scripts/gui_action.sh type "Hello World"

# Press a key
./scripts/gui_action.sh key "Return"

Workflows

Operating an App via Text UI

  • List windows with wmctrl -l.
  • Activate the target window.
  • Run scripts/inspect_ui.py to get the list of buttons and inputs.
  • Use xdotool key Tab and Return to navigate, or click if coordinates are known.
  • If text-based inspection fails, fallback to taking a screenshot and using vision.

Forcing Accessibility in Electron Apps

Many modern apps (VS Code, Discord, Cider, Chrome) need a flag to expose their UI tree:
bash
pkill <app>
nohup <app> --force-renderer-accessibility > /dev/null 2>&1 &

Tool Reference

  • wmctrl: Window management (list, activate, move, resize).
  • xdotool: Input simulation (click, type, key, mousemove).
  • dogtail: UI tree extraction via AT-SPI (Accessibility bus).
  • scrot: Lightweight screenshot tool.

Installation

Terminal bash

openclaw install guicountrol
    
Copied!

💻Code Examples

Use `xdotool` via the helper script for common actions.

use-xdotool-via-the-helper-script-for-common-actions.sh
# Activate window
./scripts/gui_action.sh activate "<window_name>"

# Click coordinates
./scripts/gui_action.sh click 500 500

# Type text
./scripts/gui_action.sh type "Hello World"

# Press a key
./scripts/gui_action.sh key "Return"

Many modern apps (VS Code, Discord, Cider, Chrome) need a flag to expose their UI tree:

many-modern-apps-vs-code-discord-cider-chrome-need-a-flag-to-expose-their-ui-tree.sh
pkill <app>
nohup <app> --force-renderer-accessibility > /dev/null 2>&1 &

Tags

#browser_and-automation

Quick Info

Category Web Scrapers
Model Claude 3.5
Complexity One-Click
Author dreamtraveler13
Last Updated 3/10/2026
🚀
Optimized for
Claude 3.5
🧠

Ready to Install?

Get started with this skill in seconds

openclaw install guicountrol