✓ Verified 💻 Development ✓ Enhanced Data

Windows Ui Automation

Automate Windows GUI interactions (mouse, keyboard, windows) using PowerShell.

Rating
4.5 (129 reviews)
Downloads
14,829 downloads
Version
1.0.0

Overview

Automate Windows GUI interactions (mouse, keyboard, windows) using PowerShell.

Complete Documentation

View Source →

Windows UI Automation

Control the Windows desktop environment programmatically.

Core Capabilities

  • Mouse: Move, click (left/right/double), drag.
  • Keyboard: Send text, press special keys (Enter, Tab, Alt, etc.).
  • Windows: Find, focus, minimize/maximize, and screenshot windows.

Usage Guide

Mouse Control

Use the provided PowerShell script mouse_control.ps1.txt:

powershell
# Move to X, Y
powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action move -X 500 -Y 500

# Click at current position
powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action click

# Right click
powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action rightclick

Keyboard Control

Use keyboard_control.ps1.txt:

powershell
# Type text
powershell -File skills/windows-ui-automation/keyboard_control.ps1.txt -Text "Hello World"

# Press Enter
powershell -File skills/windows-ui-automation/keyboard_control.ps1.txt -Key "{ENTER}"

Window Management

To focus a window by title:

powershell
$wshell = New-Object -ComObject WScript.Shell; $wshell.AppActivate("Notepad")

Best Practices

  • Safety: Always move the mouse slowly or include delays between actions.
  • Verification: Take a screenshot before and after complex UI actions to verify state.
  • Coordinates: Remember that coordinates (0,0) are at the top-left of the primary monitor.

Installation

Terminal bash

openclaw install windows-ui-automation
    
Copied!

💻Code Examples

powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action rightclick

powershell--file-skillswindows-ui-automationmousecontrolps1txt--action-rightclick.txt
### Keyboard Control

Use `keyboard_control.ps1.txt`:

powershell -File skills/windows-ui-automation/keyboard_control.ps1.txt -Key "{ENTER}"

powershell--file-skillswindows-ui-automationkeyboardcontrolps1txt--key-enter.txt
### Window Management

To focus a window by title:
example.txt
# Move to X, Y
powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action move -X 500 -Y 500

# Click at current position
powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action click

# Right click
powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action rightclick
example.txt
# Type text
powershell -File skills/windows-ui-automation/keyboard_control.ps1.txt -Text "Hello World"

# Press Enter
powershell -File skills/windows-ui-automation/keyboard_control.ps1.txt -Key "{ENTER}"

Tags

#web_and-frontend-development #automation

Quick Info

Category Development
Model Claude 3.5
Complexity Multi-Agent
Author wwb-daniel
Last Updated 3/10/2026
🚀
Optimized for
Claude 3.5
🧠

Ready to Install?

Get started with this skill in seconds

openclaw install windows-ui-automation