browser-automation/references/playwright-cheatsheet.md GitHub Copy Download浏览器与桌面自动化速查
覆盖 Playwright(浏览器自动化)和 OpenReverse(Windows 桌面自动化)的常用命令与模式。
面向渗透测试、逆向工程、自动化采集场景。
Playwright / agent-browser 命令速查
导航与生命周期
agent-browser open "https://target.com/login"
agent-browser wait --load networkidle
agent-browser close
页面快照
agent-browser snapshot
agent-browser snapshot -i
元素交互
agent-browser click @e1
agent-browser fill @e2 "admin"
agent-browser type @e2 "password123"
agent-browser press Enter
agent-browser press Tab
agent-browser press Escape
agent-browser scroll down 500
agent-browser scroll up 300
信息获取
agent-browser get text @e1
agent-browser get title
agent-browser get url
等待策略
agent-browser wait @e1
agent-browser wait 2000
agent-browser wait --load networkidle
agent-browser wait --load domcontentloaded
渗透测试常用模式
自动化登录
agent-browser open "https://target.com/login"
agent-browser snapshot -i
agent-browser fill @username "admin"
agent-browser fill @password "password123"
agent-browser click @login_button
agent-browser wait --load networkidle
agent-browser get url
XSS Payload 注入
agent-browser open "https://target.com/search"
agent-browser snapshot -i
agent-browser fill @search_input "<script>alert(1)</script>"
agent-browser click @search_button
agent-browser wait --load networkidle
agent-browser snapshot
表单批量提交(配合脚本)
$payloads = @ ("' OR 1=1--" , "<img src=x onerror=alert(1)>" , "{{7*7}}" )
foreach ($p in $payloads ) {
agent-browser open "https://target.com/form"
agent-browser snapshot -i
agent-browser fill @input "$p "
agent-browser click @submit
agent-browser wait --load networkidle
agent-browser snapshot
}
agent-browser close
Cookie / LocalStorage 提取
const { chromium } = require ('playwright' );
(async () => {
const browser = await chromium.launch ();
const context = await browser.newContext ();
const page = await context.newPage ();
await page.goto ('https://target.com' );
const cookies = await context.cookies ();
console .log (JSON .stringify (cookies, null , 2 ));
const storage = await page.evaluate (() => JSON .stringify (localStorage ));
console .log (storage);
await browser.close ();
})();
截图取证
agent-browser open "https://target.com/admin"
agent-browser wait --load networkidle
await page.screenshot ({ path : 'evidence.png' , fullPage : true });
Playwright Node.js API 速查
基础模板
const { chromium } = require ('playwright' );
(async () => {
const browser = await chromium.launch ({
headless : true ,
});
const context = await browser.newContext ({
ignoreHTTPSErrors : true ,
userAgent : 'Mozilla/5.0 ...' ,
});
const page = await context.newPage ();
await page.goto ('https://target.com' );
await browser.close ();
})();
常用选择器
await page.click ('#login-btn' );
await page.fill ('input[name="username"]' , 'admin' );
await page.click ('text=Submit' );
await page.click ('button:has-text("Login")' );
await page.click ('xpath=//button[@type="submit"]' );
await page.click ('form >> input[type="submit"]' );
网络拦截
await page.route ('**/api/**' , route => {
console .log ('API call:' , route.request ().url ());
route.continue ();
});
await page.route ('**/api/auth' , route => {
route.continue ({
headers : { ...route.request ().headers (), 'X-Admin' : 'true' }
});
});
await page.route ('**/api/user' , async route => {
const response = await route.fetch ();
const json = await response.json ();
json.role = 'admin' ;
route.fulfill ({ response, json });
});
等待与断言
await page.waitForSelector ('#result' );
await page.waitForSelector ('.error' , { state : 'visible' });
const [response] = await Promise .all ([
page.waitForResponse ('**/api/login' ),
page.click ('#login-btn' ),
]);
console .log (response.status (), await response.json ());
await Promise .all ([
page.waitForNavigation (),
page.click ('a[href="/admin"]' ),
]);
OpenReverse 桌面自动化速查
模式选择
模式
命令前缀
适合场景
UIA
openreverse uia ...
标准 Windows 控件(按钮、文本框、列表)
CUA
openreverse cua ...
复杂/非标准 GUI(IDA 反汇编视图、自定义渲染界面)
UIA 模式(结构化控件操作)
openreverse uia launch "C:\Tools\x64dbg\x64dbg.exe"
openreverse uia tree
openreverse uia click "Button:Open"
openreverse uia fill "Edit:FilePath" "C:\sample.exe"
openreverse uia menu "File > Open"
openreverse uia get-text "Edit:Output"
CUA 模式(视觉驱动交互)
openreverse cua screenshot
openreverse cua click 500 300
openreverse cua dblclick 500 300
openreverse cua type "search string"
openreverse cua key "ctrl+g"
openreverse cua key "F5"
openreverse cua key "F9"
网络观察(mitmproxy)
openreverse network start --mode proxy --port 8888
openreverse network start --mode local --filter "target.exe"
openreverse network list
openreverse network export har output.har
openreverse network stop
逆向工具自动化组合
IDA Pro 自动化(OpenReverse + ida-reverse)
场景:批量分析多个样本
1. openreverse cua launch "ida64.exe"
2. 对每个样本:
a. openreverse cua key "ctrl+o" # 打开文件对话框
b. openreverse uia fill "Edit:FileName" "sample_N.exe"
c. openreverse uia click "Button:Open"
d. 等待分析完成(轮询 IDA 标题栏)
e. 通过 ida-reverse MCP 工具提取结果
f. openreverse cua key "ctrl+w" # 关闭数据库
x64dbg 自动化调试
场景:自动化断点设置与数据采集
1. openreverse uia launch "x64dbg.exe"
2. openreverse cua key "F3" # 打开文件
3. openreverse uia fill "Edit:FileName" "target.exe"
4. openreverse uia click "Button:Open"
5. openreverse cua key "ctrl+g" # Go to address
6. openreverse cua type "0x401000"
7. openreverse cua key "F2" # 设置断点
8. openreverse cua key "F9" # 运行
9. openreverse cua screenshot # 截图保存状态
常见问题与解决
问题
原因
解决
agent-browser 无响应
进程泄漏
先 agent-browser close,再重新 open
元素引用失效
页面已刷新
重新 snapshot -i 获取新引用
填表无效
JS 监听 input 事件
用 type 代替 fill
HTTPS 证书错误
自签名证书
Playwright: ignoreHTTPSErrors: true
页面加载超时
网络慢/资源多
增加 timeout 或用 domcontentloaded
UIA 找不到控件
应用使用自绘控件
切换到 CUA 模式
CUA 点击偏移
分辨率/DPI 不匹配
先 screenshot 确认坐标
安装与依赖
Playwright
winget install OpenJS.NodeJS.LTS
npm install -g playwright
npx playwright install
npm install -g agent-browser
OpenReverse
git clone https://github.com/zhexulong/openreverse.git
cd openreverse
npm install
npm run init:agents -- --target =all <项目路径>
npm run install:cua-runtime
npm run doctor:cua-runtime
npm run install:mitmproxy
npm run doctor:network
相关资源