Agent Device

作者 callstack5ee37f30a8df无许可证4.9K 个星标收录于 2026年10月8日更新于 2026年10月8日仓库今天更新

Automates Apple-platform apps (iOS, tvOS, macOS), Android devices, and Amazon Vega OS TV apps in Vega Virtual Devices. Use when navigating apps, taking snapshots/screenshots where supported, driving TV remotes, tapping, typing, scrolling, extracting UI info, collecting evidence, or planning agent-device CLI commands.

AI 生成的概览

通过 agent-device CLI 操作 iOS、tvOS、macOS、Android 与 Vega OS 应用,使用快照、引用和操作命令。

功能
该技能指导智能体通过 agent-device CLI 操作 Apple 平台应用、Android 设备以及 Amazon Vega OS 电视应用。内容包括打开应用,使用 press、click、fill、longpress、scroll 和 back 执行操作,读取快照差异,用 wait、is、get 或 find 验证预期,并关闭会话。它还说明引用(ref)的处理方式、选择器优先级、在无障碍信息稀疏时改用截图,以及何时查阅帮助主题。
适用场景
适用于需要浏览应用、点击、输入、滚动、操作电视遥控器、在支持时获取快照或截图、提取界面信息、收集证据,或规划 agent-device CLI 命令的任务。
运行要求
需要可用的 agent-device CLI,以及已连接或可访问的目标设备或虚拟设备。该技能不附带脚本,仅为说明文档。

agent-device

For a normal app-driving task, start immediately. Do not probe first with --help, --version, devices, appstate, snapshot, or screenshot:

bash
agent-device open <app> --foreground

That starts the session and returns the initial interactive snapshot with @refs.

Loop: act with press|click|fill|longpress <target> ... --settle, scroll <direction> --settle, or back --settle; continue from the printed diff, verify the named expectation (wait text "...", is, get, or find), then run agent-device close.

Reaching an off-screen target is one command, not a scroll-and-check loop: scroll down --until <selector> scrolls until that element is on screen, and scroll bottom runs to the end of the content. Repeated bare scroll down calls are the slow way to find something.

Copy refs byte-for-byte: @e12, @e12~s4 — keep the @ and any ~sN. Prefer current refs, then id/label/role selectors; coordinates are a last resort. If snapshot reports sparse/AX-unavailable, its refs and selectors are invalid: run agent-device screenshot, inspect the image, use coordinates, then retry snapshot -i after navigating. Otherwise run snapshot -i only when the diff lacks the next target.

Error output includes corrective hints; follow them instead of re-planning. Only when the task is specialized (for example gestures, scripting, TV, macOS, remote, or debugging) or a command shape is unclear, run agent-device help <topic>. agent-device --help lists topics, but is not a startup step.

来源与署名

来源:callstack/agent-device位于skills/agent-device提交5ee37f3

许可证: 无许可证

内容归原作者所有。SourceWeft 从公开仓库中收录这些内容。

举报或申请下架