Agent Device

作者 callstack5ee37f30a8df無授權條款4.9K 個星標收錄於 2026年10月8日更新於 2026年10月8日儲存庫今天更新

Automates Apple-platform apps (iOS, tvOS, macOS), Android devices, and Amazon Vega OS TV apps in Vega Virtual Devices. Use when navigating apps, taking snapshots/screenshots where supported, driving TV remotes, tapping, typing, scrolling, extracting UI info, collecting evidence, or planning agent-device CLI commands.

AI 產生的概覽

透過 agent-device CLI 操作 iOS、tvOS、macOS、Android 與 Vega OS 應用程式,使用快照、參照與操作指令。

功能
此技能指示代理透過 agent-device CLI 操作 Apple 平台應用程式、Android 裝置以及 Amazon Vega OS 電視應用程式。內容涵蓋開啟應用程式,使用 press、click、fill、longpress、scroll 與 back 執行動作,讀取快照差異,以 wait、is、get 或 find 驗證預期結果,並關閉工作階段。它也說明參照(ref)的處理方式、選擇器優先順序、在無障礙資訊稀疏時改用螢幕截圖,以及何時查閱說明主題。
適用情境
適用於需要瀏覽應用程式、點擊、輸入、捲動、操作電視遙控器、在支援時取得快照或螢幕截圖、擷取介面資訊、蒐集證據,或規劃 agent-device CLI 指令的任務。
執行需求
需要可用的 agent-device CLI,以及已連線或可存取的目標裝置或虛擬裝置。此技能不附帶指令碼,僅為說明文件。

agent-device

For a normal app-driving task, start immediately. Do not probe first with --help, --version, devices, appstate, snapshot, or screenshot:

bash
agent-device open <app> --foreground

That starts the session and returns the initial interactive snapshot with @refs.

Loop: act with press|click|fill|longpress <target> ... --settle, scroll <direction> --settle, or back --settle; continue from the printed diff, verify the named expectation (wait text "...", is, get, or find), then run agent-device close.

Reaching an off-screen target is one command, not a scroll-and-check loop: scroll down --until <selector> scrolls until that element is on screen, and scroll bottom runs to the end of the content. Repeated bare scroll down calls are the slow way to find something.

Copy refs byte-for-byte: @e12, @e12~s4 — keep the @ and any ~sN. Prefer current refs, then id/label/role selectors; coordinates are a last resort. If snapshot reports sparse/AX-unavailable, its refs and selectors are invalid: run agent-device screenshot, inspect the image, use coordinates, then retry snapshot -i after navigating. Otherwise run snapshot -i only when the diff lacks the next target.

Error output includes corrective hints; follow them instead of re-planning. Only when the task is specialized (for example gestures, scripting, TV, macOS, remote, or debugging) or a command shape is unclear, run agent-device help <topic>. agent-device --help lists topics, but is not a startup step.

來源與署名

來源:callstack/agent-device位於skills/agent-device提交5ee37f3

授權條款: 無授權條款

內容歸原作者所有。SourceWeft 從公開儲存庫中收錄這些內容。

檢舉或申請下架