Application windows on the desktop (id, app, title, pid), like the taskbar, plus open dialogs (a file "Open" box…) with dialogOf: the window that owns them; look at a dialog by its id or title. Password managers are never listed. filter: part of a title or app.
輸入參數filter
See a window in the background, without bringing it forward: UI Automation tree (roles, names, ids, values, states) and, with mode image or both, a native capture that works even when the window is covered (WebP, at most 2000 px; unchanged since the last image sent: not attached again, mode image always attaches it). A window with almost no tree (Tk, canvas, game: fewer than 6 elements) also gets the text of its image read by OCR (ocr.lines: text, point, screenshotId), clicked with point + screenshotId. Selects that window for act; an observation serves one act and expires after 60 s. Returns its observation id: pass it to act (required from protocol 2026-07-28).
輸入參數modeimagemarksregionwindow
Steps on the window of the last look, in the background first (Win32 messages, UI Automation, DevTools for Chromium), the real mouse/keyboard only as a fallback under the shared foreground token. One step, or up to 32 each with its own expect; stops at the first step not verified. Per step: ✓ verified, = already done, ~ unknown (never replayed: look again), ✗ failed or refused. interaction: true keeps the window in front for the whole call (shared foreground token, at most 30 s, given back at the end) for a menu that closes when the foreground goes back (a context menu opened by a real right click, then its command): selectors only, every step with its expect; look again afterwards.
輸入參數steps必填interactionobservation
launch
Launch an app, folder or document
Open an application (name, absolute path or Store app id, with its arguments), a folder or a document (absolute path) or a Settings page (ms-settings:...) and give the foreground back to the user. Returns the windows attributed to this launch, each with its proof: "process" (the process the shell returned), "folder" (a new Explorer window showing exactly that folder) or "application" (the requested application, started after the request: another instance started at the same moment could be taken for it; a Store app by its app id); other new windows come back as candidates (outcome unknown). Look at one before acting.
輸入參數app必填args
close: close the window (one close message, read back; a "save?" prompt is reported, never answered).
輸入參數action必填window