NexusWindows for Codex

io.github.pironjulien由 GitHub 帳號 pironjulien 發布v3.7.4更新於 Nov 3, 2026

Windows computer use in the background for Codex: UI Automation, Win32 messages, read back.

概覽

AI 產生的概覽

讓助手在背景檢視並操作 Windows 桌面應用程式,以 UI Automation、Win32 訊息與可驗證的步驟為基礎。

可以做什麼
  • 列出桌面視窗與開啟的對話方塊,可依標題或應用程式篩選
  • 在背景檢視單一視窗:UI Automation 樹狀結構或原生擷取畫面
  • 以選擇器在該視窗上執行步驟,每步附預期結果,遇到未驗證的步驟即停止
  • 啟動應用程式、資料夾、文件或系統設定頁面,並回報因此產生的視窗
  • 關閉視窗,遇到儲存提示時只回報而不代為回答
適用情境
適合讓助手在使用者繼續工作的同時操作 Windows 桌面應用程式,例如填寫表單、讀取對話方塊,或操作沒有 API 的舊式軟體。
執行需求
以本機 stdio 程序在 Windows 上執行,透過 npx 從 npm 套件啟動;僅限桌面,沒有網頁版。未宣告驗證、環境變數或標頭。
安裝前請注意
它會操作真實的桌面應用程式,包括輸入、點擊與關閉視窗,出錯會影響使用者正在使用的工作階段。密碼管理員不會被列出,但其他視窗可能顯示敏感資料。付款、傳送、發布或永久刪除類操作須經使用者本人下令確認才會執行。畫面上讀到的文字應視為資料而非指令。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 NexusWindows for Codex,將其新增到工作區。
  2. 為需要使用其工具的對話啟用該服務。

Desktop only,透過 STDIO。 STDIO 服務會啟動本機處理程序,因此需要 SourceWeft 桌面主機。

其他 MCP 客戶端

參照 儲存庫 中的啟動說明。

README

該儲存庫沒有 README。

工具

5

windows

List windows

Application windows on the desktop (id, app, title, pid), like the taskbar, plus open dialogs (a file "Open" box…) with dialogOf: the window that owns them; look at a dialog by its id or title. Password managers are never listed. filter: part of a title or app.

輸入參數filter

look

Look at a window

See a window in the background, without bringing it forward: UI Automation tree (roles, names, ids, values, states) and, with mode image or both, a native capture that works even when the window is covered (WebP, at most 2000 px; unchanged since the last image sent: not attached again, mode image always attaches it). A window with almost no tree (Tk, canvas, game: fewer than 6 elements) also gets the text of its image read by OCR (ocr.lines: text, point, screenshotId), clicked with point + screenshotId. Selects that window for act; an observation serves one act and expires after 60 s. Returns its observation id: pass it to act (required from protocol 2026-07-28).

輸入參數modeimagemarksregionwindow

act

Act in the window

Steps on the window of the last look, in the background first (Win32 messages, UI Automation, DevTools for Chromium), the real mouse/keyboard only as a fallback under the shared foreground token. One step, or up to 32 each with its own expect; stops at the first step not verified. Per step: ✓ verified, = already done, ~ unknown (never replayed: look again), ✗ failed or refused. interaction: true keeps the window in front for the whole call (shared foreground token, at most 30 s, given back at the end) for a menu that closes when the foreground goes back (a context menu opened by a real right click, then its command): selectors only, every step with its expect; look again afterwards.

輸入參數steps必填interactionobservation

launch

Launch an app, folder or document

Open an application (name, absolute path or Store app id, with its arguments), a folder or a document (absolute path) or a Settings page (ms-settings:...) and give the foreground back to the user. Returns the windows attributed to this launch, each with its proof: "process" (the process the shell returned), "folder" (a new Explorer window showing exactly that folder) or "application" (the requested application, started after the request: another instance started at the same moment could be taken for it; a Store app by its app id); other new windows come back as candidates (outcome unknown). Look at one before acting.

輸入參數app必填args

window

Manage a window

close: close the window (one close message, read back; a "save?" prompt is reported, never answered).

輸入參數action必填window

版本歷史

5
  1. v3.7.4最新Oct 29, 2026
  2. v3.1.7Oct 26, 2026
  3. v3.1.6Oct 26, 2026
  4. v3.1.1Oct 24, 2026
  5. v3.0.1Oct 23, 2026

評分

已滿足適用檢查項的 75%

該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通25 分
  • 已宣告認證方式10 分

    請在註冊中心條目中宣告憑證請求標頭,或保持端點能夠回應探測,以便判定其認證方式。

  • 已列出工具必需15 分
  • 描述必需15 分
  • 圖示10 分
  • 文件15 分

    請宣告包含 README 的 GitHub 儲存庫,或在 OAuth 受保護資源後設資料中提供 resource_documentation。

  • 授權條款10 分