Droidline

io.github.KnifeLemonv0.1.6更新於 Oct 10, 2026

Let an AI agent see and use a real Android phone over Wi-Fi, without ADB or root.

已驗證STDIO僅桌面Developer ToolsBrowser Automation

概覽

AI 產生的概覽

讓 AI 助理透過 Wi-Fi 檢視並操作真實 Android 手機,不需要 ADB、USB 或 root。

功能
Droidline 在本機執行伺服器,透過手機端搭配的應用程式配對後,把手機螢幕與操作能力以 MCP 工具形式提供。助理可以取得螢幕元素樹,依文字、id 或描述點擊與輸入,啟動應用程式、截圖、讀取通知,並等待元素出現或畫面靜止。它也提供唯讀模式與工具限制,以及選用的檢查器、錄製器與 WebDriver 介面。
適用情境
適合需要助理操作真實 Android 裝置的情境:在實機上測試應用程式、在多支手機上重複執行日常流程,或讓助理直接操作手機畫面。不適用於模擬器,也不適用於未暴露可存取元素的應用程式。
執行需求
一台 Windows、macOS 或 Linux 電腦和一支 Android 9 以上手機,首次嘗試通常需在同一個 Wi-Fi 下。電腦上安裝 droidline 伺服器,手機上安裝搭配的 APK,再以 QR code 或 6 位數字碼配對。手機應用程式需要無障礙服務、鍵盤、通知與不受限制的電池等權限;遠端存取需要連接埠轉送、通道或自建中繼。
安裝前請注意
配對決定誰可以控制手機,已配對手機可被完整操作,請只配對自有或獲准自動化的裝置。手機應用程式會要求無障礙、鍵盤與通知權限,可讀取螢幕內容與通知。指令可以點擊、輸入、啟動應用程式與變更設定,選用的裝置擁有者模式還能清除應用程式資料。不收集遙測資料,但應用程式每天會連線 GitHub 檢查更新。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 Droidline,將其新增到工作區。
  2. 為需要使用其工具的對話啟用該服務。

Desktop only,透過 STDIO。 STDIO 服務會啟動本機處理程序,因此需要 SourceWeft 桌面主機。

其他 MCP 客戶端

參照 儲存庫 中的啟動說明。

README

[Droidline: Android automation, one line at a time.]

Automate real Android phones from your code.
Test your apps, script the tasks you repeat, run a shelf of phones, or let an AI agent use one.
Python, Node.js, the shell or HTTP. No ADB, no USB cable, no root.

Website · Docs · Download · Quick start · Languages · Guides

[CI] [Latest release] [Android 9 or later] [Windows, macOS and Linux] [MIT license]

English · 한국어 · 简体中文

No ADB, no cable
Install one app on the phone, turn on its permissions and pair it with a QR code. No developer options, no USB debugging, no root.
The same command everywhere
touch is touch in Python, Node.js, the CLI, HTTP and as an MCP tool, all generated from one spec.
Phones anywhere
The phone connects out to your PC, so it works on the same Wi-Fi or on mobile data through a tunnel or a relay you run. Every line is encrypted end to end.

What people use it for

  • Testing your own app on real phones, including flows that cross into other apps, such as a login with a code from a text message.
  • A shelf of phones running the same routine every day, each through its own network or proxy.
  • Giving an AI agent hands: through MCP, Claude, ChatGPT, Cursor and other agents can look at a phone screen and act on it.
  • Small personal automations, such as turning Wi-Fi off at night or collecting a value from an app every hour.

Droidline uses only permissions an ordinary app can get, so a few things are out of reach: see What it cannot do.

See it in action

[A script sends six lines to a phone: launch the demo app, close the ad, type an email, tick Keep me signed in, tap Log in, and wait for the main screen. Each line gets a reply with how the tap was delivered, and the phone screen changes to match.]
Try the same demo in your browser, and pick elements on a simulated screen, on droidline.dev

Quick start

You need a PC (Windows, macOS or Linux) and an Android phone with Android 9 or later, on the same Wi-Fi for a first try. The installation guide walks through each step with screenshots.

  1. Run the server on your PC. Download the droidline archive for your system from Releases, put droidline on your PATH, and start it. Leave it running.

    bash
    droidline serve
  2. Install the app on the phone. Download droidline-agent.apk from the same release page and open it. On the app's Setup tab, turn on the accessibility service, the Droidline keyboard, notifications and unrestricted battery use. On Android 13 and later, allow restricted settings for the app first; the app shows where.

  3. Pair them. Run this on the PC and scan the QR code with the app's Pair tab:

    bash
    droidline pair

    No camera? Tap Pair on this Wi-Fi in the app and type the 6-digit code it shows: droidline pair 482913.

  4. Send a command.

    bash
    droidline launch com.android.settingsdroidline touch text "Network & internet"

No phone at hand? droidline-fakephone, included in every release, simulates one with a small demo app. The first-script tutorial builds a complete login script against it.

Use it from your language

Every interface talks to droidline serve on localhost:8780 and uses the same command names.

Python (pip install droidline, Python 3.9+)

python
from droidline import connect
d = connect()                                  # the phone paired with this PCd.launch("dev.droidline.demo")if d.exists("text", "Close ad"):               # conditions never wait and never fail    d.touch("text", "Close ad")d.input("id", "email", "knife")                # waits up to 10 s for the elementd.touch("text", "Log in")print(d.get_text("id", "greeting"))

Node.js and TypeScript (npm install droidline, Node.js 18+)

js
import { connect } from "droidline";
const d = await connect();await d.launch("dev.droidline.demo");await d.input("id", "email", "knife");await d.touch("text", "Log in", { timeout: 15 });console.log(await d.getText("id", "greeting"));

C# and .NET (dotnet add package Droidline, .NET 8+ or .NET Framework 4.6.2+)

csharp
using Droidline;
await using var d = await DroidlineClient.ConnectAsync();await d.LaunchAsync("dev.droidline.demo");await d.InputAsync("id", "email", "knife");await d.TouchAsync("text", "Log in", timeout: 15);Console.WriteLine(await d.GetTextAsync("id", "greeting"));

Command line (comes with the server)

bash
droidline touch text "Log in"droidline which text="Log in" id=main_tab --timeout 15droidline screenshot shot.png

HTTP (any language, any tool)

bash
curl -s -X POST localhost:8780/devices/_/touch \  -H 'content-type: application/json' -d '{"by":"text","value":"Log in"}'

AI agents over MCP (Claude, Cursor, VS Code and others)

json
{ "mcpServers": { "droidline": { "command": "droidline", "args": ["mcp"] } } }

With Claude Code: claude mcp add droidline -- droidline mcp. In Claude Desktop you can instead open droidline.mcpb from Releases, which carries its own droidline; it is also listed in the MCP Registry as io.github.KnifeLemon/droidline. To give an agent fewer tools, add --tools dump,screenshot,touch or --read-only to the args; see Limit what an agent can use. Other languages can open a TCP socket and send one JSON line per command; see Other languages for Go, Java and PHP.

Features

  • Pick the element, not the pixel. dump() returns the screen as a tree with text, id and desc for every element. Commands take the field and the value: touch("id", "login"). When an element refuses a click, Droidline taps its parent or the center of its bounds by itself.
  • Waiting is built in. touch, input and wait wait for their element, 10 seconds by default. Conditions such as exists, checked and which answer at once and never throw for a missing element.
  • Clear errors. Every failure has a code, a message in English, Korean or Chinese, and a flag that says whether retrying helps: NOT_FOUND: Could not find text 'Log in' within 10s. Current screen: com.example / .MainActivity.
  • A shelf of phones. One PC drives many phones. Commands to one phone run in order, different phones run in parallel, and each phone has a name you choose.
  • Per-app proxy. Send chosen apps through a socks5 or http upstream with a local VPN, one upstream per phone, without root.
  • Notifications on the PC. Wait for one, react to every one, reply, open or dismiss it, or forward it to a signed webhook.
  • New mobile IPs. A batch sent with cuts_network keeps running on the phone while it is offline, so airplane mode on, wait, off works as one call. intent opens the Settings page first; the recipes show it step by step.
  • Nothing runs twice. A phone that drops off mobile data resumes where it left off; a command that was in flight is answered from the phone's cache, not run again.
  • Selectors that hold up. Combine conditions or name an element by its neighbors: touch({"class": "android.widget.Switch", "row": {"text": "Wi-Fi"}}). find hands back elements you can click and search inside, and wait_idle waits until the screen stops changing.
  • Optional tools, off until you start them. droidline inspect shows the screen and its elements, suggests selectors with code, and records a script while you use the phone. droidline webdriver lets Appium clients and scripts drive your phones. There is also a pytest plugin, leases for sharing phones between scripts, and picture and text matching for screens without elements.
  • English, 한국어, 简体中文 in the app, the error messages and the docs.

Screenshots

[Setup tab with every permission switched on][Pair tab after pairing with a PC][Status tab of a connected phone with its route and permissions]
Setup: each permission with a button to its settings screenPair: scan the QR code or use a 6-digit codeStatus: connection, route and permissions

Reach phones anywhere

The phone always opens the connection, so it needs no open port. Pick the route that fits your network; the phone tries them in order and returns to Wi-Fi when it can.

RouteYou needHow it works
Same Wi-FiNothingThe phone finds the PC with a UDP broadcast and connects directly.
Port forwardOne forwarded portThe phone connects to your public address over TLS, pinned to the PC's certificate.
Tunnelcloudflared, ngrok or similarYour PC keeps a tunnel open; the phone reaches it through the tunnel's address.
Your relayCloudflare Workers or a VPSPC and phone both connect out to a relay you deploy. It forwards lines it cannot read.

Past the two-line handshake every line is encrypted with keys only your PC and phone hold (P-256 and AES-256-GCM), so a tunnel or relay only carries ciphertext. The remote connection guides cover each route step by step.

What it cannot do

Droidline only uses permissions an ordinary app can get, so some things are out of reach. Better to know before you start:

  • It cannot open another app's screens that the app does not export. launch opens the start screen instead.
  • It cannot unlock a PIN, pattern or password lock screen.
  • There is no single command to force stop an app, clear its data or switch the network. Settings differs by phone maker, Android version and language, so the recipes press its buttons, and you may need to adjust the labels for your phone. In the optional device owner mode, clear_data wipes app data directly.
  • Games and some custom-drawn apps expose no elements. Use tap with coordinates and color(x, y) there.
  • Android 15 and later hide one-time codes in notifications from apps. You learn that a code arrived and read it in the app.

The full list explains each one.

Documentation

I want to…Start here
Install everything step by stepInstallation
Write a first script without a phoneYour first script
Use my languagePython · Node.js · CLI · HTTP · AI agents
Find the right element on a screenFinding elements
Point at elements, or record a scriptInspector and recorder
Run Appium scriptsAppium and WebDriver
Test with pytest or Node.jsTest frameworks
Copy a working patternRecipes
Look up a commandCommand reference
Reach phones on mobile dataRemote phones
Fix something that does not workTroubleshooting
Understand the wire formatspec/PROTOCOL.md

Build from source

Requirements: Go 1.26+, Node.js 22, Python 3.9+, and for the app, JDK 17+ with the Android SDK (Android Studio's bundled JDK works).

bash
git clone https://github.com/KnifeLemon/Droidline.gitcd Droidlinego build ./server/cmd/...              # droidline, droidline-relay, droidline-fakephonego test ./spec/ ./server/...node scripts/gen.mjs --check           # SDK methods match spec/commands.jsoncd sdk/python && python -m pytestcd sdk/node && npm ci && npm testdotnet test sdk/dotnetcd agent && ./gradlew assembleDebug testDebugUnitTest

scripts/integration.sh runs the server, the simulated phone and both SDK demos together, which is what CI does.

PathWhat it is
spec/commands.json (every command, in three languages), PROTOCOL.md, crypto test vectors
server/Go: droidline (server, CLI, MCP), droidline-relay, droidline-fakephone
agent/The Android app, in Kotlin
sdk/python, sdk/node, sdk/dotnetOfficial SDKs, generated from the spec plus a thin client
relay/workerA relay for Cloudflare Workers
examples/Demo scripts that run against the simulated phone

Contributing

Pull requests are welcome; CONTRIBUTING.md explains how the spec, generator and tests fit together. The most useful contribution right now is a report from a real phone: which brand and Android version, and whether the Settings recipes for force stop, clearing data and the network switches work with its labels. If Droidline saves you some taps, a ⭐ helps other people find it.

Status

Version 0.1. The server, CLI, MCP adapter, relay and both SDKs pass their tests against the phone simulator, and the app passes its unit tests and runs on an Android 13 emulator. Testing across phone brands is the next step. docs/STATUS.md lists exactly what has been verified and how.

Security and privacy

Pairing decides who may control a phone, and everything after the handshake is encrypted end to end. Report security problems privately as described in SECURITY.md.

Droidline collects no usage data and sends no telemetry. The server listens on your own machine; the app talks only to the PC it is paired with, and to GitHub once a day to check for a new release. Use Droidline on phones and accounts you own or may automate; the terms say what it is for.

License

MIT. See LICENSE.

[Star history]

來源:README.md,提交 2c96452

工具

0
工具後設資料尚未被收錄。

版本歷史

1
  1. v0.1.6最新Oct 10, 2026