Skip to content

Changelog

Manina AI · App 1.0.5 · TestFlight · 2026-11-13

Section titled “Manina AI · App 1.0.5 · TestFlight · 2026-11-13”

Use board firmware v0.2.5 (TestFlight channel).

  • Web search (Beta). When a task needs something the screen doesn’t show, the agent looks it up on the web first. Tools can be exported and imported as JSON.
  • Phone calls and text messages (Beta, experimental). New Call and Text templates. A call dials, speaks through iOS Live Speech and listens through Live Captions; set them up once as in Phone calls (including Keep Call Captions › 1 Hour). Calls are not stable yet: replies are slow and captions can mishear.
  • Intents improve themselves. When an intent’s saved steps stop matching the screen and the AI finishes the task, that run’s steps become the intent’s new steps; a new intent’s first run that works becomes its reference. Lessons from finished runs go on the intent’s checklist (up to 8). Tap Wrong in the Dynamic Island within 90 s, or Undo on the intent, to take it back; turn it off with Settings → Intents learn from runs.
  • Recordings are runs. A recorded demonstration keeps every step like a run, can be reviewed, continued and saved as an intent.
  • Opening apps is done by the app and checked on screen, also when Spotlight doesn’t open by keyboard.
  • Typing in Chinese, accented and other languages is more reliable.
  • Taps outside the screen are never sent, and a button that already worked is never pressed twice.

Manina AI · App 1.0.2 · TestFlight · 2026-11-07

Section titled “Manina AI · App 1.0.2 · TestFlight · 2026-11-07”

Tested end to end on Duolingo lessons on a real iPhone. Listening needs board firmware v0.2.4; everything else also works with v0.2.3.

  • Listen to phone audio (off by default, Settings → Listen to phone audio). The board passes the iPhone’s sound to the app, which turns it into text on the phone, in English and one more language, and the agent reads what it heard. Second language Automatic (from the screen) picks it from the screen, for example Japanese in a Japanese lesson. Share with the computer (CLI) (on by default) lets Manina AI CLI read the words too. See Listen to phone audio.
  • Longer tasks. No 40-step limit any more: a 300-step safety cap, and a pause to ask you when the screen hasn’t changed for 12 steps in a row. Tap Keep Going to let it go on.
  • A simpler agent. One AI call per step: the AI keeps its own plan and alone decides when the task is done, and each step it sees whether the last action changed the screen. On the free AI service the screen listing is built on the server (about 1 s → 70 ms a step).
  • Who decides each step (Settings → Model). Turn the AI model and Jev, an on-screen helper, on or off and drag them into order, or let both race. With your own model, Jev stays off until you agree to it; you can take that back in Settings → Privacy.
  • Continue from here. Any stopped or failed run can go on from the current screen, also after the app was closed.
  • More accurate taps. Every pointer move runs at one speed, short moves are calibrated, and a far-off pointer reading is checked twice before it counts. Going back to the corner no longer opens Control Center. When the agent taps several times in one step, each later tap first checks its target hasn’t moved. A tap that missed is found and corrects the calibration.
  • Steadier picture. Network checks and image work moved off the app’s main thread (stream drops in a Duolingo lesson: 41 → 0). After a gap the picture resumes from where it stopped, also after a long still screen, and the AI never sees a screen from before its last action. Switching between Wi-Fi and Bluetooth no longer replays old frames. Right after power-on the app keeps checking for the board’s address instead of needing a restart.
  • Review. One main button (Continue or Retry); mark steps Correct or Wrong, and Wrong opens the fix; Insert, re-run and delete sit in each step’s menu. Clearer model and provider pages.
  • Board update banner. Dismissing it hides it for a day, not for good.
  • Diagnostics include the board’s own log and its last reset or crash (firmware v0.2.3 or later).
  • Settings → Developer: demo data and an audio test.
  • Fixed: calibration and the debug log could crash the app; the Live Activity could crash; a lost Bluetooth reply could repeat an input; small calibration moves could read the wrong frame; a custom output budget in advanced model settings was lost; token counts showed 0 when the AI service didn’t report them.

Manina AI · App 1.0.1 · TestFlight · 2026-11-02

Section titled “Manina AI · App 1.0.1 · TestFlight · 2026-11-02”

The first public TestFlight build. Use board firmware v0.2.2 or later (TestFlight channel).

  • Picture over Wi-Fi. The board sends the screen to the app over its own Wi-Fi; Bluetooth carries commands and is the fallback. Video starts faster and resumes on its own after a reconnect.
  • Intents. Record a demonstration or save a run. Recorded moves replay without the AI while the screen matches; add AI steps, read from the screen, copy the notebook, ask me to do a step, and Repeat until. Import and export .esp32intent files, or share one with us.
  • Notebook and memory. The agent copies lists off the screen into the run’s notebook, across scrolls, and keeps your own words and lessons from finished runs, never secrets.
  • Ask me first. Payments only (default), payments, sending and deleting, or never. Questions arrive as notifications.
  • Pause and Stop from the Dynamic Island; a notification when a task needs your help.
  • AI services. A free AI service is available in the app, with consent; or connect your own OpenAI-compatible service that accepts images.
  • Chinese typing as Pinyin through the board.
  • Board updates over Wi-Fi from signed releases, with automatic rollback. See Firmware updates.
  • Logs. Settings → About → Logs to send diagnostics or export all logs. See Debugging & logs.
  • Shares the board with Manina AI CLI: the app has priority; the CLI can use the board while the app is idle.
  • Result card. A run’s answer shows in a collapsible card with Copy.
  • Typing and apps. The keyboard switches between English and Pinyin by itself; apps open by name through Spotlight.

Manina AI · App 1.0 · App Store (in review) · 2026-10-19

Section titled “Manina AI · App 1.0 · App Store (in review) · 2026-10-19”

The agent runs on your iPhone, no computer needed. Connect the board, give Manina AI a goal, and watch it work.

  • The board is the AirPlay receiver for Screen Mirroring and talks to the app over encrypted Bluetooth.
  • The agent on the phone: it plans, looks at the screen, and taps, swipes, and types through the board, with pointer calibration.
  • Review. Each run keeps its steps, screenshots, and a low-frame-rate video; replay and export them on the phone.
  • Live Activity, widgets, Siri, and Shortcuts. Saved tasks can be started from Siri, Shortcuts, widgets, and Control Center.
  • Self-healing when the board, the hotspot, or mirroring drops.
  • Demo data to try the app without hardware.

Set up Manina AI

  • Fixed: a deadlock where the CLI daemon could hang while the ESP32 Agent app was connected.
  • listen. What the iPhone played in the last 30 seconds, as words. By default it reads what the ESP32 Agent app heard (App 1.0.2 and firmware v0.2.4, with Share with the computer (CLI) on); listen mode local turns the raw audio into text on the computer with whisper.cpp. MCP tool phone_audio. See Listen to phone audio.
  • Wi-Fi link. With the board and the computer on the same Wi-Fi (or the computer on the board’s hotspot), commands and video go over Wi-Fi; Bluetooth stays as the way back. esp32agent net join asks for your Wi-Fi and walks you through the iPhone side. Needs board firmware v0.2.3; with v0.2.2 the CLI stays on Bluetooth. See the CLI guide.
  • Faster over Bluetooth. Short commands no longer wait behind the video (with the newer firmware).
  • More accurate taps. The pointer moves one axis at a time, so calibrations from 0.1.1 are redone once; calibration copes with a ticking clock on the Home Screen.
  • DeepSeek Harness plugin dsh-esp32agent (demo).
  • Board log. esp32agent logs --board reads the board’s recent log without unplugging it (firmware v0.2.3 or later).
  • MCP fix. Tools with no arguments send an empty required list, so stricter MCP clients accept them. The npm package carries its MCP Registry name.

The esp32agent CLI connects computer agents to the board over Bluetooth, with local commands and a stdio MCP server: screenshots, taps, swipes, typing, history, and intents. Install it on macOS, Linux, or Windows from the CLI guide. It needs board firmware v0.2.2 (TestFlight channel). Reading the board hotspot details from the CLI is coming in a later CLI release.

Version What it introduced
v0.1.0 The first formal GitHub Release: a computer-based agent controlling a real iPhone through an ESP32 board.
v0.1.1 A later legacy tag with CLI and stdio MCP support. No separate GitHub Release entry.

The legacy branch has continued beyond these tags. See how the two versions differ.

Board firmware is versioned separately from the app, on two channels. See Firmware updates.

Channel Version Installer
Official 0.2.5 manina.ai/install
TestFlight 0.2.5 manina.ai/install?build=testflight
  • Steadier picture. A damaged video packet no longer freezes the screen until the next full frame (decryption now runs in the board’s internal memory), and a packet lost for good is reported so the app can restart mirroring at once.
  • Faster gestures. The Home swipe is one quick press-move-release, and long presses come up by themselves.
  • More reliable commands. A reply that never arrived can be asked for again, and Manina AI CLI can always put the board back on a network.
  • Crash reports say whether they came from this build.
  • Phone audio. Passes the iPhone’s sound to the app while something is playing, for Listen to phone audio (App 1.0.2).
  • Even pointer speed. Every move report goes at one speed, so taps land in the same place whatever the direction; the app recalibrates once after the update. Going back to the corner moves left first, then up, so it never pulls down Control Center.
  • Steadier video. A full video buffer keeps the newest picture instead of freezing, and switching between Wi-Fi and Bluetooth no longer resends old frames.
  • Logs. The board’s own log lines also go to the app’s debug log.
  • Manina AI CLI over Wi-Fi. With the board and the computer on the same Wi-Fi, or the computer on the board’s hotspot, the CLI’s commands and video go over Wi-Fi; Bluetooth stays as the fallback. Set it up with esp32agent net join (CLI guide).
  • Faster CLI commands over Bluetooth. Short commands no longer wait behind the video.
  • esp32agent net shows the board’s Wi-Fi, including the hotspot name and password, to the paired CLI.
  • Manina AI CLI connection. A second Bluetooth link for Manina AI CLI, next to the app. The app has priority; the CLI can use the board while the app is idle.
  • Steadier Wi-Fi video. Video resumes after a reconnect, also after the phone has shown a still screen for a long time, instead of freezing until Screen Mirroring is restarted.
  • Video buffer. A full buffer is kept and reported in the board status instead of being dropped.
  • Diagnostics. The serial port never blocks the board, and a crash command reports the last crash.
  • Memory. More free memory on the board.

The first release: Wi-Fi video, encrypted Bluetooth with a 3-minute pairing window, and firmware updates over Wi-Fi.