Transcript
Libretto is an open-source AI toolkit for building reliable browser automations. It gives coding agents (like Claude Code, Codex, Cursor, Cline) a live browser and a token-efficient CLI to inspect pages, capture network traffic, reverse-engineer site APIs, record user actions, and replay them as automation scripts. Built by Saffron Health for maintaining healthcare software integrations, it’s designed to be used as a skill through your coding agent, enabling agents to reproduce failures, pause workflows, inspect live pages, and fix issues autonomously.
Details
| URL | https://libretto.sh |
| Type | CLI / Library (SDK) / Web (Cloud) |
| Pricing | Free (open source) / Cloud (paid) |
| Open Source | Yes |
| License | MIT |
| Tech Stack | TypeScript, Node.js, npm, Playwright, Chromium |
| Platforms | macOS, Windows, Linux |
| Self-Hosted | Yes (CLI + SDK) |
Key Features
- Token-efficient browser automation — 6 tools that let AI agents read pages and control real browsers with Playwright, with minimal context overhead. Includes page inspection, snapshot capture, and TypeScript execution against live pages
- Network traffic capture and API reverse-engineering — captures browser network requests to reverse-engineer site APIs, converting browser automation into faster, more reliable direct API calls. Includes security analysis of requests for common security cookies
- Interactive script recording and replay — records user actions in the browser and replays them as Playwright automation scripts. Supports interactive script building where you perform a workflow and Libretto rebuilds it as a reusable script
- Autonomous debugging — when automations fail, agents can reproduce the failure, pause the workflow at any point, inspect the live page state, and fix issues (e.g., broken selectors) all autonomously. Failed/paused workflows keep the browser open for inspection
- Debug agents — when Playwright automations fail, an agent inspects the live page and opens a pull request with the fix
- Chrome extension — tell an agent what you need done in Chrome, then save it as a workflow you can run again or schedule in the cloud
Best For
Developers and teams maintaining browser-based integrations (especially in regulated industries like healthcare) who need reliable, maintainable web automation. Particularly useful for coding agents (Claude Code, Codex CLI, Cursor, Cline, etc.) that need to interact with web applications where APIs are undocumented or unstable. Ideal for converting fragile UI automation into robust API calls, and for teams that want their AI agents to autonomously debug and fix broken browser workflows.
Integrations
Playwright (browser automation engine), Chromium (bundled browser), Claude Code, Codex CLI, Cursor, Cline, and other coding agents that support skill/plugin architectures. Also supports Libretto Cloud for scheduled/cloud workflow execution.
Notes
- Built by Saffron Health (healthcare software team) and open-sourced to help other teams maintain browser integrations
- Early-stage project under active development — APIs may change before version 1.0; recommend pinning specific versions in production
- Installation: npm install libretto then npx libretto setup (installs skills, downloads Chromium). All state lives in .libretto/ directory
- Telemetry is minimal (install ID, timestamp, command name, error boolean, package version, build channel) and can be disabled via LIBRETTO_TELEMETRY_DISABLED=1, DO_NOT_TRACK=1, or CI=1
- Community: Discord, GitHub Discussions
- Published on npm as libretto