Autoclawd

AI that watches
your screen and acts.

No prompts. No tab-switching. An ambient macOS agent that sees what you're doing, detects the friction, and fixes it before you ask.

Clone & Build
Claude CodeClickUpGranolaGoogle SheetsGitHubMCP ProtocolSwiftUIApple Neural EngineAnthropic Claude CodeClickUpGranolaGoogle SheetsGitHubMCP ProtocolSwiftUIApple Neural EngineAnthropic
Connected Tools
ClickUpTasks & backlogs
GranolaMeeting notes
SheetsLive data
GitHubIssues & PRs
WebSearch & docs
FilesystemRead & write
+ ANY MCP SERVER
Autoclawd TASK ▶
📋 "500 error on /api/users — check prod logs"
⌕ Reading routes/users.ts...
→ Null ref at getUserById():47 — missing optional chain
✓ Patched. Tests passing. 14/14.
Sonnet 4.6 ›
Session ConfigActive
MODETask
MODELSonnet 4.6
PROJECT~/dev/api
TOOLS6 connected
PERMSFS + Shell + MCP
✓ Read routes/users.ts
✓ Edited line 47
✓ npm test — 14/14
Done in 42s
Why Autoclawd

Every AI tool lives inside an app.
This one lives inside your Mac.

01Friction Detection
02Screen Intelligence
03Tool Orchestration
04Native Performance

Spots friction before you feel it

Watches your live activity — app switches, clipboard copies, file moves — and pattern-matches against known friction signals. When it finds one, it checks its capability map and offers to fix it. You never typed a word.

  • Cross-app data transfers — copy from one app, paste into another
  • File shuttles — download from Slack, upload to Google Drive, repeat
  • Manual lookups — switching to a reference app, copying a value, switching back

Neural Engine vision, not OCR

Apple's VNGenerateImageFeaturePrintRequest embeds screen frames as 768-dim vectors on-device. Cosine distance detects semantic changes. Only meaningful frames hit Sonnet — with active window crops at 1440px. It doesn't see "Chrome." It sees "editing row 3 of Q1 Budget in Google Sheets."

  • On-device frame embeddings via Apple Neural Engine
  • Adaptive thresholding — only meaningful changes trigger analysis
  • Web app resolution — browser URLs become semantic app identities

Your tools stay where they are

Autoclawd spawns Claude Code sessions with access to your MCP servers. It indexes every installed tool into a searchable capability registry. When friction is detected and no tool fits, it searches the web for MCP servers that could.

  • ClickUp, Granola, Sheets, GitHub connected out of the box
  • Any MCP server — add to ~/.claude/mcp.json, works next session
  • Capability discovery — web search for new integrations when needed

Native Swift. No Electron.

Pure Swift + SwiftUI. Menu bar pill with intelligence glow. Glass-material toast overlays. Sub-100ms hotkey response. No browser. No web wrapper. The ghost stays invisible until you need it.

  • Apple frameworks — Vision, AVFoundation, Combine, FSEvents
  • Menu bar pill with 5 collapse levels — from full panel to 44px icon
  • Four keyboard shortcuts are the entire control surface
Zero prompts to full control

One ghost,
every workflow

Autoclawd MODES

Each mode invokes a dedicated Claude Code skill with its own permissions, rules, and boundaries. Task mode can write files. Question mode can't open one. They never cross.

Fn → start session ⌘C → feed context ⌥X → cycle mode ⌥Z → screenshot ⌥⌥ → end session
Learn More

▶ Task

"Fix this. Ship this."

Full filesystem, shell, and GitHub. Edits code, runs tests, commits.

FSShellGitHubMCP

+ Add to Tasks

"Track this."

Creates ClickUp tasks from any context. Titles, priorities, assignees.

ClickUpMCPNo FSNo shell

? Question

"What did we decide?"

Queries Granola, ClickUp, Sheets, web. Can never touch code.

GranolaSheetsWebNo files

⌕ Analyze

"Explain. Change nothing."

Reads code, traces logic. Never writes a byte.

ReadMCPNo writesNo shell
For Builders

Open source. Fork it.
Break it. Make it yours.

Custom Skills

Write a Claude Code skill file. Define the system prompt, allowed tools, and permissions. Autoclawd loads it on next session.

--- name: deploy allowed-tools: Bash, GitHub --- Run tests. Build. Push to staging.
Learn More

MCP Connectors

Every integration runs on the Model Context Protocol. Slack, Linear, Notion — one JSON file, infinite reach.

{ "mcpServers": { "slack": { "command": "npx", "args": ["slack-mcp"] } } }
Learn More

Persistent Sessions

Every session carries full context — clipboard history, tool results, file changes, execution logs. Your ghost never forgets.

Learn More

Model Agnostic

Switch between Haiku, Sonnet, and Opus from the toast header. Optimize for speed or depth. Tools carry over.

Learn More

Protected from every angle.

Mode-level isolation

+

Each mode defines explicit tool access in its skill file. Task mode can write files and run shell. Question mode queries Granola and Sheets but can't open a file. Analyze is strictly read-only. Permissions are structural, not suggestions.

Local-first architecture

+

Everything runs on your machine. No cloud relay. No telemetry. Your clipboard, screen captures, and file contents never leave your laptop except as direct API calls to Anthropic and your connected tools.

Fully open source

+

Every line of Swift is on GitHub. Read the perception pipeline. Inspect the MCP wiring. Verify the permission model. Fork it, modify it, audit it. No black boxes.

The Vision

Phase 1 of
The Last Prompt

The Problem →
ARIA →
The Future →
"Every AI tool today lives inside an app. You copy context out, paste it into a chatbot, figure out the right prompt, get a result, then carry it back. The human is the integration layer. The human is the bottleneck."
readme.md — sameeeeeeep/autoclaw

Your ghost is ready.
Are you?

Try Autoclawd Today