Drive a legacy desktop workflow with computer use: AI agent prompt
Have an agent click through GUI-only desktop or browser apps that lack an API—expense reports, legacy portals, presentation updates—using GitHub Copilot's computer-use preview, which asks for approval before controlling each app.
Personal ProductivityDesktop automationintermediateThe prompt
Use computer use on my machine with approval before controlling each app. Goal: [e.g. submit this week's expense report / update slides / move data between two desktop apps]. Apps involved: [list]. Constraints: [e.g. never click Submit/Send/Pay without my OK; stay under $X; only use the sandbox account]. Step through the UI, narrate what you see, and pause for approval before irreversible actions. When done, report: screens visited, fields filled, confirmation numbers, and anything unexpected. If a dialog you don't recognize appears, stop and ask me.
How to use it
- Copy the prompt above.
- Replace every [bracket] with your own details (or fill in the blanks on AgentPlaybook Real Estate, which remembers your answers for the next prompt).
- Paste it into GitHub Copilot computer use, Claude computer use, ChatGPT computer use and review the answer before you use it.
Works with: GitHub Copilot computer use, Claude computer use, ChatGPT computer use
Real-world example: github.blog/changelog/2026-10-01-github-copilot-can-now-interact-with-
Before you use it: what to check
Already built into this prompt
- Use computer use on my machine with approval before controlling each app.
- never click Submit/Send/Pay without my OK; stay under $X; only use the sandbox account].
- Step through the UI, narrate what you see, and pause for approval before irreversible actions.
Check yourself
- Check every figure, price and total against your own records before anything is sent, posted or booked. A person approves refunds, discounts, payments and price changes.
- Read and edit the draft before it reaches a customer or goes public. If you later automate this prompt, start with "draft and notify me", not "send automatically".
- Check names, dates, numbers and any claim against your own source material before you use the answer. AI can misread or invent details.
Using an AI agent? Download this prompt as a SKILL.md agent skill with these checks built in, or get the .zip for Claude.ai. How to install skills.
Want to make this prompt even better? Grade it with the free prompt grader or build your own with the AI prompt generator.
Get the free Solo Founder Stack pack
32 copy-paste agent prompts (PDF) plus 5 new prompts every week.
Get it freeMore Personal Productivity prompts
Plan my weekPlanning · beginnerSummarize a long documentDocuments · beginner · worked exampleLearn any topic fastLearning · beginnerRemove yourself from data brokersPrivacy · beginnerCoordinate a group plan in one chat threadGroup planning · beginnerTurn the podcasts you hear into a personal wikiPersonal knowledge · intermediate