Teach a bot a workflow from a screen recording
Have Grok Bot learn a repeated task from a recording, then run it again while pausing for any login or submission step.
- What they did
- A reviewer showed Grok Bot a workflow through one screen recording, and the bot used that example to copy the same process later. The case described was pulling newsletter statistics from a service that did not offer an API or plugin. The bot could stop when a login was needed, let a person take over, then continue afterward.
- How it went
- The benefit was that the setup took less manual instruction than building a full automation step by step, and it opened up jobs that had no API path. The example did not report any measured accuracy or reliability for the newsletter-stats run. Access was also tied to paid plans, starting at about $120 per seat each month, with pricier individual tiers above that.
- Tips
- This works best for tasks with a clear visual flow that can be replayed the same way. Keep a person in the loop for sign-ins, payments, or anything else that could affect live data.
Try it yourself with Grok Bot
Watch this screen recording of me doing [task]. Learn the steps from what I do, then restate the workflow in order and ask me to confirm it. After I approve, carry out the task on [site/app] and return the result in [format]. If you reach a login, payment, send, delete, or submit step, stop and ask me to take over before you continue. Report back when the task is finished, including any problems you hit.
Fill in the [brackets]. Agents can make mistakes, so review anything before it is sent, paid or deleted.
Get 3 agent uses like this every morning
With the day's top AI news. Free, and one click to unsubscribe.
Related agent uses
Let Grok Bot handle inboxes and job bookings
Grok Bot can watch work messages, organize incoming jobs, and build booking drafts across the tools your team already uses.
Have an agent sort email and draft posts in your style
A Grok Bot handled inbox cleanup, wrote social drafts, and kept a workflow moving until it needed a decision.
Link a domain mailbox to Grok for customer mail
They used a custom mailbox plus a webhook so Grok Bot could handle incoming customer messages from their own domain.
Bundle monthly invoices for review before sending
A scheduled bot pulls details from invoice PDFs, groups them by month, and waits for approval before forwarding anything to the accountant.
Track calls and local leads for a service business
A home service business used an agent to summarize calls, surface follow-ups, and watch local Reddit posts for possible customers.
Set up weekday helper bots and a morning digest
One prompt created five weekday assistants plus a 9:00 digest that pulled their work into one update.