Turn a grocery list photo into a shopping cart

Let an agent read a handwritten list, choose the nearest store, and load the items into an online cart.

Done with ChatGPT Agentยท Intermediate

What they did
Timothy B. Lee asked ChatGPT Agent to work from a picture of a handwritten grocery list, with the buying items marked in red. The agent turned the image into text, selected Harris Teeter as the closest store, and began adding the products to the cart. When a safety check interrupted the Kroger login page, he said he would log in himself and then typed in his password.
How it went
It identified 15 of 16 items and added all 15 to the cart, but onions never made it in. An earlier run by Operator had reached only 13 of 16. The process hung at login after roughly six minutes, then the order was finished.
Tips
A human should still review the final cart, especially when the source is messy handwriting. If a login is blocked by a safety layer, taking over and entering the password can let the workflow continue.

Try it yourself with ChatGPT Agent

Look at this grocery-list image, turn the handwriting into a clean item list, and add the items to a cart at my closest store. If a login, payment, or final submission step appears, stop and ask me to take over before you proceed. Show me the items you found and wait for my approval before you place the order. Use [image], [store preference], and [pickup or delivery].

Fill in the [brackets]. Agents can make mistakes, so review anything before it is sent, paid or deleted.

Read the original on understandingai.org โ†—

Get 3 agent uses like this every morning

With the day's top AI news. Free, and one click to unsubscribe.