Guide a game agent through Goat Simulator 3
SIMA 2 in Goat Simulator 3 can be nudged by a person giving live directions.
- What they did
- Google DeepMind created SIMA 2, a Gemini-based agent for open-ended games that has to deal with messy, changing situations. In Goat Simulator 3, it can move around the game world, and a human player can give it instructions to steer how it behaves.
- How it went
- The piece does not share any scores, trials, or finished tasks. It only says the agent is working in Goat Simulator 3 and that human input can help it improve.
- Tips
- Break the job into small directions and pause often to correct course. Before any step that could be hard to undo, make the agent stop and ask for approval.
Try it yourself with Gemini
I’m running [game name] on this machine. Use the keyboard and mouse to get to [place or goal] while I guide you. If you’re unsure what to do next, ask me for the next instruction and wait. Before you do anything irreversible, such as spending resources, deleting progress, or submitting something, stop and ask for my approval first. Keep going until you reach the goal or I say to stop.
Fill in the [brackets]. Agents can make mistakes, so review anything before it is sent, paid or deleted.
1 more report of this
Get 3 agent uses like this every morning
With the day's top AI news. Free, and one click to unsubscribe.
Related agent uses
Build an HTML5 browser game in small steps
A developer used Gemini to assemble a browser game, then recovered from stalled chats by restarting and reloading the code context.
Build an agent to play Pokémon Blue from RAM and screenshots
Joel Zhang wired Gemini 2.5 Pro into a Game Boy emulator so it could read game state and press buttons in Pokémon Blue.
Pit three agents against a browser shooter build
Three coding agents independently built the same multiplayer shooter, letting the team compare their strengths and weak spots.
Build a browser 4X game with LLM help
A developer used Grok and Gemini to assemble Hexwardia, a browser-based 4X game, in two weeks.
Test screenshot-to-click scaling in a simple web game
A developer used Gemini with Playwright to confirm that click coordinates lined up with the browser view.
Build a text game around AI narration
A developer used Grok to narrate a choice-based game and said it handled story text better than Gemini and GPT.