Clear daily game tasks in Honkai: Star Rail by computer use
Web page · https://agentusecases.ai/use-case/clear-daily-game-tasks-in-honkai-star-rail-by-computer-use
Done with Claude computer use. NUS researchers had Claude Computer Use open menus, pick a stage, set run counts and start auto-battle in Honkai: Star Rail, and it also managed decks in Hearthstone.
First seen by Oriel on .
AI summary
NUS researchers used Claude Computer Use to automate daily Honkai: Star Rail tasks from screenshots, while testing showed failures on some fine-grained interfaces.
- The framework used the Claude Computer Use API, live screenshots, and previous screenshots as context to operate graphical interfaces.
- In Honkai: Star Rail, Claude opened menus, selected Golden Calyx, configured six challenge runs, started auto-battle, waited, and exited.
- The system also created and renamed Hearthstone decks, but failed on some detailed web actions and selecting text fields in Word and PowerPoint.
- Tests covered 20 tasks across 12 apps or sites on Windows and macOS, with humans monitoring the runs.
- The suggested prompt instructs Claude to describe screens, stop unexpectedly, and request confirmation before spending in-game currency or making purchases.
#computer use #gui automation #honkai: star rail #hearthstone
Generated by gpt-5.6-sol. Check the original for details.
Aliases
| Source | External ID | URL |
|---|---|---|
| Agent Use Cases | https://agentusecases.ai/use-case/clear-daily-game-tasks-in-honkai-star-rail-by-computer-use | https://agentusecases.ai/use-case/clear-daily-game-tasks-in-honkai-star-rail-by-computer-use Read discussion |