Oriel — AI & technology worth noticing, every day.

Clear daily game tasks in Honkai: Star Rail by computer use

Web page · https://agentusecases.ai/use-case/clear-daily-game-tasks-in-honkai-star-rail-by-computer-use

Done with Claude computer use. NUS researchers had Claude Computer Use open menus, pick a stage, set run counts and start auto-battle in Honkai: Star Rail, and it also managed decks in Hearthstone.

First seen by Oriel on .

AI summary

NUS researchers used Claude Computer Use to automate daily Honkai: Star Rail tasks from screenshots, while testing showed failures on some fine-grained interfaces.

  • The framework used the Claude Computer Use API, live screenshots, and previous screenshots as context to operate graphical interfaces.
  • In Honkai: Star Rail, Claude opened menus, selected Golden Calyx, configured six challenge runs, started auto-battle, waited, and exited.
  • The system also created and renamed Hearthstone decks, but failed on some detailed web actions and selecting text fields in Word and PowerPoint.
  • Tests covered 20 tasks across 12 apps or sites on Windows and macOS, with humans monitoring the runs.
  • The suggested prompt instructs Claude to describe screens, stop unexpectedly, and request confirmation before spending in-game currency or making purchases.

#computer use #gui automation #honkai: star rail #hearthstone

Generated by gpt-5.6-sol. Check the original for details.

Aliases

SourceExternal IDURL
Agent Use Caseshttps://agentusecases.ai/use-case/clear-daily-game-tasks-in-honkai-star-rail-by-computer-usehttps://agentusecases.ai/use-case/clear-daily-game-tasks-in-honkai-star-rail-by-computer-use Read discussion