Executive Summary

We demonstrated nunu.ai's powerful AI testing capabilities, Using Hogwarts Legacy, one of 2023's biggest releases ($1B+ revenue). Our agents successfully automated complex gameplay sequences including the 30-minute tutorial section, showcasing the potential for game testing automation.

About Hogwarts Legacy

Hogwarts Legacy is an open-world action RPG set in the wizarding world of Harry Potter. Developed by Avalanche Software in Unreal Engine 4 with an estimated budget of $150 million, it has sold over 30 million copies since its February 2023 release.

About nunu.ai

nunu.ai provides AI agents that play games like humans do - by looking at the screen and using keyboard and mouse inputs. Instead of maintaining complex scripts, teams can simply tell the agent what to test in plain English. Whether it's "Complete the tutorial" or "Verify healing mechanics," our agents understand and execute these tasks without breaking when the game updates. While our AI agents can test some games immediately, most titles benefit from our SDK integration. By connecting to the development build, we enhance the agent's capabilities through access to game states and functions. This lightweight integration enables more comprehensive testing while requiring minimal setup effort. Our AI agents to not require any kind of training for the games they are testing.

Results

After integration, we instructed the AI agent to complete the entire tutorial. You can watch the run in this [YouTube video], which highlights what the AI agent was “thinking” at each step. Remember: This AI agent has never seen this game before nor was it trained on it Here are a few key highlights:

General world understanding: At the very start, the player begins in a dark cave with no clear instructions. Thanks to nunu.ai’s AI agent's general world understanding, it intuitively followed the other character and moved toward the light. (Video)

Strategic thinking: Toward the end of the tutorial, the player must fight a group of statues. The AI agent successfully defeats them by blocking attacks, repositioning, and casting spells. (Video)

Adaptability: The AI agent continuously encounters in-game popups that must be acknowledged before proceeding. Conventional scripts would fail here if they weren’t updated to handle it. However, the AI agent adapt<s seamlessly to unseen situations: pressing space for two seconds to clear the popup, then continuing to complete the tutorial. (Video)

Outcome

• Successful completion of the entire tutorial: The AI agent seamlessly navigated the 30-minute introductory sequence, showcasing its ability to adapt to complex, dynamic environments.
• Demonstration of the AI agent’s reasoning: The video highlights the agent's step-by-step “thinking,” giving developers insight into its decision-making process.
• Dynamic problem-solving: The agent successfully handled a wide variety of challenges, from combat scenarios to environmental puzzles, without any prior training or game-specific scripting.
• Reduction in manual effort: What would typically require hours of manual playtesting was completed automatically, freeing developers to focus on other priorities.