Next Steps to Level Up

After running your first successful tests, here are a few ways to get more out of nunu.ai.

If you haven’t already, check out our Quickstart guide to run your first test.

Setting up Scheduled Tests

The next step is creating more test cases and putting them into a test plan. Go to Tests -> Test Plans and create a new test plan.

The agent can take quite some time to complete a full test plan run, so what you can do is schedule it to run overnight. Instead of manually starting the test plan, you can create a trigger under Configs -> Triggers. This will allow you to repeatedly run the test plan at a specified interval. For example, every night, or every monday, wednesday, and friday.

Then you just have to review the results the next morning.

Follow the steps here to learn how to set up scheduled tests.

CI/CD Integration

What’s the point in testing the same build over and over again? You can integrate uploading to our Build Storage into your CI/CD pipeline and automatically schedule tests to run as soon as a new build is ready.

We support a variety of ways to integrate into your CI/CD: the nunu-cli, api or even a jenkins plugin. Go to CI/CD Integrations and find what works best for you.

Bug Review & Tracking

After having CI/CD set up and the agent running for a few days, you’ll start seeing duplicate bugs or the same false positives. To avoid this, use the Bug Review & Tracking feature. Bug Review lets you go through runs, mark bugs, and create learnings so the agent doesn’t report them again.

It’s the most effective way to reduce noise and improve the quality of your test results.

Knowledge Base

Another way to enhance the agent’s performance is by using the Knowledge Base feature.

How is the agent supposed to know what’s expected behavior and what’s not? The Knowledge Base allows you to store and share information about your game, such as game mechanics, design documents, and feature specs. Providing high-quality information in the Knowledge Base helps the agent understand your game better and make more accurate bug reports.

SDK Integration

The NunuSDK lets you expose cheat functions to the AI Agent, surface game engine errors, and feed additional information that isn’t visible on the screen. This makes the AI Agent faster and more effective.

Reach out to the nunu team to discuss if it makes sense for your game or to get access to the SDK.