Agent Performance Testing (APT)
NeoLoad Web includes Agent Performance Testing (APT), an AI agent that analyzes your test results on demand. In the product, APT appears as the
AI Chat button in the navigation bar on every page. When a user selects it, APT opens as a side panel on the right, and the main content area adjusts so users can work with APT and their test data at the same time. As an administrator, you control which users can run APT - Analysis through the AI Chat column in the Users grid.
This lets you roll out APT - Analysis to your teams in a controlled way, manage AI credit consumption, and meet compliance requirements for AI usage.
Users without access see the AI Chat button, but it's disabled. When they select it, the panel shows a message that APT - Analysis is a new feature and directs them to contact their administrator for access. The button stays visible so users know the feature exists and who to ask.
APT is consumption-based. Each run uses credits in proportion to the amount of information the agent processes.
Before you start
To manage APT - Analysis access, make sure you have:
-
An Account Admin or NeoLoad Admin role.
-
APT - Analysis enabled for your account. If, as an admin, you don't see the AI Chat column in Settings > Users, contact your Tricentis representative.
Run an APT - Analysis
APT - Analysis is the workflow that turns one test result into an AI report. To run it, follow these steps:
-
Open a test result.
-
Select the AI Chat button in the top navigation bar to open APT.
-
Select Create performance analysis.
APT opens the AI report tab and builds the analysis. A progress tracker shows the agent's status while it prepares the report.
Approve an APT report
Every new APT report has the status For review. This shows that the report contains AI-generated findings that still need human review. Validate the findings, then approve the report to mark them as verified.
Any NeoLoad Webuser can approve reports, including users without APT - Analysis access.
To approve a report, open it from the AI report tab of a test result, or from the Dashboards page. Verify the findings, then select Approve.
If someone edits a report after approval, the status shows the edit date next to the approval date. Approve the report again to cover the new content.
Note that you can't delete approved reports from the AI report tab. To delete an approved report, go to the Dashboards page.
Review details
The report status appears wherever you access the report. The available details depend on the view:
|
View |
What you see |
|---|---|
|
AI report tab |
The status next to the report name. Hover over it for the approver's name, the approval date, and the date of the last edit. |
|
Dashboards page and tab |
The status of every APT report in the AI status column. Hover over a status for the same details, plus a note that the report includes AI-generated content. |
|
Public link |
The current status as a badge, without the review details. |
|
PDF export |
The status at the time of the export, shown as a badge with the export date. |
Control APT - Analysis access
AI Chat access covers everything APT does for that user. Alongside an APT - Analysis, the user asks the APT Performance Assistant to run and stop tests, change the load, and reassign zones. Access also covers workspaces and usage. The user reads workspace membership and quotas, and changes a workspace or its limits. APT reaches only the workspaces, tests, and results that the user's own permissions allow. It also asks the user to approve every change before it runs.
The Users grid in Settings > Users includes an AI Chat column. Select or clear the checkbox for a user to grant or remove their access. The change takes effect on the user's next page load.
To update multiple users at once, select them in the grid, then open the actions menu and select Enable AI Chat Access or Disable AI Chat Access. You can use the Filtering options to narrow the list by role, workspace, or AI Chat status.
When you invite a new user, select the AI Chat access checkbox in the invitation dialog. The user has APT - Analysis access as soon as they accept the invitation.
Troubleshoot APT - Analysis issues
If users report problems with APT - Analysis, check the following common issues:
Check the AI Chat column in Settings > Users. If the checkbox is cleared, select it to grant access.
The APT - Analysis feature flag may not be enabled for your account. Contact your Tricentis representative to enable it.
Ask the user to refresh their browser. Changes apply on the next page load.
The AI Chat access checkbox may not have been selected during the invitation. Grant access from the Users grid.
Verify that you have admin permissions and that the selected users have active accounts. Try again with a smaller selection to isolate the issue.
Verify that the user's account is active and that your account has available AI credits. Check Settings > Subscription for credit usage.
The user's browser is blocking local network access for NeoLoad Web. Ask the user to allow it in their browser:
-
Select the View site information button next to the address bar, then select Site settings.
-
Under Permissions, set Local network to Allow.
-
Refresh the page and open AI Chat again.
If the panel still doesn't load, check whether the user is on a VPN such as Zscaler. Ask them to restart the VPN and refresh the page.
What's next
Now that you've configured APT - Analysis access for your team, here's what you can do next:
-
Use AI Chat to see what your team works with once you grant access.
-
Explore the AI features available in NeoLoad Web to understand how your team can use APT - Analysis.
-
Learn how to analyze test results, where users run an APT - Analysis.
-
Manage your users to update roles and workspace assignments.