46,175 questions
This issue has now been resolved following an update to the Azure Load Environment via product team.
Azure Load Testing Preview - Load Tests Return 'Not Applicable' Failed status despite showing as successful in Exported Result Files & AppInsights
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 18%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECT%3C/text%3E%3C/svg%3E)
Chris Tyler
1
Reputation point
We are currently running a POC on the new Azure Load Testing feature (currently in preview) as a resource to run our jMeter tests against an in development API.
Unfortunately we are hitting a few problems with the output results displayed within a test run, namely the tests always fail with no start, end and duration time along with a 'Not Applicable' status when running against the APIs despite all tests running successfully directly within the jMeter GUI. The same tests when run in the Azure Load Testing tool also appear to show as 'Passed' when exporting results from the test screen.
Has anyone experienced this before and would be able to help, as this tool could be exactly what we are looking for if we can get it to output the correct results.
Our jMeter test is fairly simple and obtains a validation token which is used in the latter request, I have manually verified this is all authenticating correctly and the variables we are using in these tests are being correctly populated when run in Azure.
See attached screenshots:
Test Result
Exported Result
We have also attempted to use the 'Ultimate Thread Group' plugin following a suggestion on StackOverflow, but unfortunately this also appears to return the same results (passes when run locally or through Blazemeter) but returns no result in Azure Load Testing despite the requests returning a successful result in AppInsights.
If anyone would be able to help at all this would be greatly appreciated. Unfortunately at the moment this is preventing us from reccomending Azure as a tool for our upcoming Load Testing strategy.
Community Center Not monitored
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 43%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Monalla-MSFT 13,071 Reputation points Moderator2022-01-13T02:37:36.967+00:00 @Chris Tyler - Thanks for reaching out and for being patient.
Apologies for the delay in response. I have reached out to the product team and was requested to raise an issue in their Github Repo, so i have raised it on your behalf.
I will keep track of the issue and will post any findings here.
Thank you for your cooperation and patience while we work through resolving this issue.
-
Chris Tyler 1 Reputation point
2022-01-13T08:03:39.837+00:00 Thank you for your help with this issue @Monalla-MSFT .
Since raising this issue we have since carried out some additional investigations on our side and noticed that there appears to be a particular issue when using the GraphQL HTTP Request type that was added to jMeter in version 5.4. When using this type of request for a valid graphQL query. The request is processed successfully locally within jMeter and also within Blazemeter, but not within the Azure Load Testing tool (which provides the issues displayed above).
I have since been able to get a valid response from the Azure Load Tester, when I submit my GraphQL requests directly within the body of a standard HTTP Request and with the 'Ultimate Thread Group' plugin (without this the response fails). Would it be possible to confirm if the GraphQL HTTP Request type from JMeter is currently supported for the Azure Load Testing tool, or if this is planned as part of a future update?
Many thanks
Sign in to comment
2 answers
Sort by: Most helpful
-
-
Monalla-MSFT 13,071 Reputation points Moderator
2022-01-27T23:01:55.897+00:00 @Chris Tyler - Thanks for patiently working with us offline in the GitHub Repo,
After looking at the test results you sent us, we figured that we have fixed those issues in the last couple of weeks.
and when asked to run the test again, you confirmed that the tests are passing now and displaying full test results.
Hope that helped resolve your issue.
---------------------------------------------
If the above response was helpful, please feel free to "Accept as Answer" and "upvote" so it can be beneficial to the community.