Successful test reports failure

Best practices, code snippets for common functionality, examples, and guidelines.
HansSchl
Posts: 143
Joined: Wed Sep 19, 2018 10:05 am

Successful test reports failure

Post by HansSchl » Wed Sep 22, 2021 9:15 am

Hi,

I am unattended tests on a remote machine under the Rx Agent. When I look at the results, using the "Remote" tab of Rx Studio, I see a few tests cases marked as "failed". While there is good reason for some, one of them hasn't failed. The test report is all green, and not a single step reports and problems, not even a warning. When I repeat the test, it may be or may not succeed.

The run in question is reported to TestRail as "passed".

Using Ranorex 9.5.1 under Windows 10.

Best regards
Hans

User avatar
odklizec
Ranorex Guru
Ranorex Guru
Posts: 7470
Joined: Mon Aug 13, 2012 9:54 am
Location: Zilina, Slovakia

Re: Successful test reports failure

Post by odklizec » Wed Sep 22, 2021 9:19 am

Hi Hans,

Please try to reproduce the problem with most recent 10.1.1. Version 9.5.1. is already outdated and no longer supported. There is always a chance the problem you are experiencing in 9.5.1. is already fixed in recent version ;)
Pavel Kudrys
Ranorex explorer at Descartes Systems

Please add these details to your questions:
  • Ranorex Snapshot. Learn how to create one >here<
  • Ranorex xPath of problematic element(s)
  • Ranorex version
  • OS version
  • HW configuration

HansSchl
Posts: 143
Joined: Wed Sep 19, 2018 10:05 am

Re: Successful test reports failure

Post by HansSchl » Wed Nov 24, 2021 2:37 pm

Thanks Pavel, I upgraded a few days ago. Since the problem occurred only now and then, I'll watch test execution for a while and report back. Let's hope the issue is gone :-)

HansSchl
Posts: 143
Joined: Wed Sep 19, 2018 10:05 am

Re: Successful test reports failure

Post by HansSchl » Fri Dec 10, 2021 2:59 pm

Unfortunately the problem is still here.
* Ranorex 10.1.3
* Test reports "failed" in the Remote panel of Ranorex Studio
* Test report (rxzlog file) contains success for each test of the suite
* Console output during test execution end with a line "Job completed: Success"
I'm going to create a support ticket...