Title: TestNG retries are marked as Skipped and the test itself is not marked as Flaky Test · Issue #452 · allure-framework/allure-java · GitHub
Open Graph Title: TestNG retries are marked as Skipped and the test itself is not marked as Flaky Test · Issue #452 · allure-framework/allure-java
X Title: TestNG retries are marked as Skipped and the test itself is not marked as Flaky Test · Issue #452 · allure-framework/allure-java
Description: I'm submitting a ... bug report feature request support request => Please do not submit support request here, see note at the top of this template. What is the current behavior? Tests that failed and then success after re-run using TestN...
Open Graph Description: I'm submitting a ... bug report feature request support request => Please do not submit support request here, see note at the top of this template. What is the current behavior? Tests that failed a...
X Description: I'm submitting a ... bug report feature request support request => Please do not submit support request here, see note at the top of this template. What is the current behavior? Tests that f...
Opengraph URL: https://github.com/allure-framework/allure-java/issues/452
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"TestNG retries are marked as Skipped and the test itself is not marked as Flaky Test","articleBody":"[//]: # (\r\n. Note: for support questions, please use Stackoverflow or Gitter**. \r\n. This repository's issues are reserved for feature requests and bug reports.\r\n.\r\n. In case of any problems with Allure Jenkins plugin** please use the following repository \r\n. to create an issue: https://github.com/jenkinsci/allure-plugin/issues\r\n.\r\n. Make sure you have a clear name for your issue. The name should start with a capital \r\n. letter and no dot is required in the end of the sentence. An example of good issue names:\r\n.\r\n. - The report is broken in IE11\r\n. - Add an ability to disable default plugins\r\n. - Support emoji in test descriptions\r\n)\r\n\r\n#### I'm submitting a ... \r\n - [X] bug report\r\n - [ ] feature request\r\n - [ ] support request => Please do not submit support request here, see note at the top of this template.\r\n\r\n#### What is the current behavior?\r\nTests that failed and then success after re-run using TestNG retryAnalyzer marked as skipped and not showing the Flaky Test (bomb) icon.\r\n\r\n\r\n\r\n\r\n#### If the current behavior is a bug, please provide the steps to reproduce and if possible a minimal demo of the problem\r\nThe retry impl class\r\n\r\n\tpublic class RetryAnalyzerImpl implements IRetryAnalyzer {\r\n\t\tprivate int maxRetryCount = 3;\r\n\t\tprivate int retryCount = 0;\r\n\r\n\t\tpublic boolean retry(ITestResult result) {\r\n\t\t\tif (retryCount \u003c maxRetryCount) {\r\n\t\t\t\tretryCount++;\r\n\t\t\t\treturn true;\r\n\t\t\t}\r\n\t\t\treturn false;\r\n\t\t}\r\n\t}\r\n \r\nThe test method\r\n\r\n\t@Test(retryAnalyzer= RetryAnalyzerImpl.class)\r\n\tpublic void VerifyRetrievePublicaAndActiveCommunity(){\r\n\t\tint i = ThreadLocalRandom.current().nextInt(0, 2);\r\n\t\tSystem.out.println(i);\r\n\t\tAssert.assertEquals(i,0);\r\n\t}\r\n\r\n\r\n#### What is the expected behavior?\r\nThe retries are marked as Failed correctly. And the tests are marked as Flaky.\r\n\r\n#### What is the motivation / use case for changing the behavior?\r\n\r\n\r\n#### Please tell us about your environment:\r\n\r\n\r\n| Allure version | 2.13.3 |\r\n| Test framework | testng@7.1.0 |\r\n| Allure integration | allure-testng@2.13.3 |\r\n| Generate report using | allure windows cli@2.13.3 |\r\n\r\n#### Other information \r\n\r\n[//]: # (\r\n. e.g. detailed explanation, stacktraces, related issues, suggestions \r\n. how to fix, links for us to have more context, eg. Stackoverflow, Gitter etc\r\n)\r\n","author":{"url":"https://github.com/marvelfrozen","@type":"Person","name":"marvelfrozen"},"datePublished":"2020-06-18T05:18:47Z","url":"https://github.com/allure-framework/allure-java/issues/452"}
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:d00219b4-f3c3-fc38-497a-67983b8b742e |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | A32E:37EB8F:25E4DF5:34EAC94:6AFD476A |
| html-safe-nonce | a883bb6ef2c9a3b12b48c4de3b640aef80fdf9fd714ed0b6d831908dd2340f52 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBMzJFOjM3RUI4RjoyNUU0REY1OjM0RUFDOTQ6NkFGRDQ3NkEiLCJ2aXNpdG9yX2lkIjoiNzIxNTI1NDc0OTM1MDU0NTI1OCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | abf4996e7b9b5971879dd14cfcc32b1ce5e3e6ea70a22f2e0d36c689a38f5bdb |
| hovercard-subject-tag | issue:640914844 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/allure-framework/allure-java/452/issue_layout |
| twitter:image | https://opengraph.githubassets.com/b535daf204322a3b44785e62c680db67b094765cde98cee12d834c29ff4d0ad9/allure-framework/allure-java/issues/452 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/b535daf204322a3b44785e62c680db67b094765cde98cee12d834c29ff4d0ad9/allure-framework/allure-java/issues/452 |
| og:image:alt | I'm submitting a ... bug report feature request support request => Please do not submit support request here, see note at the top of this template. What is the current behavior? Tests that failed a... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | marvelfrozen |
| hostname | github.com |
| expected-hostname | github.com |
| None | bdbacc25b921224ff0befcb9e629560a1255be51aec9991d6e3f95b5e9151474 |
| turbo-cache-control | no-preview |
| go-import | github.com/allure-framework/allure-java git https://github.com/allure-framework/allure-java.git |
| octolytics-dimension-user_id | 5879127 |
| octolytics-dimension-user_login | allure-framework |
| octolytics-dimension-repository_id | 80822758 |
| octolytics-dimension-repository_nwo | allure-framework/allure-java |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 80822758 |
| octolytics-dimension-repository_network_root_nwo | allure-framework/allure-java |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 556dd37bb0aceffb25724e151b5d858b3265b40b |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | issues |
Links:
Viewport: width=device-width