René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"🐞: [JUnit 5] Incorrect suite status in Allure report when @BeforeAll fails on first run but passes on retry","articleBody":"### What happened?\n\nWe are using JUnit 5 with Gradle and the [test-retry-gradle-plugin](https://github.com/gradle/test-retry-gradle-plugin) plugin to rerun failed tests. We encountered an issue with Allure reports where a test class is still marked as \"failed\" even though all tests passed on retry.\n\n**Problem**\nIf @BeforeAll fails in the first run, no tests inside the class are executed.\nOn retry, @BeforeAll succeeds, and all tests pass.\n\nIn the Allure report:\n- All individual tests are marked as passed ✅.\n- But the entire test class is still marked as failed ❌.\n\u003cimg width=\"1395\" alt=\"Image\" src=\"https://github.com/user-attachments/assets/e7fa1921-8dad-4377-b796-51be594aea79\" /\u003e\n\n\n\n:confused: This creates confusion in reports and CI pipelines, because the actual final result is 100% passed.\n\n✅ Desired Behavior\nIf @BeforeAll fails during the first attempt but succeeds on retry, it should not appear in the Allure report.\n\nIf @BeforeAll fails during all retry attempts, the current behavior is correct — the test class should be marked as failed.\n\n**The easiest way to reproduce:**\n\n1. Create a test class like this:\n\n```\n@TestInstance(TestInstance.Lifecycle.PER_CLASS)\nclass RetryBeforeAllTest {\n\n    @BeforeAll\n    void beforeAll() {\n        throw new RuntimeException(\"Simulated failure in @BeforeAll\");\n    }\n\n    @Test\n    void test1() {\n        Assertions.assertTrue(true);\n    }\n\n    @Test\n    void test2() {\n        Assertions.assertTrue(true);\n    }\n\n    @Test\n    void test3() {\n        Assertions.assertTrue(true);\n    }\n\n}\n```\n\n2. Run the test suite once — it will fail due to @BeforeAll.\n3. Then comment out the exception in @BeforeAll, and run the test suite again.\n4. Generate Allure report (execute allureServe for example)\n\n### What Allure Integration are you using?\n\nallure-junit5\n\n### What version of Allure Integration you are using?\n\n2.29.1\n\n### What version of Allure Report you are using?\n\n2.29.1\n\n### Code of Conduct\n\n- [x] I agree to follow this project's Code of Conduct","author":{"url":"https://github.com/yevhenii-odd","@type":"Person","name":"yevhenii-odd"},"datePublished":"2025-04-08T09:58:47.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/1155/allure-java/issues/1155"}