René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Test with comment 'This test fails because ... java.lang.ArithmeticException' does not fail","articleBody":"**Description**\r\n\r\nUTBot could find situations which leads to arithmetic overflow and generate tests for such cases adding comment that such test would fail, but actually such test pass.\r\n\r\n**To Reproduce**\r\n\r\nSteps to reproduce the behavior:\r\n\r\n1. Open `utbot`  project in IntelliJ Idea\r\n2. In UTBot settings set `Overflow detection:` to `Treat overflows as errors`\r\n3. Set `Test generated method` to 100 % `Symbolic`\r\n4. Generate tests for `org.utbot.examples.math.OverflowExamples#intOverflow` method\r\n5. Open the generated test\r\n\r\n**Expected behavior**\r\n\r\nEither UTBot generates test which causes ArithmeticException during execution \r\nOr it doesn't write that test should fail\r\n\r\n**Actual behavior**\r\n\r\nTest which are supposed to generate errors are generated, but during execution they pass.\r\n\r\nSample of such test:\r\n```java\r\n    @Test\r\n    @DisplayName(\"intOverflow: x * x * x \u003e 0 -\u003e ThrowArithmeticException\")\r\n    public void testIntOverflow_ThrowArithmeticException() {\r\n        OverflowExamples overflowExamples = new OverflowExamples();\r\n\r\n        /* This test fails because method [org.utbot.examples.math.OverflowExamples.intOverflow] produces [java.lang.ArithmeticException: int  *  overflow] */\r\n        overflowExamples.intOverflow(-11086, 0);\r\n    }\r\n```\r\n\r\n**Visual proofs (screenshots, logs, images)**\r\n\r\n![image](https://user-images.githubusercontent.com/10035839/199029014-c254a4d0-1901-4528-95cb-fa07a6696948.png)\r\n\r\n**Additional context**\r\n\r\nSo this case is more about how to properly present results of UTBot finding. Currently there are at least two problems:\r\n* incorrect comment that test fails\r\n* as test pass it would be difficult to find such test in case of bulk test generation, so overflow problem could be left unnoticed.\r\nProbably we should add `fail()` to such test, so it would actually fail and draw user attention.\r\n","author":{"url":"https://github.com/tyuldashev","@type":"Person","name":"tyuldashev"},"datePublished":"2022-10-31T15:35:59.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/1272/UTBotJava/issues/1272"}