René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Multiple time out tests are generated by fuzzer","articleBody":"**Description**\r\n\r\nSince #2583 fuzzer is able to construct quite complex arguments for method under test, that can take quite some time to actually create, while instrumnted-process marks executions as timed out even if the thing that actually timed out is the argument creation prior to method under test invocation.\r\n\r\n**To Reproduce**\r\n\r\n* Use UtBot version from #2583\r\n* Generate tests with fuzzing set to `100%` for the following method\r\n```java\r\npublic static boolean isNull(CharSequence charSequence) {\r\n    if (charSequence == null) return true;\r\n    else return false;\r\n}\r\n```\r\n\r\n**Expected behavior**\r\n\r\nTwo successful test and no time out test.\r\n\r\n**Actual behavior**\r\n\r\nTwo successful test and 10 time out test.\r\n\r\n**Visual proofs**\r\n\r\n~~~java\r\npublic final class ClassUnderTestTest {\r\n    ///region Test suites for executable org.example.ClassUnderTest.isNull\r\n\r\n    ///region FUZZER: SUCCESSFUL EXECUTIONS for method isNull(java.lang.CharSequence)\r\n\r\n    /**\r\n     * @utbot.classUnderTest {@link ClassUnderTest}\r\n     * @utbot.methodUnderTest {@link ClassUnderTest#isNull(CharSequence)}\r\n     */\r\n    @Test\r\n    @DisplayName(\"isNull: arg_0 = null -\u003e return true\")\r\n    public void testIsNullReturnsTrue() {\r\n        boolean actual = ClassUnderTest.isNull(null);\r\n\r\n        assertTrue(actual);\r\n    }\r\n\r\n    /**\r\n     * @utbot.classUnderTest {@link ClassUnderTest}\r\n     * @utbot.methodUnderTest {@link ClassUnderTest#isNull(CharSequence)}\r\n     */\r\n    @Test\r\n    @DisplayName(\"isNull: arg_0 = '10\\uFFFC' (mutated from '10') -\u003e return false\")\r\n    public void testIsNullReturnsFalseWithNonEmptyString() {\r\n        boolean actual = ClassUnderTest.isNull(\"10\\uFFFC\");\r\n\r\n        assertFalse(actual);\r\n    }\r\n    ///endregion\r\n\r\n    ///region FUZZER: TIMEOUTS for method isNull(java.lang.CharSequence)\r\n\r\n    /**\r\n     * @utbot.classUnderTest {@link ClassUnderTest}\r\n     * @utbot.methodUnderTest {@link ClassUnderTest#isNull(CharSequence)}\r\n     */\r\n    @Test\r\n    @DisplayName(\"isNull: arg_0 = InetAddress.getCanonicalHostName()\")\r\n    @Timeout(value = 1000L, unit = TimeUnit.MILLISECONDS)\r\n    public void testIsNull() throws UnknownHostException {\r\n        byte[] byteArray = {Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE};\r\n        InetAddress inetAddress = getByAddress(byteArray);\r\n        byte[] byteArray1 = {Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE};\r\n        inetAddress.getByAddress(byteArray1);\r\n        inetAddress.getLocalHost();\r\n        inetAddress.getByName(\"\");\r\n        byte[] byteArray2 = {Byte.MIN_VALUE, (byte) 0, (byte) -1};\r\n        inetAddress.getByAddress(\"-3\", byteArray2);\r\n        inetAddress.getLoopbackAddress();\r\n        String charSequence = inetAddress.getCanonicalHostName();\r\n        \r\n        /* This execution may take longer than the 1000 ms timeout\r\n         and therefore fail due to exceeding the timeout. */\r\n        assertTimeoutPreemptively(Duration.ofMillis(1000L), () -\u003e ClassUnderTest.isNull(charSequence));\r\n    }\r\n\r\n    /**\r\n     * @utbot.classUnderTest {@link ClassUnderTest}\r\n     * @utbot.methodUnderTest {@link ClassUnderTest#isNull(CharSequence)}\r\n     */\r\n    @Test\r\n    @DisplayName(\"isNull: arg_0 = InetAddress.getCanonicalHostName()\")\r\n    @Timeout(value = 1000L, unit = TimeUnit.MILLISECONDS)\r\n    public void testIsNull1() throws UnknownHostException {\r\n        byte[] byteArray = {Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE};\r\n        InetAddress inetAddress = getByAddress(byteArray);\r\n        byte[] byteArray1 = {Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE};\r\n        inetAddress.getByAddress(byteArray1);\r\n        inetAddress.getLocalHost();\r\n        inetAddress.getByName(\"\");\r\n        byte[] byteArray2 = {Byte.MIN_VALUE, (byte) 0, (byte) -1};\r\n        inetAddress.getByAddress(\"-3\", byteArray2);\r\n        inetAddress.getLoopbackAddress();\r\n        String charSequence = inetAddress.getCanonicalHostName();\r\n        \r\n        /* This execution may take longer than the 1000 ms timeout\r\n         and therefore fail due to exceeding the timeout. */\r\n        assertTimeoutPreemptively(Duration.ofMillis(1000L), () -\u003e ClassUnderTest.isNull(charSequence));\r\n    }\r\n\r\n    /**\r\n     * @utbot.classUnderTest {@link ClassUnderTest}\r\n     * @utbot.methodUnderTest {@link ClassUnderTest#isNull(CharSequence)}\r\n     */\r\n    @Test\r\n    @DisplayName(\"isNull: arg_0 = InetAddress.getCanonicalHostName()\")\r\n    @Timeout(value = 1000L, unit = TimeUnit.MILLISECONDS)\r\n    public void testIsNull2() throws UnknownHostException {\r\n        byte[] byteArray = {Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE};\r\n        InetAddress inetAddress = getByAddress(byteArray);\r\n        inetAddress.getByName(\"\");\r\n        String charSequence = inetAddress.getCanonicalHostName();\r\n        \r\n        /* This execution may take longer than the 1000 ms timeout\r\n         and therefore fail due to exceeding the timeout. */\r\n        assertTimeoutPreemptively(Duration.ofMillis(1000L), () -\u003e ClassUnderTest.isNull(charSequence));\r\n    }\r\n\r\n    /**\r\n     * @utbot.classUnderTest {@link ClassUnderTest}\r\n     * @utbot.methodUnderTest {@link ClassUnderTest#isNull(CharSequence)}\r\n     */\r\n    @Test\r\n    @DisplayName(\"isNull: arg_0 = InetAddress.getCanonicalHostName()\")\r\n    @Timeout(value = 1000L, unit = TimeUnit.MILLISECONDS)\r\n    public void testIsNull3() throws UnknownHostException {\r\n        byte[] byteArray = {Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE};\r\n        InetAddress inetAddress = getByAddress(byteArray);\r\n        String charSequence = inetAddress.getCanonicalHostName();\r\n        \r\n        /* This execution may take longer than the 1000 ms timeout\r\n         and therefore fail due to exceeding the timeout. */\r\n        assertTimeoutPreemptively(Duration.ofMillis(1000L), () -\u003e ClassUnderTest.isNull(charSequence));\r\n    }\r\n\r\n    /**\r\n     * @utbot.classUnderTest {@link ClassUnderTest}\r\n     * @utbot.methodUnderTest {@link ClassUnderTest#isNull(CharSequence)}\r\n     */\r\n    @Test\r\n    @DisplayName(\"isNull: arg_0 = InetAddress.getCanonicalHostName()\")\r\n    @Timeout(value = 1000L, unit = TimeUnit.MILLISECONDS)\r\n    public void testIsNull4() throws UnknownHostException {\r\n        byte[] byteArray = {Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE};\r\n        InetAddress inetAddress = getByAddress(byteArray);\r\n        String charSequence = inetAddress.getCanonicalHostName();\r\n        \r\n        /* This execution may take longer than the 1000 ms timeout\r\n         and therefore fail due to exceeding the timeout. */\r\n        assertTimeoutPreemptively(Duration.ofMillis(1000L), () -\u003e ClassUnderTest.isNull(charSequence));\r\n    }\r\n\r\n    /**\r\n     * @utbot.classUnderTest {@link ClassUnderTest}\r\n     * @utbot.methodUnderTest {@link ClassUnderTest#isNull(CharSequence)}\r\n     */\r\n    @Test\r\n    @DisplayName(\"isNull: arg_0 = InetAddress.getCanonicalHostName()\")\r\n    @Timeout(value = 1000L, unit = TimeUnit.MILLISECONDS)\r\n    public void testIsNull5() throws UnknownHostException {\r\n        byte[] byteArray = {Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE};\r\n        InetAddress inetAddress = getByAddress(byteArray);\r\n        String charSequence = inetAddress.getCanonicalHostName();\r\n        \r\n        /* This execution may take longer than the 1000 ms timeout\r\n         and therefore fail due to exceeding the timeout. */\r\n        assertTimeoutPreemptively(Duration.ofMillis(1000L), () -\u003e ClassUnderTest.isNull(charSequence));\r\n    }\r\n\r\n    /**\r\n     * @utbot.classUnderTest {@link ClassUnderTest}\r\n     * @utbot.methodUnderTest {@link ClassUnderTest#isNull(CharSequence)}\r\n     */\r\n    @Test\r\n    @DisplayName(\"isNull: arg_0 = InetAddress.getCanonicalHostName()\")\r\n    @Timeout(value = 1000L, unit = TimeUnit.MILLISECONDS)\r\n    public void testIsNull6() throws UnknownHostException {\r\n        byte[] byteArray = {Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE};\r\n        InetAddress inetAddress = getByAddress(byteArray);\r\n        String charSequence = inetAddress.getCanonicalHostName();\r\n        \r\n        /* This execution may take longer than the 1000 ms timeout\r\n         and therefore fail due to exceeding the timeout. */\r\n        assertTimeoutPreemptively(Duration.ofMillis(1000L), () -\u003e ClassUnderTest.isNull(charSequence));\r\n    }\r\n\r\n    /**\r\n     * @utbot.classUnderTest {@link ClassUnderTest}\r\n     * @utbot.methodUnderTest {@link ClassUnderTest#isNull(CharSequence)}\r\n     */\r\n    @Test\r\n    @DisplayName(\"isNull: arg_0 = InetAddress.getCanonicalHostName()\")\r\n    @Timeout(value = 1000L, unit = TimeUnit.MILLISECONDS)\r\n    public void testIsNull7() throws UnknownHostException {\r\n        byte[] byteArray = {Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE};\r\n        InetAddress inetAddress = getByAddress(byteArray);\r\n        String charSequence = inetAddress.getCanonicalHostName();\r\n        \r\n        /* This execution may take longer than the 1000 ms timeout\r\n         and therefore fail due to exceeding the timeout. */\r\n        assertTimeoutPreemptively(Duration.ofMillis(1000L), () -\u003e ClassUnderTest.isNull(charSequence));\r\n    }\r\n\r\n    /**\r\n     * @utbot.classUnderTest {@link ClassUnderTest}\r\n     * @utbot.methodUnderTest {@link ClassUnderTest#isNull(CharSequence)}\r\n     */\r\n    @Test\r\n    @DisplayName(\"isNull: arg_0 = InetAddress.getCanonicalHostName()\")\r\n    @Timeout(value = 1000L, unit = TimeUnit.MILLISECONDS)\r\n    public void testIsNull8() throws UnknownHostException {\r\n        byte[] byteArray = {Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE};\r\n        InetAddress inetAddress = getByAddress(byteArray);\r\n        String charSequence = inetAddress.getCanonicalHostName();\r\n        \r\n        /* This execution may take longer than the 1000 ms timeout\r\n         and therefore fail due to exceeding the timeout. */\r\n        assertTimeoutPreemptively(Duration.ofMillis(1000L), () -\u003e ClassUnderTest.isNull(charSequence));\r\n    }\r\n\r\n    /**\r\n     * @utbot.classUnderTest {@link ClassUnderTest}\r\n     * @utbot.methodUnderTest {@link ClassUnderTest#isNull(CharSequence)}\r\n     */\r\n    @Test\r\n    @DisplayName(\"isNull: arg_0 = InetAddress.getCanonicalHostName()\")\r\n    @Timeout(value = 1000L, unit = TimeUnit.MILLISECONDS)\r\n    public void testIsNull9() throws UnknownHostException {\r\n        byte[] byteArray = {Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE, Byte.MIN_VALUE};\r\n        InetAddress inetAddress = getByAddress(byteArray);\r\n        String charSequence = inetAddress.getCanonicalHostName();\r\n        \r\n        /* This execution may take longer than the 1000 ms timeout\r\n         and therefore fail due to exceeding the timeout. */\r\n        assertTimeoutPreemptively(Duration.ofMillis(1000L), () -\u003e ClassUnderTest.isNull(charSequence));\r\n    }\r\n    ///endregion\r\n\r\n    ///endregion\r\n}\r\n~~~\r\n","author":{"url":"https://github.com/IlyaMuravjov","@type":"Person","name":"IlyaMuravjov"},"datePublished":"2023-09-12T19:47:03.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/2595/UTBotJava/issues/2595"}