Title: Many similar sandboxed tests on sockets generated by Fuzzing and not minimized · Issue #1129 · UnitTestBot/UTBotJava · GitHub
Open Graph Title: Many similar sandboxed tests on sockets generated by Fuzzing and not minimized · Issue #1129 · UnitTestBot/UTBotJava
X Title: Many similar sandboxed tests on sockets generated by Fuzzing and not minimized · Issue #1129 · UnitTestBot/UTBotJava
Description: Description Many similar tests with same coverage are generated and not minimized. Socket is created inside tests. Fuzzing only mode is on. To Reproduce Run a project in IntelliJ Idea 2022.1.3 - 2022.2.2 Install RC plugin build Set Fuzzi...
Open Graph Description: Description Many similar tests with same coverage are generated and not minimized. Socket is created inside tests. Fuzzing only mode is on. To Reproduce Run a project in IntelliJ Idea 2022.1.3 - 20...
X Description: Description Many similar tests with same coverage are generated and not minimized. Socket is created inside tests. Fuzzing only mode is on. To Reproduce Run a project in IntelliJ Idea 2022.1.3 - 20...
Opengraph URL: https://github.com/UnitTestBot/UTBotJava/issues/1129
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Many similar sandboxed tests on sockets generated by Fuzzing and not minimized","articleBody":"**Description**\r\n\r\nMany similar tests with same coverage are generated and not minimized.\r\nSocket is created inside tests.\r\nFuzzing only mode is on.\r\n\r\n**To Reproduce**\r\n\r\n1. Run a project in IntelliJ Idea 2022.1.3 - 2022.2.2\r\n2. Install [RC plugin build](https://github.com/UnitTestBot/UTBotJava/actions/runs/3217740096) \r\n3. Set Fuzzing to 100%\r\n\r\n\r\n\r\n4. Add the following class (originally posted in #625 ):\r\n\r\n```java\r\npublic class SecurityCheck {\r\n public int connect(Socket socket) throws IOException {\r\n socket.connect(new InetSocketAddress(\"0.0.0.0\", 22));\r\n return 0;\r\n }\r\n}\r\n```\r\n\r\n5. Use plugin to generate tests\r\n6. Open the generated test\r\n\r\n**Expected behavior**\r\n\r\nThere should be only one test creating Socket and sandboxed due to an unpermitted operation.\r\n\r\n**Actual behavior**\r\n\r\nThere are 272 tests generated by Fuzzing with similar arguments. They all have annotation \r\n```java \r\n@Disabled(value = \"Disabled due to sandbox\")\r\n```\r\n\r\n```java\r\n ///region FUZZER: EXPLICITLY_THROWN_UNCHECKED_EXCEPTIONS for method connect(java.net.Socket)\r\n\r\n @Test\r\n @DisplayName(\"connect: socket = Socket(String, int, boolean)\")\r\n @Disabled(value = \"Disabled due to sandbox\")\r\n public void testConnect() throws IOException {\r\n SecurityCheck securityCheck = new SecurityCheck();\r\n Socket socket = new Socket(\"jkmqh\", 568849899, true);\r\n\r\n /* This test fails because method [org.utbot.examples.SecurityCheck.connect] produces [java.security.AccessControlException: access denied (\"java.net.SocketPermission\" \"jkmqh\" \"resolve\")] */\r\n }\r\n\r\n @Test\r\n @DisplayName(\"connect: socket = Socket(String, int, boolean)\")\r\n @Disabled(value = \"Disabled due to sandbox\")\r\n public void testConnect1() throws IOException {\r\n SecurityCheck securityCheck = new SecurityCheck();\r\n Socket socket = new Socket(\"qylov\", -469477656, true);\r\n\r\n /* This test fails because method [org.utbot.examples.SecurityCheck.connect] produces [java.security.AccessControlException: access denied (\"java.net.SocketPermission\" \"qylov\" \"resolve\")] */\r\n }\r\n```\r\n\r\n**Visual proofs (screenshots, logs, images)**\r\n\r\n\r\n\r\n\u003cdetails\u003e\r\n\u003csummary\u003e\r\nThere are the following warnings in concrete executor logs:\r\nIllegal reflective access by org.utbot.framework.concrete.UtModelConstructor \r\nto field java.net.Socket.created\r\n\r\nExpand for details\r\n\u003c/summary\u003e\r\n\r\n19:03:52.187 | Info | DynamicClassTransformer | 16:Scheduler for Client56431 @coroutine#10 | Transforming: org/utbot/examples/SecurityCheck \r\nWARNING: Illegal reflective access by org.utbot.framework.concrete.UtModelConstructor (file:/C:/Users/\u003cusername\u003e/AppData/Roaming/JetBrains/IntelliJIdea2022.1/plugins/utbot-intellij/lib/utbot-framework-2022.10.417.jar) to field java.net.Socket.created\r\nWARNING: Illegal reflective access by org.utbot.framework.concrete.UtModelConstructor (file:/C:/Users/\u003cusername\u003e/AppData/Roaming/JetBrains/IntelliJIdea2022.1/plugins/utbot-intellij/lib/utbot-framework-2022.10.417.jar) to field java.net.Socket.bound\r\nWARNING: Illegal reflective access by org.utbot.framework.concrete.UtModelConstructor (file:/C:/Users/\u003cusername\u003e/AppData/Roaming/JetBrains/IntelliJIdea2022.1/plugins/utbot-intellij/lib/utbot-framework-2022.10.417.jar) to field java.net.Socket.connected\r\nWARNING: Illegal reflective access by org.utbot.framework.concrete.UtModelConstructor (file:/C:/Users/\u003cusername\u003e/AppData/Roaming/JetBrains/IntelliJIdea2022.1/plugins/utbot-intellij/lib/utbot-framework-2022.10.417.jar) to field java.net.Socket.closed\r\nWARNING: Illegal reflective access by org.utbot.framework.concrete.UtModelConstructor (file:/C:/Users/\u003cusername\u003e/AppData/Roaming/JetBrains/IntelliJIdea2022.1/plugins/utbot-intellij/lib/utbot-framework-2022.10.417.jar) to field java.net.Socket.closeLock\r\nWARNING: Illegal reflective access by org.utbot.framework.concrete.UtModelConstructor (file:/C:/Users/\u003cusername\u003e/AppData/Roaming/JetBrains/IntelliJIdea2022.1/plugins/utbot-intellij/lib/utbot-framework-2022.10.417.jar) to field java.net.Socket.shutIn\r\nWARNING: Illegal reflective access by org.utbot.framework.concrete.UtModelConstructor (file:/C:/Users/\u003cusername\u003e/AppData/Roaming/JetBrains/IntelliJIdea2022.1/plugins/utbot-intellij/lib/utbot-framework-2022.10.417.jar) to field java.net.Socket.shutOut\r\nWARNING: Illegal reflective access by org.utbot.framework.concrete.UtModelConstructor (file:/C:/Users/\u003cusername\u003e/AppData/Roaming/JetBrains/IntelliJIdea2022.1/plugins/utbot-intellij/lib/utbot-framework-2022.10.417.jar) to field java.net.Socket.impl\r\nWARNING: Illegal reflective access by org.utbot.framework.concrete.UtModelConstructor (file:/C:/Users/\u003cusername\u003e/AppData/Roaming/JetBrains/IntelliJIdea2022.1/plugins/utbot-intellij/lib/utbot-framework-2022.10.417.jar) to field java.net.Socket.oldImpl\r\nWARNING: Illegal reflective access by org.utbot.framework.concrete.UtModelConstructor (file:/C:/Users/\u003cusername\u003e/AppData/Roaming/JetBrains/IntelliJIdea2022.1/plugins/utbot-intellij/lib/utbot-framework-2022.10.417.jar) to field java.net.Socket.factory\r\nWARNING: Illegal reflective access by org.utbot.framework.concrete.UtModelConstructor (file:/C:/Users/\u003cusername\u003e/AppData/Roaming/JetBrains/IntelliJIdea2022.1/plugins/utbot-intellij/lib/utbot-framework-2022.10.417.jar) to field java.net.Socket.options\r\nWARNING: Illegal reflective access by org.utbot.framework.concrete.UtModelConstructor (file:/C:/Users/\u003cusername\u003e/AppData/Roaming/JetBrains/IntelliJIdea2022.1/plugins/utbot-intellij/lib/utbot-framework-2022.10.417.jar) to field java.net.Socket.optionsSet\r\n\u003c/details\u003e\r\n\r\n**Environment**\r\n\r\nWindows 10 Pro\r\nIntelliJ IDEA 2022.1.3, 2022.1.4, 2022.2.2\r\n\r\n**Additional context**\r\n\r\n_Originally posted by @alisevych in https://github.com/UnitTestBot/UTBotJava/issues/1125#issuecomment-1273350246_\r\n ","author":{"url":"https://github.com/alisevych","@type":"Person","name":"alisevych"},"datePublished":"2022-10-10T15:56:07.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":2},"url":"https://github.com/1129/UTBotJava/issues/1129"}
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:7ccea119-4bc8-3f60-0adc-1eb7fdda5a17 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | 84DE:2E9E2A:17825A:1F8F7E:698E4C68 |
| html-safe-nonce | 3e9616a4f01ab213423c174ec0a9c3d8578c86b7bb2ce39ae83610e46a7573a9 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4NERFOjJFOUUyQToxNzgyNUE6MUY4RjdFOjY5OEU0QzY4IiwidmlzaXRvcl9pZCI6Ijg0ODg4ODkxODMxMjA1NDI4MjQiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 45d9a333e56a91bab4c85d856bd7236c7ea1fc5ce0b78977038c3b0fd72fd0b1 |
| hovercard-subject-tag | issue:1403395282 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/UnitTestBot/UTBotJava/1129/issue_layout |
| twitter:image | https://opengraph.githubassets.com/3fb78a106eab06cbf9fe287ed4c425c2008cc246dfafe9638e6069484eb847d3/UnitTestBot/UTBotJava/issues/1129 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/3fb78a106eab06cbf9fe287ed4c425c2008cc246dfafe9638e6069484eb847d3/UnitTestBot/UTBotJava/issues/1129 |
| og:image:alt | Description Many similar tests with same coverage are generated and not minimized. Socket is created inside tests. Fuzzing only mode is on. To Reproduce Run a project in IntelliJ Idea 2022.1.3 - 20... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | alisevych |
| hostname | github.com |
| expected-hostname | github.com |
| None | 0e08b85f0035d49bc4c22868f70a4d30fb8c2a777936895c37e78df095242ddc |
| turbo-cache-control | no-preview |
| go-import | github.com/UnitTestBot/UTBotJava git https://github.com/UnitTestBot/UTBotJava.git |
| octolytics-dimension-user_id | 87413538 |
| octolytics-dimension-user_login | UnitTestBot |
| octolytics-dimension-repository_id | 480810501 |
| octolytics-dimension-repository_nwo | UnitTestBot/UTBotJava |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 480810501 |
| octolytics-dimension-repository_network_root_nwo | UnitTestBot/UTBotJava |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | ab1cf30f0feb8db377fc0d52bc41f0105f9b4181 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width