René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Manual testing of Release 2022.10.2","articleBody":"**Initial set-up**\r\n\r\n*Check that the IntelliJ Idea UTBot plugin can be successfully installed*\r\n\r\n- [x] [Build from the unit-test-bot/rc10192022 branch](https://github.com/UnitTestBot/UTBotJava/actions/runs/3281195826)\r\n- [x] Download plugin\r\n- [x] Check downloaded zip-file size \u003c 100 MB\r\n- [x] Open IntelliJ IDEA 2022.2.3 (last released)\r\n- [x] Remove previously installed UTBot plugin\r\n- [x] Clone or reuse UTBot project (https://github.com/UnitTestBot/UTBotJava.git)\r\n- [x] Open the project in the IDE\r\n- [x] Install the downloaded plugin\r\n\r\n*Go through manual scenarios*\r\n\r\n**Manual scenario #1**\r\n\r\n- [x] Use default plugin settings\r\n- [x] Open the utbot-sample/src/main/java/org/utbot/examples/algorithms/ArraysQuickSort.java file\r\n- [x] Generate tests for the class\r\n- [x] Remove results\r\n- [x] Generate and Run test for a method\r\n \r\n**Manual scenario #2**\r\n\r\n- [x] Use default plugin settings\r\n- [x] Open the utbot-sample/src/main/java/org/utbot/examples/mock/CommonMocksExample.java file\r\n- [x] Generate tests with different Mocking options combinations\r\n\r\n**Verify fixes**\r\n\r\n- [x] #1028\r\n- [ ] #747\r\n- [x] #1098\r\n- [x] #1129 \r\n- [ ] #273 \r\n- [x] #1149 \r\n- [ ] #983 \r\n- [x] #1173\r\n- [ ] #448\r\n- [ ] #711\r\n- [ ] #1054 \r\n\r\n**Regression checks**\r\n\r\n**Collect compulsory reflection in tests**\r\n\r\nAdd a class / package  - generate / generate and run tests for class / method / class - check tests\r\n\r\n- [x] Installed on 2021.2.4  - Gradle project\r\n- [x] Installed on 2022.1.4  - Gradle project\r\n- [x] Installed on 2022.2.3  - Gradle project\r\n- [ ] Installed on 2021.2.4  - Maven project\r\n- [x] Installed on 2022.1.4  - Maven project\r\n- [x] Installed on 2022.2.3  - Maven project\r\n- [ ] Installed on 2021.2.4  - IntelliJ project\r\n- [x] Installed on 2022.1.4  - IntelliJ project\r\n- [ ] Installed on 2022.2.3  - IntelliJ project\r\n\r\nAdd a class / package  - generate tests for class / method / class\r\n\r\n- [ ] Gradle  - existing test sources root - No mocks\r\n- [x] Maven - existing test sources root - Mocks outside package\r\n- [ ] Maven - new test sources root - Mocks outside class\r\n- [ ] IntelliJ  - new test sources root  -  Mocks outside class - Mock static methods\r\n\r\nAdd a class / package  - generate tests for class / method / class\r\n\r\n- [ ] JDK 8  - JUnit 5 - Parametrized\r\n- [x] JDK 11 - JUnit 5 - Parametrized off\r\n- [ ] JDK 11 - JUnit 4 - Parametrized off\r\n- [x] JDK 11 - TestNG - Parametrized\r\n- [ ] JDK 17 - JUnit 5 - Parametrized\r\n- [ ] JDK 17 - JUnit 4 - Parametrized off\r\n- [x] JDK 17 - TestNG - Parametrized off\r\n\r\n**UI checks - in a project with JDK 17**\r\n\r\n- [x] timeout changes - 1/10/60 sec - check with stopwatch\r\n- [x] cancellation - check on different steps\r\n- [ ] regions: Symbolic first, Fuzzing, error suite (NPE), explicitly thrown exceptions, caught exceptions (successful)\r\n- [ ] exceptions - check regions for exceptions\r\n- [ ] exceptions - check Problems tab\r\n- [ ] context menu / shortcut\r\n- [ ] call from method / class / package - check Members list\r\n\r\n**Check Settings - in a project with JDK 17**\r\n\r\n- [ ] Symbolic 100% \r\n- [x] Symbolic 95%\r\n- [ ] Symbolic  5%\r\n- [x] Symbolic 0% - Fuzzing 100%\r\n- [ ] Summaries with custom tags - check all tags\r\n- [ ] Summaries with plain text - check for Fuzzing\r\n- [ ] Summaries turned off\r\n- [ ] Tests with exceptions: Fail\r\n- [ ] Tests with exceptions: Pass\r\n- [ ] Overflow : Ignore overflows \r\n- [ ] Overflow: Treat overflows as errors \r\n\r\n**Other features testing**\r\n\r\n- [ ] Sandboxing - check default behavior\r\n- [ ] Sandboxing - add some permission\r\n- [ ] Strings\r\n","author":{"url":"https://github.com/alisevych","@type":"Person","name":"alisevych"},"datePublished":"2022-10-19T12:44:05.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":9},"url":"https://github.com/1187/UTBotJava/issues/1187"}