René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"JaCoCo evaluation report is failed during measuring coverage in run_with_coverage.sh script","articleBody":"**Description**\r\n\r\nThe section of the documentation https://github.com/UnitTestBot/UTBotJava/blob/main/docs/jlearch/setup.md#continue-setup\r\ncould not be reproduced correctly\r\n\r\nThe JaCoCo report is not generated.\r\n\r\n**To Reproduce**\r\n\r\n1. Train the minimal model according provided instruction\r\n2. Run the last step to measure the quality of the model\r\n3. Obtain a few errors: a few failed tests due to the row ./gradlew :utbot-junit-contest:test :utbot-junit-contest:jacocoTestReport\r\n4. If comment first part with running tests, you will obtain the failing of report generation\r\n5. If run the :utbot-junit-contest:jacocoTestReport with flags --stacktrace you could find the real reason\r\n\r\n \r\n**Expected behavior**\r\n\r\nReport should be generated\r\n\r\n**Actual behavior**\r\n\r\nGot the following stacktrace\r\n\r\n```\r\nCaused by: java.io.IOException: Error while analyzing /home/jupyter-z00663679/UTBotJava/utbot-junit-contest/build/resources/main/lib/utbot-instrumentation-1.0-SNAPSHOT.jar@kotlin/reflect/jvm/internal/impl/serialization/deserialization/builtins/BuiltInsResourceLoader.class.\r\n        at org.jacoco.core.analysis.Analyzer.analyzerError(Analyzer.java:162)\r\n        at org.jacoco.core.analysis.Analyzer.analyzeClass(Analyzer.java:134)\r\n        at org.jacoco.core.analysis.Analyzer.analyzeClass(Analyzer.java:157)\r\n        at org.jacoco.core.analysis.Analyzer.analyzeAll(Analyzer.java:193)\r\n        at org.jacoco.core.analysis.Analyzer.analyzeZip(Analyzer.java:265)\r\n        at org.jacoco.core.analysis.Analyzer.analyzeAll(Analyzer.java:196)\r\n        at org.jacoco.core.analysis.Analyzer.analyzeAll(Analyzer.java:226)\r\n        at org.jacoco.core.analysis.Analyzer.analyzeAll(Analyzer.java:221)\r\n        at org.jacoco.core.analysis.Analyzer.analyzeAll(Analyzer.java:221)\r\n        at org.jacoco.ant.ReportTask.createBundle(ReportTask.java:570)\r\n        at org.jacoco.ant.ReportTask.createReport(ReportTask.java:545)\r\n        at org.jacoco.ant.ReportTask.execute(ReportTask.java:496)\r\n        ... 140 more\r\nCaused by: java.lang.IllegalStateException: Can't add different class with same name: kotlin/reflect/jvm/internal/impl/serialization/deserialization/builtins/BuiltInsResourceLoader\r\n        at org.jacoco.core.analysis.CoverageBuilder.visitCoverage(CoverageBuilder.java:106)\r\n        at org.jacoco.core.analysis.Analyzer$1.visitEnd(Analyzer.java:99)\r\n        at org.objectweb.asm.ClassVisitor.visitEnd(ClassVisitor.java:378)\r\n        at org.jacoco.core.internal.flow.ClassProbesAdapter.visitEnd(ClassProbesAdapter.java:100)\r\n        at org.objectweb.asm.ClassReader.accept(ClassReader.java:722)\r\n        at org.objectweb.asm.ClassReader.accept(ClassReader.java:401)\r\n        at org.jacoco.core.analysis.Analyzer.analyzeClass(Analyzer.java:116)\r\n        at org.jacoco.core.analysis.Analyzer.analyzeClass(Analyzer.java:132)\r\n        ... 150 more\r\n\r\n\r\n```\r\n\r\n**Additional context**\r\n\r\nThe following solution solves the problem:\r\n\r\n1. Change gradle script in the \r\n```\r\njacocoTestReport {\r\n    doFirst {\r\n        delete fileTree (dir: \"${buildDir}/resources/main/lib\")\r\n    }\r\n    reports {\r\n        html.enabled = true\r\n    }\r\n}\r\n```\r\nIt removes the utbot-instrumentation.jar from the analyzing path\r\n2. Run `./gradlew :utbot-junit-contest:assemble`\r\n3. Re-run the `run_with_coverage.sh` script like the following command `./scripts/run_with_coverage.sh antlr 10 \"NN_REWARD_GUIDED_SELECTOR models/linear/0\" linear0 true`\r\n4. The report is found under `eval/jacoco`","author":{"url":"https://github.com/amandelpie","@type":"Person","name":"amandelpie"},"datePublished":"2022-08-22T14:00:19.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/762/UTBotJava/issues/762"}