René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"11 tests owned by \"ut3_tester\" fail when executed as \"ut3_tester\"","articleBody":"**Describe the bug**\r\n\r\nI expect that the owner of tests can execute its tests successfully. And if this is not the case the tests should throw an appropriate exception (e.g. must be executed as ut3_tester_helper) or it should be disabled dynamically.\r\n\r\n**Provide version info**\r\n\r\n```\r\n19.0.0.0.0\r\n19.0.0\r\n\r\n\r\nPL/SQL procedure successfully completed.\r\n\r\n\r\nUT_VERSION                                                  \r\n------------------------------------------------------------\r\nv3.1.8.3142-develop\r\n\r\n\r\nBANNER                                                                           BANNER_FULL                                                                                                                                                      BANNER_LEGACY                                                                        CON_ID\r\n-------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- ----------\r\nOracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production           Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production                                                                                           Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production                    0\r\n                                                                                 Version 19.2.0.0.0                                                                                                                                                                                                                                          \r\n\r\n\r\n\r\nPARAMETER                      VALUE                                                           \r\n------------------------------ ----------------------------------------------------------------\r\nNLS_LANGUAGE                   ENGLISH                                                         \r\nNLS_TERRITORY                  SWITZERLAND                                                     \r\nNLS_CURRENCY                   SFr.                                                            \r\nNLS_ISO_CURRENCY               SWITZERLAND                                                     \r\nNLS_NUMERIC_CHARACTERS         .'                                                              \r\nNLS_CALENDAR                   GREGORIAN                                                       \r\nNLS_DATE_FORMAT                DD.MM.YYYY HH24:MI:SS                                           \r\nNLS_DATE_LANGUAGE              ENGLISH                                                         \r\nNLS_SORT                       BINARY                                                          \r\nNLS_TIME_FORMAT                HH24:MI:SSXFF                                                   \r\nNLS_TIMESTAMP_FORMAT           DD.MM.RR HH24:MI:SSXFF                                          \r\n\r\nPARAMETER                      VALUE                                                           \r\n------------------------------ ----------------------------------------------------------------\r\nNLS_TIME_TZ_FORMAT             HH24:MI:SSXFF TZR                                               \r\nNLS_TIMESTAMP_TZ_FORMAT        DD.MM.RR HH24:MI:SSXFF TZR                                      \r\nNLS_DUAL_CURRENCY              SF                                                              \r\nNLS_COMP                       BINARY                                                          \r\nNLS_LENGTH_SEMANTICS           BYTE                                                            \r\nNLS_NCHAR_CONV_EXCP            FALSE                                                           \r\n\r\n17 rows selected. \r\n\r\n\r\nPORT_STRING                                                 \r\n------------------------------------------------------------\r\nx86_64/Linux 2.4.xx\r\n```\r\n\r\n**Information about client software**\r\n\r\nirrelevant.\r\n\r\n**To Reproduce**\r\n\r\n1. connect as user `ut3_tester` in a current development environment\r\n\r\n2. run the the follwing:\r\n\r\n```\r\nSET SERVEROUTPUT ON SIZE UNLIMITED\r\nEXECUTE ut.run('UT3_TESTER');\r\n```\r\n\r\n3. Look at the output:\r\n\r\n```\r\nFailures:\r\n \r\n   1) after_each_executed\r\n      Actual: 3 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.AFTER_EACH_EXECUTED\", line 160 ut.expect(l_test.result).to_equal(ut3.ut_utils.gc_success);\r\n      \r\n       \r\n      Actual: 0 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.AFTER_EACH_EXECUTED\", line 161 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(1);\r\n      \r\n       \r\n   2) before_each_executed\r\n      Actual: 3 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.BEFORE_EACH_EXECUTED\", line 332 ut.expect(l_test.result).to_equal(ut3.ut_utils.gc_success);\r\n      \r\n       \r\n      Actual: NULL (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.BEFORE_EACH_EXECUTED\", line 333 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(1);\r\n      \r\n       \r\n   3) before_test_executed\r\n      Actual: 3 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.BEFORE_TEST_EXECUTED\", line 536 ut.expect(l_test.result).to_equal(ut3.ut_utils.gc_success);\r\n      \r\n       \r\n      Actual: NULL (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.BEFORE_TEST_EXECUTED\", line 537 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(1);\r\n      \r\n       \r\n   4) after_test_executed\r\n      Actual: 3 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.AFTER_TEST_EXECUTED\", line 591 ut.expect(l_test.result).to_equal(ut3.ut_utils.gc_success);\r\n      \r\n       \r\n      Actual: 0 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.AFTER_TEST_EXECUTED\", line 592 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(1);\r\n      \r\n       \r\n   5) disabled_test\r\n      Actual: NULL (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.DISABLED_TEST\", line 25 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(1);\r\n      \r\n       \r\n      Actual: 3 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.DISABLED_TEST\", line 26 ut.expect(l_suite.result).to_equal(ut3.ut_utils.gc_success);\r\n      \r\n       \r\n      Actual: 0 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.DISABLED_TEST\", line 27 ut.expect(l_suite.results_count.disabled_count).to_equal(1);\r\n      \r\n       \r\n      Actual: 0 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.DISABLED_TEST\", line 29 ut.expect(l_suite.results_count.success_count).to_equal(1);\r\n      \r\n       \r\n      Actual: 2 (number) was expected to equal: 0 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.DISABLED_TEST\", line 31 ut.expect(l_suite.results_count.errored_count).to_equal(0);\r\n      \r\n       \r\n   6) aftertest_errors\r\n      Actual: NULL (number) was expected to equal: 3 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.AFTERTEST_ERRORS\", line 53 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(3);\r\n      \r\n       \r\n      Actual: 0 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.AFTERTEST_ERRORS\", line 57 ut.expect(l_suite.results_count.success_count).to_equal(1);\r\n      \r\n       \r\n      Actual: 2 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.AFTERTEST_ERRORS\", line 59 ut.expect(l_suite.results_count.errored_count).to_equal(1);\r\n      \r\n       \r\n   7) aftereach_errors\r\n      Actual: NULL (number) was expected to equal: 3 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.AFTEREACH_ERRORS\", line 79 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(3);\r\n      \r\n       \r\n      Actual: 0 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.AFTEREACH_ERRORS\", line 83 ut.expect(l_suite.results_count.success_count).to_equal(1);\r\n      \r\n       \r\n      Actual: 2 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.AFTEREACH_ERRORS\", line 85 ut.expect(l_suite.results_count.errored_count).to_equal(1);\r\n      \r\n       \r\n   8) beforetest_errors\r\n      Actual: NULL (number) was expected to equal: 2 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.BEFORETEST_ERRORS\", line 105 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(2);\r\n      \r\n       \r\n      Actual: 0 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.BEFORETEST_ERRORS\", line 109 ut.expect(l_suite.results_count.success_count).to_equal(1);\r\n      \r\n       \r\n      Actual: 2 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.BEFORETEST_ERRORS\", line 111 ut.expect(l_suite.results_count.errored_count).to_equal(1);\r\n      \r\n       \r\n   9) beforeeach_errors\r\n      Actual: NULL (number) was expected to equal: 2 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.BEFOREEACH_ERRORS\", line 131 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(2);\r\n      \r\n       \r\n      Actual: 0 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.BEFOREEACH_ERRORS\", line 135 ut.expect(l_suite.results_count.success_count).to_equal(1);\r\n      \r\n       \r\n      Actual: 2 (number) was expected to equal: 1 (number) \r\n      at \"UT3_TESTER.TEST_UT_TEST.BEFOREEACH_ERRORS\", line 137 ut.expect(l_suite.results_count.errored_count).to_equal(1);\r\n      \r\n       \r\n  10) rollback_manual\r\n      Actual: 0 (number) was expected to be greater than: 0 (number) \r\n      at \"UT3_TESTER_HELPER.RUN_HELPER.TEST_ROLLBACK_TYPE\", line 556 ut.expect(main_helper.get_value(q'[ut_transaction_control.count_rows('t')]')).to_( a_expectation );\r\n      \r\n       \r\n      Actual: 0 (number) was expected to be greater than: 0 (number) \r\n      at \"UT3_TESTER_HELPER.RUN_HELPER.TEST_ROLLBACK_TYPE\", line 557 ut.expect(main_helper.get_value(q'[ut_transaction_control.count_rows('s')]')).to_( a_expectation );\r\n      \r\n       \r\n  11) rollback_manual_on_failure\r\n      Actual: 0 (number) was expected to be greater than: 0 (number) \r\n      at \"UT3_TESTER_HELPER.RUN_HELPER.TEST_ROLLBACK_TYPE\", line 556 ut.expect(main_helper.get_value(q'[ut_transaction_control.count_rows('t')]')).to_( a_expectation );\r\n      \r\n       \r\n      Actual: 0 (number) was expected to be greater than: 0 (number) \r\n      at \"UT3_TESTER_HELPER.RUN_HELPER.TEST_ROLLBACK_TYPE\", line 557 ut.expect(main_helper.get_value(q'[ut_transaction_control.count_rows('s')]')).to_( a_expectation );\r\n      \r\n       \r\nFinished in 12.283786 seconds\r\n233 tests, 11 failed, 0 errored, 1 disabled, 0 warning(s)\r\n```\r\n\r\n4. connect as user `ut3_tester_helper`\r\n\r\n5. run the following (same as in step 3):\r\n\r\n```\r\nSET SERVEROUTPUT ON SIZE UNLIMITED\r\nEXECUTE ut.run('UT3_TESTER');\r\n```\r\n\r\n6. look at the ouput (no errors, excerpt):\r\n\r\n```\r\nFinished in 13.088981 seconds\r\n233 tests, 0 failed, 0 errored, 1 disabled, 0 warning(s)\r\n```\r\n\r\n**Expected behavior**\r\n\r\n- Option 1: step 3 and 5 produced the same number of succeeded, failed, errored tests \r\n- Option 2: if option 1 is not feasible, this should be documented and reported in an sensible way, so that the user knows what to do (and maybe also why). \r\n","author":{"url":"https://github.com/PhilippSalvisberg","@type":"Person","name":"PhilippSalvisberg"},"datePublished":"2019-07-05T13:13:53.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/969/utPLSQL/issues/969"}