René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Odd default ordering of tests when using contexts","articleBody":"**Describe the bug**\r\nWhen a test suite doesn't contain contexts, the default ordering of tests is determined by test procedure position in package specification.\r\n\r\nWhen test suite contains  a context, the ordering is no longer directly related to test or context position in test suite.\r\n\r\n**Provide version info**\r\nAffects all versions that support contexts.\r\n\r\n\r\n**To Reproduce**\r\nCreate two test packages. One with contexts one without.\r\n```sql\r\ncreate or replace package demo_1 as\r\n  --%suite\r\n\r\n  --%test(First)\r\n  procedure t1;\r\n  --%test(Second)\r\n  procedure t2;\r\n  --%test(Third)\r\n  procedure t3;\r\n  --%test(Forth)\r\n  procedure t4;\r\nend;\r\n/\r\ncreate or replace package body demo_1 as\r\n  procedure t1 is begin null; end;\r\n  procedure t2 is begin null; end;\r\n  procedure t3 is begin null; end;\r\n  procedure t4 is begin null; end;\r\nend;\r\n/\r\ncreate or replace package demo_2 as\r\n  --%suite\r\n\r\n  --%test(First)\r\n  procedure t1;\r\n\r\n  --%context(Context 1)\r\n\r\n    --%test(Second)\r\n    procedure t2;\r\n\r\n  --%endcontext\r\n  --%context(Context 2)\r\n\r\n    --%test(Third)\r\n    procedure t3;\r\n\r\n  --%endcontext\r\n\r\n  --%test(Forth)\r\n  procedure t4;\r\nend;\r\n/\r\ncreate or replace package body demo_2 as\r\n  procedure t1 is begin null; end;\r\n  procedure t2 is begin null; end;\r\n  procedure t3 is begin null; end;\r\n  procedure t4 is begin null; end;\r\nend;\r\n/\r\n```\r\n\r\nRun tests:\r\n`call ut.run('demo_1,demo_2');`\r\n\r\nResults are:\r\n```\r\ndemo_2\r\n  Context 2\r\n    Third [.006 sec]\r\n  Context 1\r\n    Second [.003 sec]\r\n  First [.003 sec]\r\n  Forth [.003 sec]\r\n\r\ndemo_1\r\n  First [.001 sec]\r\n  Second [.001 sec]\r\n  Third [.001 sec]\r\n  Forth [.001 sec]\r\n\r\nFinished in .028732 seconds\r\n8 tests, 0 failed, 0 errored, 0 disabled, 0 warning(s)\r\n```\r\n\r\n**Expected behavior**\r\nRun tests:\r\n`call ut.run('demo_1,demo_2');`\r\n\r\nResults are:\r\n```\r\ndemo_2\r\n  First [.003 sec]\r\n  Context 1\r\n    Second [.003 sec]\r\n  Context 2\r\n    Third [.006 sec]\r\n  Forth [.003 sec]\r\n\r\ndemo_1\r\n  First [.001 sec]\r\n  Second [.001 sec]\r\n  Third [.001 sec]\r\n  Forth [.001 sec]\r\n\r\nFinished in .028732 seconds\r\n8 tests, 0 failed, 0 errored, 0 disabled, 0 warning(s)\r\n```\r\n\r\n**Additional context**\r\nThe ordering of tests is mostly relevant when trying to write tests as documentation for your code, so that the tests tell a story.\r\n\r\n","author":{"url":"https://github.com/jgebal","@type":"Person","name":"jgebal"},"datePublished":"2019-12-29T00:58:32.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/1036/utPLSQL/issues/1036"}