Title: failing `pytest` tests are marked as “success” when some of the subtests succeeded · Issue #25824 · microsoft/vscode-python · GitHub
Open Graph Title: failing `pytest` tests are marked as “success” when some of the subtests succeeded · Issue #25824 · microsoft/vscode-python
X Title: failing `pytest` tests are marked as “success” when some of the subtests succeeded · Issue #25824 · microsoft/vscode-python
Description: Type: Bug Behaviour See title, see #24455 what I expect instead test_subtests should be marked as failed as the CLI shows (pytest itself isn’t buggy and shows things as expected): Steps to reproduce: def test_subtests(subtests): with sub...
Open Graph Description: Type: Bug Behaviour See title, see #24455 what I expect instead test_subtests should be marked as failed as the CLI shows (pytest itself isn’t buggy and shows things as expected): Steps to reproduc...
X Description: Type: Bug Behaviour See title, see #24455 what I expect instead test_subtests should be marked as failed as the CLI shows (pytest itself isn’t buggy and shows things as expected): Steps to reproduc...
Opengraph URL: https://github.com/microsoft/vscode-python/issues/25824
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"failing `pytest` tests are marked as “success” when some of the subtests succeeded","articleBody":"\nType: \u003cb>Bug\u003c/b>\n\n# Behaviour\n\nSee title, see https://github.com/microsoft/vscode-python/issues/24455\n\n\u003cimg width=\"308\" height=\"41\" alt=\"Image\" src=\"https://github.com/user-attachments/assets/73974db2-397d-4c48-9b54-82950318154f\" />\n\n\u003cdetails>\u003csummary>what I expect instead\u003c/summary>\n\n`test_subtests` should be marked as failed as the CLI shows (pytest itself isn’t buggy and shows things as expected):\n\n\u003cimg width=\"563\" height=\"126\" alt=\"Image\" src=\"https://github.com/user-attachments/assets/7c006984-09e0-440a-ad87-16bac1c66875\" />\n\n\u003c/details>\n\n\n## Steps to reproduce:\n\n```py\ndef test_subtests(subtests):\n with subtests.test(\"success\"):\n assert True\n with subtests.test(\"failure\"):\n pytest.fail(\"subtest failure\")\n```\n\n1. install pytest >=9\n2. run the above test in the test sidebar\n3. see buggy results as described and shown above\n\n# Diagnostic data\n\n\u003cdetails>\n\n\u003csummary>Output for \u003ccode>Python\u003c/code> in the \u003ccode>Output\u003c/code> panel (\u003ccode>View\u003c/code>→\u003ccode>Output\u003c/code>, change the drop-down the upper-right of the \u003ccode>Output\u003c/code> panel to \u003ccode>Python\u003c/code>)\n\u003c/summary>\n\n\u003cp>\n\n```\n2026-02-28 11:47:00.075 [info] Attempting to use temp directory for test ids file, file name: test-ids-c9c0405040b5fbf605e6.txt\n2026-02-28 11:47:00.084 [info] Environment variables set for pytest execution: PYTHONPATH=/home/phil/.vscode/extensions/ms-python.python-2026.2.0-linux-x64/python_files, TEST_RUN_PIPE=/run/user/1000/python-test-results-31b84a1d4f7f94f5a051, RUN_TEST_IDS_PIPE=/run/user/1000/test-ids-c9c0405040b5fbf605e6.txt\n2026-02-28 11:47:00.084 [info] Running pytest with arguments: /home/phil/.vscode/extensions/ms-python.python-2026.2.0-linux-x64/python_files/vscode_pytest/run_pytest_script.py for workspace /home/phil/Dev/Python/test\n2026-02-28 11:47:00.084 [info] > …/python ~/.vscode/extensions/ms-python.python-2026.2.0-linux-x64/python_files/vscode_pytest/run_pytest_script.py\n2026-02-28 11:47:00.084 [info] cwd: .\n2026-02-28 11:47:03.400 [info] Test Result named pipe /run/user/1000/python-test-results-31b84a1d4f7f94f5a051 cancelled\n\n```\n\n\u003c/p>\n\u003c/details>\n\n\nExtension version: 2026.2.0\nVS Code version: Code 1.109.5 (072586267e68ece9a47aa43f8c108e0dcbf44622, 2026-02-19T19:43:32.382Z)\nOS version: Linux x64 6.18.13-arch1-1\nModes:\n\n- Python version (& distribution if applicable, e.g. Anaconda): 3.14.3\n- Type of virtual environment used (e.g. conda, venv, virtualenv, etc.): Hatch\n- Value of the `python.languageServer` setting: Pylance\n\n\u003cdetails>\n\u003csummary>User Settings\u003c/summary>\n\u003cp>\n\n```\n\nlanguageServer: \"Pylance\"\n\ntesting\n• pytestArgs: \"-vv\"\n• pytestEnabled: true\n\nexperiments\n• optInto: [\"pythonTestAdapter\"]\n\n```\n\u003c/p>\n\u003c/details>\n\n\u003cdetails>\n\u003csummary>Installed Extensions\u003c/summary>\n\n|Extension Name|Extension Id|Version|\n|---|---|---|\n|2077-theme|End|1.5.3|\n|biome|bio|3.4.1|\n|cmake-tools|ms-|1.22.28|\n|code-spell-checker|str|4.5.6|\n|code-spell-checker-german|str|2.3.4|\n|codeium|Cod|1.48.2|\n|cpp-devtools|ms-|0.2.0|\n|datawrangler|ms-|1.24.0|\n|debugpy|ms-|2025.18.0|\n|dependi|fil|0.7.21|\n|EditorConfig|Edi|0.18.1|\n|editorconfiggenerator|nep|0.2.1|\n|errorlens|use|3.28.0|\n|even-better-toml|tam|0.21.2|\n|gc-excelviewer|Gra|4.2.64|\n|git-graph|mhu|1.30.0|\n|jinjahtml|sam|0.20.0|\n|js-debug|ms-|1.105.0|\n|js-debug-companion|ms-|1.1.3|\n|jupyter|ms-|2025.9.1|\n|jupyter-keymap|ms-|1.1.2|\n|jupyter-renderers|ms-|1.3.2025062701|\n|live-server|ms-|0.4.17|\n|markdown-checkbox|bie|0.4.0|\n|markdown-mermaid|bie|1.32.0|\n|myst-highlight|Exe|0.11.0|\n|myst-tml-syntax|chr|0.1.3|\n|pdf|tom|1.2.2|\n|pre-commit-vscode|Mar|0.1.0|\n|python|ms-|2026.2.0|\n|rainbow-csv|mec|3.24.1|\n|remote-containers|ms-|0.442.0|\n|remote-explorer|ms-|0.5.0|\n|remote-ssh|ms-|0.122.0|\n|remote-ssh-edit|ms-|0.87.0|\n|ruff|cha|2026.36.0|\n|RunOnSave|eme|1.0.3|\n|shades-of-purple|ahm|7.3.6|\n|simple-rst|tro|1.5.4|\n|simply-view-image-for-python-debugging|ela|4.0.10|\n|string-converter|ada|0.1.2|\n|synthwave-vscode|Rob|0.1.20|\n|test-adapter-converter|ms-|0.2.1|\n|todo-tree|Gru|0.0.226|\n|toml|be5|0.6.0|\n|vscode-ansi|ili|1.1.7|\n|vscode-dask|joy|0.0.4|\n|vscode-github-actions|git|0.31.0|\n|vscode-graphql|Gra|0.13.2|\n|vscode-graphql-syntax|Gra|1.3.8|\n|vscode-js-profile-table|ms-|1.0.10|\n|vscode-jupyter-cell-tags|ms-|0.1.9|\n|vscode-jupyter-slideshow|ms-|0.1.6|\n|vscode-language-pack-de|MS-|1.108.2026021109|\n|vscode-mogami|nin|0.1.9|\n|vscode-nushell-lang|The|1.10.0|\n|vscode-open|san|0.3.0|\n|vscode-pull-request-github|Git|0.128.0|\n|vscode-pylance|ms-|2026.1.100|\n|vscode-svg-previewer|vit|0.7.0|\n|vscode-yaml|red|1.21.0|\n|vscode-zipfs|arc|3.0.0|\n|xml|Dot|2.5.1|\n\u003c/details>\n\u003cdetails>\n\u003csummary>System Info\u003c/summary>\n\n|Item|Value|\n|---|---|\n|CPUs|AMD Ryzen 7 3700X 8-Core Processor (16 x 3379)|\n|GPU Status|2d_canvas: enabled\u003cbr>GPU0: VENDOR= 0x1002 [Google Inc. (AMD)], DEVICE=0x73bf [ANGLE (AMD, AMD Radeon RX 6800 XT (radeonsi navi21 ACO), OpenGL ES 3.2 Mesa 26.0.1-arch1.1)], DRIVER_VENDOR=Mesa, DRIVER_VERSION=26.0.1 *ACTIVE*\u003cbr>Machine model name: \u003cbr>Machine model version: \u003cbr>direct_rendering_display_compositor: disabled_off_ok\u003cbr>gpu_compositing: enabled\u003cbr>multiple_raster_threads: enabled_on\u003cbr>opengl: enabled_on\u003cbr>rasterization: enabled\u003cbr>raw_draw: disabled_off_ok\u003cbr>skia_graphite: disabled_off\u003cbr>trees_in_viz: disabled_off\u003cbr>video_decode: enabled\u003cbr>video_encode: disabled_software\u003cbr>vulkan: disabled_off\u003cbr>webgl: enabled\u003cbr>webgl2: enabled\u003cbr>webgpu: disabled_off\u003cbr>webnn: disabled_off|\n|Load (avg)|3, 2, 2|\n|Memory (System)|31.26GB (19.68GB free)|\n|Process Argv|--crash-reporter-id e73710ca-22af-43b0-a2f6-ea09b8305a53|\n|Screen Reader|no|\n|VM|0%|\n|DESKTOP_SESSION|plasma|\n|XDG_CURRENT_DESKTOP|KDE|\n|XDG_SESSION_DESKTOP|KDE|\n|XDG_SESSION_TYPE|wayland|\n\u003c/details>\u003cdetails>\n\u003csummary>A/B Experiments\u003c/summary>\n\n```\nvsliv368cf:30146710\npythonvspyt551:31249599\nbinariesv615:30325510\nnativeloc1:31344060\ndwcopilot:31170013\ndwoutputs:31242946\ncopilot_t_ci:31333650\ne5gg6876:31282496\npythonrdcb7:31342333\n6518g693:31463988\naj953862:31281341\n6abeh943:31336334\nenvsactivate1:31464700\ncloudbuttont:31379625\n3efgi100_wstrepl:31403338\nuse-responses-api:31390855\nje187915:31454425\nec5jj548:31422691\ncp_cls_t_966_ss:31454198\n4je02754:31466945\nfind_all_ref_in_bg_f:31469307\na5gib710:31434435\n38bie571_auto:31426784\n7a04d226_do_not_restore_last_panel_session:31438103\ncp_cls_t_1081:31454832\na43f0574a:31442826\ne9c30283:31461165\nidci7584:31464702\nedit_mode_hidden:31461530\n3bj34942:31461205\n864ei723_large_tool_results_to_disk:31460878\n7ef87755:31458076\nchat:31457767\n\n```\n\n\u003c/details>\n\n\u003c!-- generated by issue reporter -->","author":{"url":"https://github.com/flying-sheep","@type":"Person","name":"flying-sheep"},"datePublished":"2026-02-28T10:45:27Z","url":"https://github.com/microsoft/vscode-python/issues/25824"}
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:0c2e3dfb-4b3f-84ae-31e8-b44e4e1e60ee |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | AF26:1EC9BC:A6403F:D5348E:6B00F527 |
| html-safe-nonce | c3d6217322f16c6cbf83c1dc40fd4277124a00b3429ba5d6bac28be5407e52ee |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBRjI2OjFFQzlCQzpBNjQwM0Y6RDUzNDhFOjZCMDBGNTI3IiwidmlzaXRvcl9pZCI6IjMxNDIzMTkzMzEwNjU1MjU1NDMiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 8c24989e4e71ab06cb76ab3b9a128e0bf2736b367006ae2bdc6868f6d1d72b9d |
| hovercard-subject-tag | issue:4004437898 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/microsoft/vscode-python/25824/issue_layout |
| twitter:image | https://opengraph.githubassets.com/256f9ddd20e97f3d199fdbdbdf71f7e5bdcc3926f15db4c4b64b92ac57ffc165/microsoft/vscode-python/issues/25824 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/256f9ddd20e97f3d199fdbdbdf71f7e5bdcc3926f15db4c4b64b92ac57ffc165/microsoft/vscode-python/issues/25824 |
| og:image:alt | Type: Bug Behaviour See title, see #24455 what I expect instead test_subtests should be marked as failed as the CLI shows (pytest itself isn’t buggy and shows things as expected): Steps to reproduc... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | flying-sheep |
| hostname | github.com |
| expected-hostname | github.com |
| None | 4ef498cbabcbe3c50befc7a5b743e7072ee770b4daf0e15e54801180d1fa91fc |
| turbo-cache-control | no-preview |
| go-import | github.com/microsoft/vscode-python git https://github.com/microsoft/vscode-python.git |
| octolytics-dimension-user_id | 6154722 |
| octolytics-dimension-user_login | microsoft |
| octolytics-dimension-repository_id | 106462765 |
| octolytics-dimension-repository_nwo | microsoft/vscode-python |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | true |
| octolytics-dimension-repository_parent_id | 49946255 |
| octolytics-dimension-repository_parent_nwo | DonJayamanne/pythonVSCode |
| octolytics-dimension-repository_network_root_id | 49946255 |
| octolytics-dimension-repository_network_root_nwo | DonJayamanne/pythonVSCode |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 9983dd5da06943f833c971dd5b6bc988e2858be5 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | issues |
Links:
Viewport: width=device-width