Title: Race in _ctypes_alloc_callback and libffi under free-threading · Issue #128485 · python/cpython · GitHub
Open Graph Title: Race in _ctypes_alloc_callback and libffi under free-threading · Issue #128485 · python/cpython
X Title: Race in _ctypes_alloc_callback and libffi under free-threading · Issue #128485 · python/cpython
Description: Bug report Bug description: I built libffi with TSAN and cpython (3.13 branch) with free-threading and TSAN. The following python code reports TSAN warnings: import ctypes import concurrent.futures import threading def test_ctypes(): @ct...
Open Graph Description: Bug report Bug description: I built libffi with TSAN and cpython (3.13 branch) with free-threading and TSAN. The following python code reports TSAN warnings: import ctypes import concurrent.futures...
X Description: Bug report Bug description: I built libffi with TSAN and cpython (3.13 branch) with free-threading and TSAN. The following python code reports TSAN warnings: import ctypes import concurrent.futures...
Opengraph URL: https://github.com/python/cpython/issues/128485
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Race in _ctypes_alloc_callback and libffi under free-threading","articleBody":"# Bug report\r\n\r\n### Bug description:\r\n\r\nI built libffi with TSAN and cpython (3.13 branch) with free-threading and TSAN. The following python code reports TSAN warnings:\r\n\r\n```python\r\nimport ctypes\r\nimport concurrent.futures\r\nimport threading\r\n\r\n\r\ndef test_ctypes():\r\n @ctypes.CFUNCTYPE(ctypes.c_float, ctypes.c_float, ctypes.c_float)\r\n def callback(a, b):\r\n return a / 2 + b / 2\r\n\r\n\r\nif __name__ == \"__main__\":\r\n num_workers = 20\r\n\r\n barrier = threading.Barrier(num_workers)\r\n\r\n def closure():\r\n barrier.wait()\r\n test_ctypes()\r\n\r\n with concurrent.futures.ThreadPoolExecutor(max_workers=num_workers) as executor:\r\n futures = []\r\n for i in range(num_workers):\r\n futures.append(executor.submit(closure))\r\n assert len(list(f.result() for f in futures)) == num_workers\r\n```\r\n\r\nTSAN report exract:\r\n```\r\nWARNING: ThreadSanitizer: data race (pid=59410)\r\n Read of size 8 at 0x7ffff618b6d0 by thread T2:\r\n #0 dlmalloc /project/libffi/x86_64-pc-linux-gnu/../src/dlmalloc.c:4158:8 (libffi.so.8+0x58a5) (BuildId: 7b5c105b8eca23b7c54bb5eeab8b4ecf28fc7756)\r\n #1 ffi_closure_alloc /project/libffi/x86_64-pc-linux-gnu/../src/closures.c:998:9 (libffi.so.8+0x56ec) (BuildId: 7b5c105b8eca23b7c54bb5eeab8b4ecf28fc7756)\r\n #2 _ctypes_alloc_callback /project/cpython/./Modules/_ctypes/callbacks.c:367:20 (_ctypes.cpython-313t-x86_64-linux-gnu.so+0x1b435) (BuildId: e9fba41204b37973fe60945270803301c7df9615)\r\n #3 PyCFuncPtr_new /project/cpython/./Modules/_ctypes/_ctypes.c:3955:13 (_ctypes.cpython-313t-x86_64-linux-gnu.so+0x18ba4) (BuildId: e9fba41204b37973fe60945270803301c7df9615)\r\n```\r\n\r\nMore details on the build and the output: https://gist.github.com/vfdev-5/06b1c60713241e75773e9a92f2ecf135\r\n\r\nThe issue is with dlmalloc of libffi (reported [here](https://github.com/libffi/libffi/issues/873))\r\n\r\nDiscussing the issue with @colesbury and @Yhg1s on discord, Thomas proposed the following fix (agreed by Sam):\r\n\r\n> I still think the easy fix is to cause dlmalloc to do its initialization early, like during ctypes import time. Maybe just calling ffi_closure_alloc() (and immediately freeing) is enough.\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n### CPython versions tested on:\r\n\r\n3.13\r\n\r\n### Operating systems tested on:\r\n\r\nLinux\n\n\u003c!-- gh-linked-prs -->\n### Linked PRs\n* gh-131633\n\u003c!-- /gh-linked-prs -->\n","author":{"url":"https://github.com/vfdev-5","@type":"Person","name":"vfdev-5"},"datePublished":"2025-01-04T15:33:25Z","url":"https://github.com/python/cpython/issues/128485"}
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:2d810dbe-7dcc-b825-70be-d7c79d3084ab |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | 8C46:2F543F:18EE145:20F3910:6B021096 |
| html-safe-nonce | c542989a93d17b2293603616e593f186d5467a682c96aa5185ff0df93cc10831 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4QzQ2OjJGNTQzRjoxOEVFMTQ1OjIwRjM5MTA6NkIwMjEwOTYiLCJ2aXNpdG9yX2lkIjoiNDA2NzkwOTQ1MzY0NTc0NjMyNiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | f3df9d704c9b62cccb789f8f8fd2198f2f1c26ddf8d8a218ffa82e36c4b99681 |
| hovercard-subject-tag | issue:2768893963 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/python/cpython/128485/issue_layout |
| twitter:image | https://opengraph.githubassets.com/dbf47c81f510fab3a43a3d31969b163a4b48ac411dd38748b18c5b716c0810c6/python/cpython/issues/128485 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/dbf47c81f510fab3a43a3d31969b163a4b48ac411dd38748b18c5b716c0810c6/python/cpython/issues/128485 |
| og:image:alt | Bug report Bug description: I built libffi with TSAN and cpython (3.13 branch) with free-threading and TSAN. The following python code reports TSAN warnings: import ctypes import concurrent.futures... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | vfdev-5 |
| hostname | github.com |
| expected-hostname | github.com |
| None | 87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456 |
| turbo-cache-control | no-preview |
| go-import | github.com/python/cpython git https://github.com/python/cpython.git |
| octolytics-dimension-user_id | 1525981 |
| octolytics-dimension-user_login | python |
| octolytics-dimension-repository_id | 81598961 |
| octolytics-dimension-repository_nwo | python/cpython |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 81598961 |
| octolytics-dimension-repository_network_root_nwo | python/cpython |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 423dbb54c5e7bfecc838eb387c1435eb3d0e760d |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | issues |
Links:
Viewport: width=device-width