Title: Improve mutex/lock handling · Issue #32 · CentML/centml-python-client · GitHub
Open Graph Title: Improve mutex/lock handling · Issue #32 · CentML/centml-python-client
X Title: Improve mutex/lock handling · Issue #32 · CentML/centml-python-client
Description: Currently, the compiler and inference thread of the remote-compiler client backend share a lock to ensure that the compiler can safely delete the uncompiled model once compiled is done. However, this could lead to starvation if a thread ...
Open Graph Description: Currently, the compiler and inference thread of the remote-compiler client backend share a lock to ensure that the compiler can safely delete the uncompiled model once compiled is done. However, th...
X Description: Currently, the compiler and inference thread of the remote-compiler client backend share a lock to ensure that the compiler can safely delete the uncompiled model once compiled is done. However, th...
Opengraph URL: https://github.com/CentML/centml-python-client/issues/32
X: @github
Domain: patch-diff.githubusercontent.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Improve mutex/lock handling","articleBody":"Currently, the compiler and inference thread of the remote-compiler client backend share a lock to ensure that the compiler can safely delete the uncompiled model once compiled is done.\n\nHowever, this could lead to starvation if a thread holds onto a lock for too long.\n\nWe should probably use semaphores instead or whatever is the standard implementation for the reader-writer concurrency problem\n\n┆Issue is synchronized with this [Notion page](https://www.notion.so/Improve-mutex-lock-handling-cc5a0f28f538410e9cc856a6e31f3ce0) by [Unito](https://www.unito.io)\n","author":{"url":"https://github.com/destefy","@type":"Person","name":"destefy"},"datePublished":"2024-03-06T18:57:10.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/32/centml-python-client/issues/32"}| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:875d373f-a2ed-c2d4-f16f-169fe345d4fa |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | AA22:D5FCA:949C9C:C89082:698E3B63 |
| html-safe-nonce | d5bc5b30e764b8b7cfa182e6ef638c8330326f01e6e3d36b68ffe9b822e2c5b1 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBQTIyOkQ1RkNBOjk0OUM5QzpDODkwODI6Njk4RTNCNjMiLCJ2aXNpdG9yX2lkIjoiNjYzMDAxMzMwMTQ1ODYxNTEzOSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 6c591fb6889268dd8b26a063777e604c8c76500e126aae5d2aea5f5d3e8fe764 |
| hovercard-subject-tag | issue:2172207989 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/CentML/centml-python-client/32/issue_layout |
| twitter:image | https://opengraph.githubassets.com/0aa99ad7dbbf1413dfd8d9303052d87416c9b215865496300f2c1fbbc5f747aa/CentML/centml-python-client/issues/32 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/0aa99ad7dbbf1413dfd8d9303052d87416c9b215865496300f2c1fbbc5f747aa/CentML/centml-python-client/issues/32 |
| og:image:alt | Currently, the compiler and inference thread of the remote-compiler client backend share a lock to ensure that the compiler can safely delete the uncompiled model once compiled is done. However, th... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | destefy |
| hostname | github.com |
| expected-hostname | github.com |
| None | a5632af64f7fed7bff1d6a428d1aca1b94fa7a48f760de2d39d9b1effdbf0082 |
| turbo-cache-control | no-preview |
| go-import | github.com/CentML/centml-python-client git https://github.com/CentML/centml-python-client.git |
| octolytics-dimension-user_id | 98933447 |
| octolytics-dimension-user_login | CentML |
| octolytics-dimension-repository_id | 666050741 |
| octolytics-dimension-repository_nwo | CentML/centml-python-client |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 666050741 |
| octolytics-dimension-repository_network_root_nwo | CentML/centml-python-client |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | aa1fa9100f85cd8b602c63c7e337f9151e70024f |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width