René's URL Explorer Experiment


Title: Library leaves dangling processes after use · Issue #1333 · gitpython-developers/GitPython · GitHub

Open Graph Title: Library leaves dangling processes after use · Issue #1333 · gitpython-developers/GitPython

X Title: Library leaves dangling processes after use · Issue #1333 · gitpython-developers/GitPython

Description: Hi, I've faced a problem on Windows with file/directory removal with shutil.rmtree(). The problem, by itself, is not new and already has known solutions, including git.util.rmtree(). However, just using this function was not enough in my...

Open Graph Description: Hi, I've faced a problem on Windows with file/directory removal with shutil.rmtree(). The problem, by itself, is not new and already has known solutions, including git.util.rmtree(). However, just ...

X Description: Hi, I've faced a problem on Windows with file/directory removal with shutil.rmtree(). The problem, by itself, is not new and already has known solutions, including git.util.rmtree(). However, j...

Opengraph URL: https://github.com/gitpython-developers/GitPython/issues/1333

X: @github

direct link

Domain: github.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Library leaves dangling processes after use","articleBody":"Hi, I've faced a problem on Windows with file/directory removal with `shutil.rmtree()`. The problem, by itself, is not new and already has known solutions, including `git.util.rmtree()`. However, just using this function was not enough in my case and I started to dig deeper - there was an error about an open file handle. I discovered there were extra child `git` processes hanging in the process tree, but, unexpectedly, it was happening after all the library objects were removed:\r\n![image](https://user-images.githubusercontent.com/13832349/131838938-b2c962ef-ca7c-4621-b4f5-71c9601f1fee.png)\r\n\r\nThen I tried to catch and trace `Popen` calls from the library and found out this function:\r\nhttps://github.com/gitpython-developers/GitPython/blob/5b3669e24a8ce7f3f482de86fcf95620db643467/git/cmd.py#L1190-L1199\r\n\r\nFrom comments and names, it looks like such persistent behavior is intended. There is also the `AutoInterrupt` class here:\r\nhttps://github.com/gitpython-developers/GitPython/blob/5b3669e24a8ce7f3f482de86fcf95620db643467/git/cmd.py#L367-L373\r\n\r\nreturned from:\r\nhttps://github.com/gitpython-developers/GitPython/blob/5b3669e24a8ce7f3f482de86fcf95620db643467/git/cmd.py#L841\r\n\r\nThe class comment indicates that the process should be killed when the object goes out of scope. To me, it looks like an attempt to imitate [the RAII C++ idiom](https://en.cppreference.com/w/cpp/language/raii). Unfortunately, in Python it does not work this way because of garbage collector and the scoping rules. That is, an object that has no references can be removed in any time after it lost its last reference. The \"pythonic\" way to deal with this behavior is using a context manager (which this class is *not*). \r\n\r\nMy suggestion is to collect these processes and manage them on a library/repo level, or wrap this in a context manager (which is better than just calling `wait()` manually in case of exceptions). BTW, probably, the process created is not reused after the first call.\r\n\r\n``` python\r\nimport git\r\nr = git.Repo.init('test_repo') \r\nr.index.commit('aa')   \r\ndel r\r\n```\r\nUpd: I see there is an undocumented `repo.close()`, which can help, but can have undesired side-effects because of a forced gc call.","author":{"url":"https://github.com/zhiltsov-max","@type":"Person","name":"zhiltsov-max"},"datePublished":"2021-09-02T12:08:23.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":2},"url":"https://github.com/1333/GitPython/issues/1333"}

route-pattern/_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format)
route-controllervoltron_issues_fragments
route-actionissue_layout
fetch-noncev2:57527582-4a52-bc70-8486-5a52108089a1
current-catalog-service-hash81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114
request-idBC8C:254E6C:25F79E0:310738B:696C9AA1
html-safe-nonce38cf38c4edde0d2bf6116224db1fd0c1b149a3f7a2e7aa0d265a77a7fd9ab333
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCQzhDOjI1NEU2QzoyNUY3OUUwOjMxMDczOEI6Njk2QzlBQTEiLCJ2aXNpdG9yX2lkIjoiODI3NDgzMzkwMTQ4NTg1NzQ0MSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac946a0cb94b8de809190791e27bcabfcc114962c85548548ca3cd2c882bde2970
hovercard-subject-tagissue:986628313
github-keyboard-shortcutsrepository,issues,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/issues_fragments/issue_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/gitpython-developers/GitPython/1333/issue_layout
twitter:imagehttps://opengraph.githubassets.com/e47c5cdb29421269d20ddc836112f024670b4f31b8c246cd76a5d28aeb489060/gitpython-developers/GitPython/issues/1333
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/e47c5cdb29421269d20ddc836112f024670b4f31b8c246cd76a5d28aeb489060/gitpython-developers/GitPython/issues/1333
og:image:altHi, I've faced a problem on Windows with file/directory removal with shutil.rmtree(). The problem, by itself, is not new and already has known solutions, including git.util.rmtree(). However, just ...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamezhiltsov-max
hostnamegithub.com
expected-hostnamegithub.com
None5f99f7c1d70f01da5b93e5ca90303359738944d8ab470e396496262c66e60b8d
turbo-cache-controlno-preview
go-importgithub.com/gitpython-developers/GitPython git https://github.com/gitpython-developers/GitPython.git
octolytics-dimension-user_id503709
octolytics-dimension-user_logingitpython-developers
octolytics-dimension-repository_id1126087
octolytics-dimension-repository_nwogitpython-developers/GitPython
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id1126087
octolytics-dimension-repository_network_root_nwogitpython-developers/GitPython
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release38f4d3209478aaeff3ef254f1919defede86af41
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/gitpython-developers/GitPython/issues/1333#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgitpython-developers%2FGitPython%2Fissues%2F1333
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgitpython-developers%2FGitPython%2Fissues%2F1333
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fissues_fragments%2Fissue_layout&source=header-repo&source_repo=gitpython-developers%2FGitPython
Reloadhttps://github.com/gitpython-developers/GitPython/issues/1333
Reloadhttps://github.com/gitpython-developers/GitPython/issues/1333
Reloadhttps://github.com/gitpython-developers/GitPython/issues/1333
gitpython-developers https://github.com/gitpython-developers
GitPythonhttps://github.com/gitpython-developers/GitPython
Please reload this pagehttps://github.com/gitpython-developers/GitPython/issues/1333
Notifications https://github.com/login?return_to=%2Fgitpython-developers%2FGitPython
Fork 964 https://github.com/login?return_to=%2Fgitpython-developers%2FGitPython
Star 5k https://github.com/login?return_to=%2Fgitpython-developers%2FGitPython
Code https://github.com/gitpython-developers/GitPython
Issues 169 https://github.com/gitpython-developers/GitPython/issues
Pull requests 8 https://github.com/gitpython-developers/GitPython/pulls
Discussions https://github.com/gitpython-developers/GitPython/discussions
Actions https://github.com/gitpython-developers/GitPython/actions
Security Uh oh! There was an error while loading. Please reload this page. https://github.com/gitpython-developers/GitPython/security
Please reload this pagehttps://github.com/gitpython-developers/GitPython/issues/1333
Insights https://github.com/gitpython-developers/GitPython/pulse
Code https://github.com/gitpython-developers/GitPython
Issues https://github.com/gitpython-developers/GitPython/issues
Pull requests https://github.com/gitpython-developers/GitPython/pulls
Discussions https://github.com/gitpython-developers/GitPython/discussions
Actions https://github.com/gitpython-developers/GitPython/actions
Security https://github.com/gitpython-developers/GitPython/security
Insights https://github.com/gitpython-developers/GitPython/pulse
New issuehttps://github.com/login?return_to=https://github.com/gitpython-developers/GitPython/issues/1333
New issuehttps://github.com/login?return_to=https://github.com/gitpython-developers/GitPython/issues/1333
Library leaves dangling processes after usehttps://github.com/gitpython-developers/GitPython/issues/1333#top
acknowledgedhttps://github.com/gitpython-developers/GitPython/issues?q=state%3Aopen%20label%3A%22acknowledged%22
help wantedhttps://github.com/gitpython-developers/GitPython/issues?q=state%3Aopen%20label%3A%22help%20wanted%22
https://github.com/zhiltsov-max
https://github.com/zhiltsov-max
zhiltsov-maxhttps://github.com/zhiltsov-max
on Sep 2, 2021https://github.com/gitpython-developers/GitPython/issues/1333#issue-986628313
https://user-images.githubusercontent.com/13832349/131838938-b2c962ef-ca7c-4621-b4f5-71c9601f1fee.png
GitPython/git/cmd.pyhttps://github.com/gitpython-developers/GitPython/blob/5b3669e24a8ce7f3f482de86fcf95620db643467/git/cmd.py#L1190-L1199
5b3669ehttps://github.com/gitpython-developers/GitPython/commit/5b3669e24a8ce7f3f482de86fcf95620db643467
GitPython/git/cmd.pyhttps://github.com/gitpython-developers/GitPython/blob/5b3669e24a8ce7f3f482de86fcf95620db643467/git/cmd.py#L367-L373
5b3669ehttps://github.com/gitpython-developers/GitPython/commit/5b3669e24a8ce7f3f482de86fcf95620db643467
GitPython/git/cmd.pyhttps://github.com/gitpython-developers/GitPython/blob/5b3669e24a8ce7f3f482de86fcf95620db643467/git/cmd.py#L841
5b3669ehttps://github.com/gitpython-developers/GitPython/commit/5b3669e24a8ce7f3f482de86fcf95620db643467
the RAII C++ idiomhttps://en.cppreference.com/w/cpp/language/raii
acknowledgedhttps://github.com/gitpython-developers/GitPython/issues?q=state%3Aopen%20label%3A%22acknowledged%22
help wantedhttps://github.com/gitpython-developers/GitPython/issues?q=state%3Aopen%20label%3A%22help%20wanted%22
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.