René's URL Explorer Experiment


Title: fix: Use container memory and CPU limits when running in a container by Mantisus · Pull Request #2128 · apify/crawlee-python · GitHub

Open Graph Title: fix: Use container memory and CPU limits when running in a container by Mantisus · Pull Request #2128 · apify/crawlee-python

X Title: fix: Use container memory and CPU limits when running in a container by Mantisus · Pull Request #2128 · apify/crawlee-python

Description: Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included. - fix: Use container memory and CPU limits when running in a container by Mantisus · Pull Request #2128 · apify/crawlee-python

Open Graph Description: Description Crawlee now scales against the memory and CPU limits that apply to the process rather than the resources of the host machine. This covers Docker containers, Kubernetes pods, systemd sli...

X Description: Description Crawlee now scales against the memory and CPU limits that apply to the process rather than the resources of the host machine. This covers Docker containers, Kubernetes pods, systemd sli...

Opengraph URL: https://github.com/apify/crawlee-python/pull/2128

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/voltron/pull_requests/show/:user_id/:repository/:id/pull_request_layout(.:format)
route-controllervoltron_pull_requests_fragments
route-actionpull_request_layout
fetch-noncev2:ef0a3e15-999e-85eb-90a4-f4ef29b5779d
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idB66A:1D8AA1:CC6AD2:10EAB1A:6B00F24F
html-safe-nonce02665b2a8db6f9fb5e7ecf13effbfd5540f0669f6e08fa6916cd4de05b74e961
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCNjZBOjFEOEFBMTpDQzZBRDI6MTBFQUIxQTo2QjAwRjI0RiIsInZpc2l0b3JfaWQiOiIzODcxMTYwNDM3Nzg5NzQ5ODM5IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmacc3e098ef4ac7810e29c9827684283b514f6cd2698966f17c493e846d265b5205
hovercard-subject-tagpull_request:4224331000
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/pull_requests_fragments/pull_request_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/voltron/pull_requests/show/apify/crawlee-python/2128/pull_request_layout
twitter:imagehttps://opengraph.githubassets.com/2ca757062a0cde561e2eeaee4eca0d7edbfcc925c2137d4a59e9331187588fa9/apify/crawlee-python/pull/2128
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/2ca757062a0cde561e2eeaee4eca0d7edbfcc925c2137d4a59e9331187588fa9/apify/crawlee-python/pull/2128
og:image:altDescription Crawlee now scales against the memory and CPU limits that apply to the process rather than the resources of the host machine. This covers Docker containers, Kubernetes pods, systemd sli...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernameMantisus
hostnamegithub.com
expected-hostnamegithub.com
None4ef498cbabcbe3c50befc7a5b743e7072ee770b4daf0e15e54801180d1fa91fc
turbo-cache-controlno-cache
go-importgithub.com/apify/crawlee-python git https://github.com/apify/crawlee-python.git
octolytics-dimension-user_id24586296
octolytics-dimension-user_loginapify
octolytics-dimension-repository_id741365632
octolytics-dimension-repository_nwoapify/crawlee-python
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id741365632
octolytics-dimension-repository_network_root_nwoapify/crawlee-python
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release9983dd5da06943f833c971dd5b6bc988e2858be5
ui-targetcanary-2
theme-color#1e2327
color-schemelight dark
react-app-namepull-requests

Links:

Skip to contenthttps://github.com/apify/crawlee-python/pull/2128#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapify%2Fcrawlee-python%2Fpull%2F2128
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapify%2Fcrawlee-python%2Fpull%2F2128
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fpull_requests_fragments%2Fpull_request_layout&source=header-repo&source_repo=apify%2Fcrawlee-python
Reloadhttps://github.com/apify/crawlee-python/pull/2128
Reloadhttps://github.com/apify/crawlee-python/pull/2128
Reloadhttps://github.com/apify/crawlee-python/pull/2128
apifyhttps://github.com/apify
crawlee-pythonhttps://github.com/apify/crawlee-python
Codehttps://github.com/apify/crawlee-python
Issues72 (72)https://github.com/apify/crawlee-python/issues
Pull requests14 (14)https://github.com/apify/crawlee-python/pulls
Discussionshttps://github.com/apify/crawlee-python/discussions
Actionshttps://github.com/apify/crawlee-python/actions
Security and quality1 (1)https://github.com/apify/crawlee-python/security
Insightshttps://github.com/apify/crawlee-python/insights
https://github.com/apify/crawlee-python
vdusekhttps://github.com/vdusek
apify:masterhttps://github.com/apify/crawlee-python/tree/master
Mantisus:container-limitshttps://github.com/Mantisus/crawlee-python/tree/container-limits
Conversationhttps://github.com/apify/crawlee-python/pull/2128
Commits6 (6)https://github.com/apify/crawlee-python/pull/2128/commits
Checkshttps://github.com/apify/crawlee-python/pull/2128/checks
Files changedhttps://github.com/apify/crawlee-python/pull/2128/files
fix: Use container memory and CPU limits when running in a containerhttps://github.com/apify/crawlee-python/pull/2128#top
vdusekhttps://github.com/vdusek
apify:masterhttps://github.com/apify/crawlee-python/tree/master
Mantisus:container-limitshttps://github.com/Mantisus/crawlee-python/tree/container-limits
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
Aug 6, 2026https://github.com/apify/crawlee-python/pull/2128#issue-5085270332
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
Memory metrics ignore container memory limits (no cgroup awareness) #2095https://github.com/apify/crawlee-python/issues/2095
Crawlee increasing concurrency until it dies #1535https://github.com/apify/crawlee-python/issues/1535
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
Copilothttps://github.com/apps/copilot-pull-request-reviewer
August 6, 2026 22:57https://github.com/apify/crawlee-python/pull/2128#event-29090036453
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
Aug 6, 2026https://github.com/apify/crawlee-python/pull/2128#event-29090037037
started reviewinghttps://github.com/apify/crawlee-python/sessions/aa3eaf6e-dfa9-4ec8-9e0b-0f20d46a4e56
Mantisushttps://github.com/Mantisus
August 6, 2026 22:58https://github.com/apify/crawlee-python/pull/2128#event-29090047179
View session https://github.com/apify/crawlee-python/sessions/aa3eaf6e-dfa9-4ec8-9e0b-0f20d46a4e56
https://github.com/apps/copilot-pull-request-reviewer
Copilothttps://github.com/apps/copilot-pull-request-reviewer
Aug 6, 2026 https://github.com/apify/crawlee-python/pull/2128#pullrequestreview-4878636497
View reviewed changes https://github.com/apify/crawlee-python/pull/2128/files
Copilothttps://github.com/apps/copilot-pull-request-reviewer
https://github.com/apify/crawlee-python/pull/2128#pullrequestreview-4878636497
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Add Copilot custom instructionshttps://github.com/apify/crawlee-python/new/master?filename=.github/instructions/*.instructions.md
Learn how to get startedhttps://docs.github.com/en/copilot/customizing-copilot/adding-repository-custom-instructions-for-github-copilot
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
src/crawlee/_utils/cgroup.pyhttps://github.com/apify/crawlee-python/pull/2128/files#diff-bffc0b6cf1b7dfdf0a0399aa248078980292e62afce2e861ad7fd5b417ef9153
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
src/crawlee/_utils/cgroup.pyhttps://github.com/apify/crawlee-python/pull/2128/files#diff-bffc0b6cf1b7dfdf0a0399aa248078980292e62afce2e861ad7fd5b417ef9153
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
vdusekhttps://github.com/vdusek
August 6, 2026 23:14https://github.com/apify/crawlee-python/pull/2128#event-29090444214
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Aug 7, 2026https://github.com/apify/crawlee-python/pull/2128#event-29103173103
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Aug 7, 2026https://github.com/apify/crawlee-python/pull/2128#issuecomment-5213571232
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
Aug 7, 2026https://github.com/apify/crawlee-python/pull/2128#issuecomment-5216902192
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
Pijukatelhttps://github.com/Pijukatel
August 10, 2026 10:12https://github.com/apify/crawlee-python/pull/2128#event-29215696243
https://github.com/Pijukatel
Pijukatelhttps://github.com/Pijukatel
Aug 11, 2026https://github.com/apify/crawlee-python/pull/2128#issuecomment-5250858053
placeholder repohttps://github.com/apify/cgroups-sensor
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
August 12, 2026 09:36https://github.com/apify/crawlee-python/pull/2128#event-29331298296
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
force-pushedhttps://github.com/apify/crawlee-python/compare/9af4150bd55de3e3d7695981fc8be1aa319bb9da..f362479a887b1b0f3899903b854f5501809994bb
9af4150https://github.com/apify/crawlee-python/commit/9af4150bd55de3e3d7695981fc8be1aa319bb9da
f362479https://github.com/apify/crawlee-python/commit/f362479a887b1b0f3899903b854f5501809994bb
Compare https://github.com/apify/crawlee-python/compare/9af4150bd55de3e3d7695981fc8be1aa319bb9da..f362479a887b1b0f3899903b854f5501809994bb
August 18, 2026 11:35https://github.com/apify/crawlee-python/pull/2128#event-29615948103
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
force-pushedhttps://github.com/apify/crawlee-python/compare/165ea86bf88ca6967055469c2a97513e74312d86..e64b8da002acdc3fc1c2a8cc64accb351b4283e2
165ea86https://github.com/apify/crawlee-python/commit/165ea86bf88ca6967055469c2a97513e74312d86
e64b8dahttps://github.com/apify/crawlee-python/commit/e64b8da002acdc3fc1c2a8cc64accb351b4283e2
Compare https://github.com/apify/crawlee-python/compare/165ea86bf88ca6967055469c2a97513e74312d86..e64b8da002acdc3fc1c2a8cc64accb351b4283e2
September 15, 2026 16:27https://github.com/apify/crawlee-python/pull/2128#event-31187854347
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
force-pushedhttps://github.com/apify/crawlee-python/compare/e64b8da002acdc3fc1c2a8cc64accb351b4283e2..512418387389706241c1832fd0d11aa891b1837c
e64b8dahttps://github.com/apify/crawlee-python/commit/e64b8da002acdc3fc1c2a8cc64accb351b4283e2
5124183https://github.com/apify/crawlee-python/commit/512418387389706241c1832fd0d11aa891b1837c
Compare https://github.com/apify/crawlee-python/compare/e64b8da002acdc3fc1c2a8cc64accb351b4283e2..512418387389706241c1832fd0d11aa891b1837c
September 16, 2026 17:23https://github.com/apify/crawlee-python/pull/2128#event-31263465088
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
Sep 17, 2026https://github.com/apify/crawlee-python/pull/2128#event-31337834050
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
Sep 18, 2026https://github.com/apify/crawlee-python/pull/2128#event-31424574222
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
force-pushedhttps://github.com/apify/crawlee-python/compare/512418387389706241c1832fd0d11aa891b1837c..673098c2e5e54328392e5d2a041625b5c7ad30be
5124183https://github.com/apify/crawlee-python/commit/512418387389706241c1832fd0d11aa891b1837c
673098chttps://github.com/apify/crawlee-python/commit/673098c2e5e54328392e5d2a041625b5c7ad30be
Compare https://github.com/apify/crawlee-python/compare/512418387389706241c1832fd0d11aa891b1837c..673098c2e5e54328392e5d2a041625b5c7ad30be
September 18, 2026 23:19https://github.com/apify/crawlee-python/pull/2128#event-31424574307
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
Sep 18, 2026https://github.com/apify/crawlee-python/pull/2128#event-31424915719
https://github.com/Mantisus
respect the memory and CPU limits that apply to the processhttps://github.com/apify/crawlee-python/pull/2128/commits/4863830dff3a3c279a70899f8723f0e8718dda3b
4863830https://github.com/apify/crawlee-python/pull/2128/commits/4863830dff3a3c279a70899f8723f0e8718dda3b
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
force-pushedhttps://github.com/apify/crawlee-python/compare/490efcbc8934fdf8d789d578a35d355c1713a0b7..4863830dff3a3c279a70899f8723f0e8718dda3b
490efcbhttps://github.com/apify/crawlee-python/commit/490efcbc8934fdf8d789d578a35d355c1713a0b7
4863830https://github.com/apify/crawlee-python/commit/4863830dff3a3c279a70899f8723f0e8718dda3b
Compare https://github.com/apify/crawlee-python/compare/490efcbc8934fdf8d789d578a35d355c1713a0b7..4863830dff3a3c279a70899f8723f0e8718dda3b
September 19, 2026 12:03https://github.com/apify/crawlee-python/pull/2128#event-31443600721
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
September 19, 2026 12:10https://github.com/apify/crawlee-python/pull/2128#event-31443756514
https://github.com/Pijukatel
Pijukatelhttps://github.com/Pijukatel
Sep 21, 2026 https://github.com/apify/crawlee-python/pull/2128#pullrequestreview-5263643241
View reviewed changes https://github.com/apify/crawlee-python/pull/2128/files/4863830dff3a3c279a70899f8723f0e8718dda3b
Pijukatelhttps://github.com/Pijukatel
https://github.com/apify/crawlee-python/pull/2128#pullrequestreview-5263643241
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
src/crawlee/_utils/system.pyhttps://github.com/apify/crawlee-python/pull/2128/files/4863830dff3a3c279a70899f8723f0e8718dda3b#diff-93c91bc9ca7b074b7c930ec5e035961773969ce5de0292b7ef2e210afa7fc9aa
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
src/crawlee/_utils/system.pyhttps://github.com/apify/crawlee-python/pull/2128/files/4863830dff3a3c279a70899f8723f0e8718dda3b#diff-93c91bc9ca7b074b7c930ec5e035961773969ce5de0292b7ef2e210afa7fc9aa
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
src/crawlee/configuration.pyhttps://github.com/apify/crawlee-python/pull/2128/files/4863830dff3a3c279a70899f8723f0e8718dda3b#diff-eee007f27993a05b36a1b70843698bf8242a7be27ee5e306d39c5104f67f0089
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
https://github.com/Mantisus
address review updatehttps://github.com/apify/crawlee-python/pull/2128/commits/e5f8010b12bc19a0628936fd6a6dee5e8ac5ee3a
e5f8010https://github.com/apify/crawlee-python/pull/2128/commits/e5f8010b12bc19a0628936fd6a6dee5e8ac5ee3a
https://github.com/Pijukatel
Pijukatelhttps://github.com/Pijukatel
Sep 22, 2026 https://github.com/apify/crawlee-python/pull/2128#pullrequestreview-5274589019
View reviewed changes https://github.com/apify/crawlee-python/pull/2128/files/e5f8010b12bc19a0628936fd6a6dee5e8ac5ee3a
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Sep 24, 2026 https://github.com/apify/crawlee-python/pull/2128#pullrequestreview-5303149305
View reviewed changes https://github.com/apify/crawlee-python/pull/2128/files/e5f8010b12bc19a0628936fd6a6dee5e8ac5ee3a
vdusekhttps://github.com/vdusek
https://github.com/apify/crawlee-python/pull/2128#pullrequestreview-5303149305
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
vdusekhttps://github.com/vdusek
September 25, 2026 14:26https://github.com/apify/crawlee-python/pull/2128#commits-pushed-66167c5
https://github.com/vdusek
refactor: state the memory budget in the default-ratio warninghttps://github.com/apify/crawlee-python/pull/2128/commits/66167c54be9548fcf4b187bb64d5437f29f3a00d
66167c5https://github.com/apify/crawlee-python/pull/2128/commits/66167c54be9548fcf4b187bb64d5437f29f3a00d
https://github.com/vdusek
docs: tighten resource-limit commentshttps://github.com/apify/crawlee-python/pull/2128/commits/d8fbaf080ca200788a891cd9627d70f35edaeb71
d8fbaf0https://github.com/apify/crawlee-python/pull/2128/commits/d8fbaf080ca200788a891cd9627d70f35edaeb71
https://github.com/vdusek
test: drop leading underscore from system test fixtureshttps://github.com/apify/crawlee-python/pull/2128/commits/e5fdcb2008a0ce9973c95e297ddd23f1b755bf06
e5fdcb2https://github.com/apify/crawlee-python/pull/2128/commits/e5fdcb2008a0ce9973c95e297ddd23f1b755bf06
https://github.com/vdusek
test: cover a memory limit without a CPU limithttps://github.com/apify/crawlee-python/pull/2128/commits/06dc4d96c469eb51e43b9a042b6f8c247d4854f7
06dc4d9https://github.com/apify/crawlee-python/pull/2128/commits/06dc4d96c469eb51e43b9a042b6f8c247d4854f7
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Sep 25, 2026https://github.com/apify/crawlee-python/pull/2128#event-31835041520
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Sep 25, 2026 https://github.com/apify/crawlee-python/pull/2128#pullrequestreview-5317657511
View reviewed changes https://github.com/apify/crawlee-python/pull/2128/files/06dc4d96c469eb51e43b9a042b6f8c247d4854f7
vdusekhttps://github.com/vdusek
https://github.com/apify/crawlee-python/pull/2128#pullrequestreview-5317657511
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
https://github.com/vdusek
vdusekhttps://github.com/vdusek
40dafe5https://github.com/apify/crawlee-python/commit/40dafe5f98fbb2f0d84adcf289a4bcd0bedb646b
Sep 25, 2026https://github.com/apify/crawlee-python/pull/2128#event-31835142611
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
Memory metrics ignore container memory limits (no cgroup awareness) #2095 https://github.com/apify/crawlee-python/issues/2095
Crawlee increasing concurrency until it dies #1535 https://github.com/apify/crawlee-python/issues/1535
https://github.com/Pijukatel
Pijukatelhttps://github.com/Pijukatel
Oct 1, 2026 https://github.com/apify/crawlee-python/pull/2128#ref-pullrequest-5659270692
test: Check the memory estimation under every multiprocessing start method #2264 https://github.com/apify/crawlee-python/pull/2264
https://github.co/hiddenchars
https://github.com/apify/crawlee-python/pull/{{ revealButtonHref }}
Sign up for freehttps://github.com/join?source=comment-repo
Sign in to commenthttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapify%2Fcrawlee-python%2Fpull%2F2128
Copilot code review https://github.com/apps/copilot-pull-request-reviewer
Copilot https://github.com/apps/copilot-pull-request-reviewer
Learn more about Copilot code review.https://gh.io/copilot-code-review-docs
https://github.com/apify/crawlee-python/pull/2128/files/87b2adf845906880aae029443ef5ac2ff0762080
https://github.com/vdusek
vdusek https://github.com/vdusek
https://github.com/apify/crawlee-python/pull/2128/files/06dc4d96c469eb51e43b9a042b6f8c247d4854f7
https://github.com/Pijukatel
Pijukatel https://github.com/Pijukatel
https://github.com/apify/crawlee-python/pull/2128/files/e5f8010b12bc19a0628936fd6a6dee5e8ac5ee3a
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
https://github.com/Mantisus
Mantisus https://github.com/Mantisus
Memory metrics ignore container memory limits (no cgroup awareness) https://github.com/apify/crawlee-python/issues/2095
Crawlee increasing concurrency until it dies https://github.com/apify/crawlee-python/issues/1535
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2128
https://github.com/Mantisus
https://github.com/vdusek
https://github.com/Pijukatel
https://github.com/apps/copilot-pull-request-reviewer
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.