René's URL Explorer Experiment


Title: perf(impit): optimize client and connection reuse across Sessions by Mantisus · Pull Request #2140 · apify/crawlee-python · GitHub

Open Graph Title: perf(impit): optimize client and connection reuse across Sessions by Mantisus · Pull Request #2140 · apify/crawlee-python

X Title: perf(impit): optimize client and connection reuse across Sessions by Mantisus · Pull Request #2140 · apify/crawlee-python

Description: Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included. - perf(impit): optimize client and connection reuse across Sessions by Mantisus · Pull Request #2140 · apify/crawlee-python

Open Graph Description: Description Cookie handling has been moved entirely from impit to ImpitHttpClient. Clients are now reused per proxy instead of being recreated for every Session, so a single client keeps its conne...

X Description: Description Cookie handling has been moved entirely from impit to ImpitHttpClient. Clients are now reused per proxy instead of being recreated for every Session, so a single client keeps its conne...

Opengraph URL: https://github.com/apify/crawlee-python/pull/2140

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/voltron/pull_requests/show/:user_id/:repository/:id/pull_request_layout(.:format)
route-controllervoltron_pull_requests_fragments
route-actionpull_request_layout
fetch-noncev2:8cd0ee1c-b4df-62db-e66a-4fe145e5ac48
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idB7A0:38C5CF:C5D873:FF28B4:6B00EBC3
html-safe-nonce577711b7a46305843e7ca3d693676017f1059d9352518d2a064ced1f6643450f
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCN0EwOjM4QzVDRjpDNUQ4NzM6RkYyOEI0OjZCMDBFQkMzIiwidmlzaXRvcl9pZCI6IjU0MTg2MjU3NTk5OTAzMTE4NzUiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac974bdb1e1b7e689cdf33451a9ace8efc0693eb514887b0673dc184e49b107da0
hovercard-subject-tagpull_request:4229250125
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/pull_requests_fragments/pull_request_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/voltron/pull_requests/show/apify/crawlee-python/2140/pull_request_layout
twitter:imagehttps://opengraph.githubassets.com/5b21655ffc841a20741abe57a6192364d2748c1ddf1173f6383e9cb74bc791a4/apify/crawlee-python/pull/2140
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/5b21655ffc841a20741abe57a6192364d2748c1ddf1173f6383e9cb74bc791a4/apify/crawlee-python/pull/2140
og:image:altDescription Cookie handling has been moved entirely from impit to ImpitHttpClient. Clients are now reused per proxy instead of being recreated for every Session, so a single client keeps its conne...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernameMantisus
hostnamegithub.com
expected-hostnamegithub.com
None4ef498cbabcbe3c50befc7a5b743e7072ee770b4daf0e15e54801180d1fa91fc
turbo-cache-controlno-cache
go-importgithub.com/apify/crawlee-python git https://github.com/apify/crawlee-python.git
octolytics-dimension-user_id24586296
octolytics-dimension-user_loginapify
octolytics-dimension-repository_id741365632
octolytics-dimension-repository_nwoapify/crawlee-python
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id741365632
octolytics-dimension-repository_network_root_nwoapify/crawlee-python
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release9983dd5da06943f833c971dd5b6bc988e2858be5
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-namepull-requests

Links:

Skip to contenthttps://github.com/apify/crawlee-python/pull/2140#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapify%2Fcrawlee-python%2Fpull%2F2140
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapify%2Fcrawlee-python%2Fpull%2F2140
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fpull_requests_fragments%2Fpull_request_layout&source=header-repo&source_repo=apify%2Fcrawlee-python
Reloadhttps://github.com/apify/crawlee-python/pull/2140
Reloadhttps://github.com/apify/crawlee-python/pull/2140
Reloadhttps://github.com/apify/crawlee-python/pull/2140
apifyhttps://github.com/apify
crawlee-pythonhttps://github.com/apify/crawlee-python
Codehttps://github.com/apify/crawlee-python
Issues72 (72)https://github.com/apify/crawlee-python/issues
Pull requests14 (14)https://github.com/apify/crawlee-python/pulls
Discussionshttps://github.com/apify/crawlee-python/discussions
Actionshttps://github.com/apify/crawlee-python/actions
Security and quality1 (1)https://github.com/apify/crawlee-python/security
Insightshttps://github.com/apify/crawlee-python/insights
https://github.com/apify/crawlee-python
vdusekhttps://github.com/vdusek
apify:masterhttps://github.com/apify/crawlee-python/tree/master
Mantisus:impit-manucal-cookieshttps://github.com/Mantisus/crawlee-python/tree/impit-manucal-cookies
Conversationhttps://github.com/apify/crawlee-python/pull/2140
Commits5 (5)https://github.com/apify/crawlee-python/pull/2140/commits
Checkshttps://github.com/apify/crawlee-python/pull/2140/checks
Files changedhttps://github.com/apify/crawlee-python/pull/2140/files
perf(impit): optimize client and connection reuse across Sessionshttps://github.com/apify/crawlee-python/pull/2140#top
vdusekhttps://github.com/vdusek
apify:masterhttps://github.com/apify/crawlee-python/tree/master
Mantisus:impit-manucal-cookieshttps://github.com/Mantisus/crawlee-python/tree/impit-manucal-cookies
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
Aug 7, 2026https://github.com/apify/crawlee-python/pull/2140#issue-5091136751
WHATWG Fetchhttps://fetch.spec.whatwg.org/#http-redirect-fetch
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
https://github.com/Mantisus
optimize client and connection reuse across Sessionshttps://github.com/apify/crawlee-python/pull/2140/commits/0cde6cd67b0c7eaa2b54b678eb8ae6f87ec6ef50
0cde6cdhttps://github.com/apify/crawlee-python/pull/2140/commits/0cde6cd67b0c7eaa2b54b678eb8ae6f87ec6ef50
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
Aug 7, 2026https://github.com/apify/crawlee-python/pull/2140#event-29123915265
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
vdusekhttps://github.com/vdusek
Copilothttps://github.com/apps/copilot-pull-request-reviewer
August 7, 2026 14:33https://github.com/apify/crawlee-python/pull/2140#event-29123929943
started reviewinghttps://github.com/apify/crawlee-python/sessions/882d9006-fc88-4230-b57f-67da72fcd25a
Mantisushttps://github.com/Mantisus
August 7, 2026 14:34https://github.com/apify/crawlee-python/pull/2140#event-29123976012
View session https://github.com/apify/crawlee-python/sessions/882d9006-fc88-4230-b57f-67da72fcd25a
https://github.com/apps/copilot-pull-request-reviewer
Copilothttps://github.com/apps/copilot-pull-request-reviewer
Aug 7, 2026 https://github.com/apify/crawlee-python/pull/2140#pullrequestreview-4883815550
View reviewed changes https://github.com/apify/crawlee-python/pull/2140/files/0cde6cd67b0c7eaa2b54b678eb8ae6f87ec6ef50
Copilothttps://github.com/apps/copilot-pull-request-reviewer
https://github.com/apify/crawlee-python/pull/2140#pullrequestreview-4883815550
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Add Copilot custom instructionshttps://github.com/apify/crawlee-python/new/master?filename=.github/instructions/*.instructions.md
Learn how to get startedhttps://docs.github.com/en/copilot/customizing-copilot/adding-repository-custom-instructions-for-github-copilot
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
src/crawlee/http_clients/_impit.pyhttps://github.com/apify/crawlee-python/pull/2140/files/0cde6cd67b0c7eaa2b54b678eb8ae6f87ec6ef50#diff-162ae563ba92c9c8df7d705c49031789f891e081d9a2ca5d7c74c5a44b0c9b2e
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
src/crawlee/http_clients/_impit.pyhttps://github.com/apify/crawlee-python/pull/2140/files/0cde6cd67b0c7eaa2b54b678eb8ae6f87ec6ef50#diff-162ae563ba92c9c8df7d705c49031789f891e081d9a2ca5d7c74c5a44b0c9b2e
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
src/crawlee/http_clients/_impit.pyhttps://github.com/apify/crawlee-python/pull/2140/files/0cde6cd67b0c7eaa2b54b678eb8ae6f87ec6ef50#diff-162ae563ba92c9c8df7d705c49031789f891e081d9a2ca5d7c74c5a44b0c9b2e
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
https://github.com/Mantisus
https://github.com/apps/copilot-pull-request-reviewer
Potential fix for pull request findinghttps://github.com/apify/crawlee-python/pull/2140/commits/36b96dd65af93d0fdd3769b124bae3f99878f67f
36b96ddhttps://github.com/apify/crawlee-python/pull/2140/commits/36b96dd65af93d0fdd3769b124bae3f99878f67f
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
Pijukatelhttps://github.com/Pijukatel
August 10, 2026 10:13https://github.com/apify/crawlee-python/pull/2140#event-29215718934
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Aug 10, 2026 https://github.com/apify/crawlee-python/pull/2140#pullrequestreview-4896157627
View reviewed changes https://github.com/apify/crawlee-python/pull/2140/files/36b96dd65af93d0fdd3769b124bae3f99878f67f
src/crawlee/http_clients/_impit.pyhttps://github.com/apify/crawlee-python/pull/2140/files/36b96dd65af93d0fdd3769b124bae3f99878f67f#diff-162ae563ba92c9c8df7d705c49031789f891e081d9a2ca5d7c74c5a44b0c9b2e
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
src/crawlee/http_clients/_impit.pyhttps://github.com/apify/crawlee-python/pull/2140/files/36b96dd65af93d0fdd3769b124bae3f99878f67f#diff-162ae563ba92c9c8df7d705c49031789f891e081d9a2ca5d7c74c5a44b0c9b2e
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
src/crawlee/http_clients/_impit.pyhttps://github.com/apify/crawlee-python/pull/2140/files/36b96dd65af93d0fdd3769b124bae3f99878f67f#diff-162ae563ba92c9c8df7d705c49031789f891e081d9a2ca5d7c74c5a44b0c9b2e
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
src/crawlee/http_clients/_impit.pyhttps://github.com/apify/crawlee-python/pull/2140/files/36b96dd65af93d0fdd3769b124bae3f99878f67f#diff-162ae563ba92c9c8df7d705c49031789f891e081d9a2ca5d7c74c5a44b0c9b2e
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
src/crawlee/errors.pyhttps://github.com/apify/crawlee-python/pull/2140/files/36b96dd65af93d0fdd3769b124bae3f99878f67f#diff-1b942a8f67fa59414b5efa5c98ead8c825bbbdb9392af955881d251d6ba12b68
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
src/crawlee/sessions/_cookies.pyhttps://github.com/apify/crawlee-python/pull/2140/files/36b96dd65af93d0fdd3769b124bae3f99878f67f#diff-96ba858669a3999a671533047f14e034772ab75fca7279e772917c4dc0179d6a
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
tests/unit/server.pyhttps://github.com/apify/crawlee-python/pull/2140/files/36b96dd65af93d0fdd3769b124bae3f99878f67f#diff-345ea1d2dee67c8421fccd6e4d7a542318c3113e7124559164b33f9caf15af9b
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
tests/unit/http_clients/test_impit.pyhttps://github.com/apify/crawlee-python/pull/2140/files/36b96dd65af93d0fdd3769b124bae3f99878f67f#diff-ded681b1a7e990fe8e0a020b5bf35c7cf51acfde7053fd4f0a5f667f2ea5da35
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
tests/unit/http_clients/test_impit.pyhttps://github.com/apify/crawlee-python/pull/2140/files/36b96dd65af93d0fdd3769b124bae3f99878f67f#diff-ded681b1a7e990fe8e0a020b5bf35c7cf51acfde7053fd4f0a5f667f2ea5da35
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
pyproject.tomlhttps://github.com/apify/crawlee-python/pull/2140/files/36b96dd65af93d0fdd3769b124bae3f99878f67f#diff-50c86b7ed8ac2cf95bd48334961bf0530cdc77b5a56f852c5c61b89d735fd711
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
Mantisushttps://github.com/Mantisus
August 10, 2026 17:03https://github.com/apify/crawlee-python/pull/2140#commits-pushed-8f8c3cc
https://github.com/Mantisus
https://github.com/vdusek
Apply suggestions from code reviewhttps://github.com/apify/crawlee-python/pull/2140/commits/8f8c3cc11d5e06393efe2d9449a832731cfc68a1
8f8c3cchttps://github.com/apify/crawlee-python/pull/2140/commits/8f8c3cc11d5e06393efe2d9449a832731cfc68a1
https://github.com/Mantisus
use update extract_cookies_from_headers methodhttps://github.com/apify/crawlee-python/pull/2140/commits/d1cbb18519751392c1a2d2f018287fcaac38c479
d1cbb18https://github.com/apify/crawlee-python/pull/2140/commits/d1cbb18519751392c1a2d2f018287fcaac38c479
https://github.com/Mantisus
fixhttps://github.com/apify/crawlee-python/pull/2140/commits/81bc9293a74432d28f5d035a2115ec708e74227c
81bc929https://github.com/apify/crawlee-python/pull/2140/commits/81bc9293a74432d28f5d035a2115ec708e74227c
https://github.com/Mantisus
Mantisushttps://github.com/Mantisus
vdusekhttps://github.com/vdusek
August 10, 2026 15:16https://github.com/apify/crawlee-python/pull/2140#event-29230806981
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Aug 10, 2026 https://github.com/apify/crawlee-python/pull/2140#pullrequestreview-4899196680
View reviewed changes https://github.com/apify/crawlee-python/pull/2140/files/81bc9293a74432d28f5d035a2115ec708e74227c
vdusekhttps://github.com/vdusek
https://github.com/apify/crawlee-python/pull/2140#pullrequestreview-4899196680
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Aug 10, 2026 https://github.com/apify/crawlee-python/pull/2140#pullrequestreview-4899201112
View reviewed changes https://github.com/apify/crawlee-python/pull/2140/files/81bc9293a74432d28f5d035a2115ec708e74227c
vdusekhttps://github.com/vdusek
https://github.com/apify/crawlee-python/pull/2140#pullrequestreview-4899201112
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
https://github.com/vdusek
vdusekhttps://github.com/vdusek
cd7ab2bhttps://github.com/apify/crawlee-python/commit/cd7ab2b7020f0d6d0c7091db6ca1729bd0883f0f
Aug 17, 2026https://github.com/apify/crawlee-python/pull/2140#event-29547704197
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
https://github.co/hiddenchars
https://github.com/apify/crawlee-python/pull/{{ revealButtonHref }}
Sign up for freehttps://github.com/join?source=comment-repo
Sign in to commenthttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapify%2Fcrawlee-python%2Fpull%2F2140
Copilot code review https://github.com/apps/copilot-pull-request-reviewer
Copilot https://github.com/apps/copilot-pull-request-reviewer
Learn more about Copilot code review.https://gh.io/copilot-code-review-docs
https://github.com/apify/crawlee-python/pull/2140/files/0cde6cd67b0c7eaa2b54b678eb8ae6f87ec6ef50
https://github.com/vdusek
vdusek https://github.com/vdusek
https://github.com/apify/crawlee-python/pull/2140/files/81bc9293a74432d28f5d035a2115ec708e74227c
https://github.com/Pijukatel
Pijukatel https://github.com/Pijukatel
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
https://github.com/Mantisus
Mantisus https://github.com/Mantisus
Please reload this pagehttps://github.com/apify/crawlee-python/pull/2140
https://github.com/Mantisus
https://github.com/vdusek
https://github.com/apps/copilot-pull-request-reviewer
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.