René's URL Explorer Experiment


Title: fix: commit request queue dedup cache only after batch_add_requests succeeds by vdusek · Pull Request #975 · apify/apify-sdk-python · GitHub

Open Graph Title: fix: commit request queue dedup cache only after batch_add_requests succeeds by vdusek · Pull Request #975 · apify/apify-sdk-python

X Title: fix: commit request queue dedup cache only after batch_add_requests succeeds by vdusek · Pull Request #975 · apify/apify-sdk-python

Description: Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client. - fix: commit request queue dedup cache only after batch_add_requests succeeds by vdusek · Pull Request #975 · apify/apify-sdk-python

Open Graph Description: Both Apify request queue clients (ApifyRequestQueueSingleClient, ApifyRequestQueueSharedClient) cached new requests locally (the single client also updates _head_requests) before calling batch_add_...

X Description: Both Apify request queue clients (ApifyRequestQueueSingleClient, ApifyRequestQueueSharedClient) cached new requests locally (the single client also updates _head_requests) before calling batch_add_...

Opengraph URL: https://github.com/apify/apify-sdk-python/pull/975

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/voltron/pull_requests/show/:user_id/:repository/:id/pull_request_layout(.:format)
route-controllervoltron_pull_requests_fragments
route-actionpull_request_layout
fetch-noncev2:053bfdb0-79a1-2834-064e-f79308422936
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idB778:249135:591874:770FEA:6B00A800
html-safe-nonce99f78b5787def915b9f967e01a1bad94f787a85f5c697003bd6e1a9b0ca02628
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCNzc4OjI0OTEzNTo1OTE4NzQ6NzcwRkVBOjZCMDBBODAwIiwidmlzaXRvcl9pZCI6IjYzMjc5NDI3NDU0MDcxMzc3OTMiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac7f353dbd7d1cee7cd6091d4b879a3d57061eec80b03493159b325c0ca6704bd2
hovercard-subject-tagpull_request:3853742532
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/pull_requests_fragments/pull_request_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/voltron/pull_requests/show/apify/apify-sdk-python/975/pull_request_layout
twitter:imagehttps://opengraph.githubassets.com/45700cdbb11fd17789b5ce52a684cc69b059e9454c52f723c314df0ac1818bd4/apify/apify-sdk-python/pull/975
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/45700cdbb11fd17789b5ce52a684cc69b059e9454c52f723c314df0ac1818bd4/apify/apify-sdk-python/pull/975
og:image:altBoth Apify request queue clients (ApifyRequestQueueSingleClient, ApifyRequestQueueSharedClient) cached new requests locally (the single client also updates _head_requests) before calling batch_add_...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamevdusek
hostnamegithub.com
expected-hostnamegithub.com
None455b493e3402a3a3a06beac5d20bb7db3da060808b220aa48d6a7eca7c59863a
turbo-cache-controlno-cache
go-importgithub.com/apify/apify-sdk-python git https://github.com/apify/apify-sdk-python.git
octolytics-dimension-user_id24586296
octolytics-dimension-user_loginapify
octolytics-dimension-repository_id573436939
octolytics-dimension-repository_nwoapify/apify-sdk-python
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id573436939
octolytics-dimension-repository_network_root_nwoapify/apify-sdk-python
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release2f575159976167242d488c0b062eb355c4e198b7
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-namepull-requests

Links:

Skip to contenthttps://github.com/apify/apify-sdk-python/pull/975#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapify%2Fapify-sdk-python%2Fpull%2F975
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapify%2Fapify-sdk-python%2Fpull%2F975
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fpull_requests_fragments%2Fpull_request_layout&source=header-repo&source_repo=apify%2Fapify-sdk-python
Reloadhttps://github.com/apify/apify-sdk-python/pull/975
Reloadhttps://github.com/apify/apify-sdk-python/pull/975
Reloadhttps://github.com/apify/apify-sdk-python/pull/975
apifyhttps://github.com/apify
apify-sdk-pythonhttps://github.com/apify/apify-sdk-python
Codehttps://github.com/apify/apify-sdk-python
Issues12 (12)https://github.com/apify/apify-sdk-python/issues
Pull requests10 (10)https://github.com/apify/apify-sdk-python/pulls
Discussionshttps://github.com/apify/apify-sdk-python/discussions
Actionshttps://github.com/apify/apify-sdk-python/actions
Security and qualityhttps://github.com/apify/apify-sdk-python/security
Insightshttps://github.com/apify/apify-sdk-python/insights
https://github.com/apify/apify-sdk-python
vdusekhttps://github.com/vdusek
masterhttps://github.com/apify/apify-sdk-python/tree/master
fix/rq-cache-commit-on-successhttps://github.com/apify/apify-sdk-python/tree/fix/rq-cache-commit-on-success
Conversationhttps://github.com/apify/apify-sdk-python/pull/975
Commits8 (8)https://github.com/apify/apify-sdk-python/pull/975/commits
Checkshttps://github.com/apify/apify-sdk-python/pull/975/checks
Files changedhttps://github.com/apify/apify-sdk-python/pull/975/files
fix: commit request queue dedup cache only after batch_add_requests succeedshttps://github.com/apify/apify-sdk-python/pull/975#top
vdusekhttps://github.com/vdusek
masterhttps://github.com/apify/apify-sdk-python/tree/master
fix/rq-cache-commit-on-successhttps://github.com/apify/apify-sdk-python/tree/fix/rq-cache-commit-on-success
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Jun 12, 2026https://github.com/apify/apify-sdk-python/pull/975#issue-4648189230
Please reload this pagehttps://github.com/apify/apify-sdk-python/pull/975
Please reload this pagehttps://github.com/apify/apify-sdk-python/pull/975
https://github.com/vdusek
fix: commit request queue dedup cache only after batch_add_requests s…https://github.com/apify/apify-sdk-python/pull/975/commits/6a3bf6898e795b2408dded3eb3173d0a31f77389
6a3bf68https://github.com/apify/apify-sdk-python/pull/975/commits/6a3bf6898e795b2408dded3eb3173d0a31f77389
https://github.com/vdusek
vdusekhttps://github.com/vdusek
adhoc https://github.com/apify/apify-sdk-python/issues?q=state%3Aopen%20label%3Aadhoc
t-tooling https://github.com/apify/apify-sdk-python/issues?q=state%3Aopen%20label%3At-tooling
Jun 12, 2026https://github.com/apify/apify-sdk-python/pull/975#event-26668551687
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Jun 12, 2026https://github.com/apify/apify-sdk-python/pull/975#event-26668552564
https://github.com/apps/github-actions
github-actionshttps://github.com/apps/github-actions
142nd sprint - Tooling teamhttps://github.com/apify/apify-sdk-python/milestone/561
Jun 12, 2026https://github.com/apify/apify-sdk-python/pull/975#event-26668588075
https://github.com/apps/github-actions
github-actionshttps://github.com/apps/github-actions
tested https://github.com/apify/apify-sdk-python/issues?q=state%3Aopen%20label%3Atested
Jun 12, 2026https://github.com/apify/apify-sdk-python/pull/975#event-26668588628
https://github.com/apps/codecov
codecovhttps://github.com/apps/codecov
Jun 12, 2026https://github.com/apify/apify-sdk-python/pull/975#issuecomment-4689861953
Please reload this pagehttps://github.com/apify/apify-sdk-python/pull/975
Codecovhttps://app.codecov.io/gh/apify/apify-sdk-python/pull/975?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apify
0daca28https://app.codecov.io/gh/apify/apify-sdk-python/commit/0daca2818860cbcbd0778efa4d73622783ce63cf?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apify
fe358b5https://app.codecov.io/gh/apify/apify-sdk-python/commit/fe358b5362ea1449ddcce2375c82e090e39bcd62?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apify
Flaghttps://app.codecov.io/gh/apify/apify-sdk-python/pull/975/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apify
e2ehttps://app.codecov.io/gh/apify/apify-sdk-python/pull/975/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apify
integrationhttps://app.codecov.io/gh/apify/apify-sdk-python/pull/975/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apify
unithttps://app.codecov.io/gh/apify/apify-sdk-python/pull/975/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apify
Click herehttps://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apify#carryforward-flags-in-the-pull-request-comment
☔ View full report in Codecov by Harnesshttps://app.codecov.io/gh/apify/apify-sdk-python/pull/975?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apify
Share it herehttps://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apify
Test Analyticshttps://docs.codecov.com/docs/test-analytics
JS Bundle Analysishttps://docs.codecov.com/docs/javascript-bundle-analysis
Please reload this pagehttps://github.com/apify/apify-sdk-python/pull/975
vdusekhttps://github.com/vdusek
June 12, 2026 18:27https://github.com/apify/apify-sdk-python/pull/975#commits-pushed-0cbbef5
https://github.com/vdusek
Merge remote-tracking branch 'origin/master' into fix/rq-cache-commit…https://github.com/apify/apify-sdk-python/pull/975/commits/0cbbef51b0a662da70f57fec9a456b6d982d6cd4
0cbbef5https://github.com/apify/apify-sdk-python/pull/975/commits/0cbbef51b0a662da70f57fec9a456b6d982d6cd4
https://github.com/vdusek
fix: keep request queue dedup cache, roll back on batch_add_requests …https://github.com/apify/apify-sdk-python/pull/975/commits/710ecbe48d4fd96812598e4b92849fc124dfbe78
710ecbehttps://github.com/apify/apify-sdk-python/pull/975/commits/710ecbe48d4fd96812598e4b92849fc124dfbe78
https://github.com/vdusek
fix: prevent false dedup success when a concurrent batch_add_requests…https://github.com/apify/apify-sdk-python/pull/975/commits/7203b6f8fd5b9f1395d50a6c6ee4d67d28465c6e
7203b6fhttps://github.com/apify/apify-sdk-python/pull/975/commits/7203b6f8fd5b9f1395d50a6c6ee4d67d28465c6e
https://github.com/vdusek
fix: dedupe concurrent in-flight request adds to avoid redundant plat…https://github.com/apify/apify-sdk-python/pull/975/commits/56d7c553c4bfc8b63cb3f1292996a4145c444b6c
56d7c55https://github.com/apify/apify-sdk-python/pull/975/commits/56d7c553c4bfc8b63cb3f1292996a4145c444b6c
https://github.com/vdusek
refactor: share request-queue in-flight add helpers, add partial-unpr…https://github.com/apify/apify-sdk-python/pull/975/commits/72f459c1f07e94a75d90002a3a0532d2d0e7e520
72f459chttps://github.com/apify/apify-sdk-python/pull/975/commits/72f459c1f07e94a75d90002a3a0532d2d0e7e520
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Pijukatelhttps://github.com/Pijukatel
June 17, 2026 13:31https://github.com/apify/apify-sdk-python/pull/975#event-26862897955
https://github.com/vdusek
vdusekhttps://github.com/vdusek
June 17, 2026 13:31https://github.com/apify/apify-sdk-python/pull/975#event-26862900787
https://github.com/vdusek
vdusekhttps://github.com/vdusek
June 17, 2026 13:35https://github.com/apify/apify-sdk-python/pull/975#event-26863068201
https://github.com/vdusek
docs: clarify in-flight add markers coordinate only in-process concur…https://github.com/apify/apify-sdk-python/pull/975/commits/9cea9a4e3b2331b29f46452aa90e2d2abbb969b8
9cea9a4https://github.com/apify/apify-sdk-python/pull/975/commits/9cea9a4e3b2331b29f46452aa90e2d2abbb969b8
https://github.com/vdusek
vdusekhttps://github.com/vdusek
June 17, 2026 13:51https://github.com/apify/apify-sdk-python/pull/975#event-26863901871
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Copilothttps://github.com/apps/copilot-pull-request-reviewer
June 24, 2026 18:40https://github.com/apify/apify-sdk-python/pull/975#event-27160300599
started reviewinghttps://github.com/apify/apify-sdk-python/sessions/6db851f3-1d6d-48b0-920b-9124b9d9de89
vdusekhttps://github.com/vdusek
June 24, 2026 18:41https://github.com/apify/apify-sdk-python/pull/975#event-27160314223
View session https://github.com/apify/apify-sdk-python/sessions/6db851f3-1d6d-48b0-920b-9124b9d9de89
https://github.com/apps/copilot-pull-request-reviewer
Copilothttps://github.com/apps/copilot-pull-request-reviewer
Jun 24, 2026 https://github.com/apify/apify-sdk-python/pull/975#pullrequestreview-4564974156
View reviewed changes https://github.com/apify/apify-sdk-python/pull/975/files/9cea9a4e3b2331b29f46452aa90e2d2abbb969b8
Copilothttps://github.com/apps/copilot-pull-request-reviewer
https://github.com/apify/apify-sdk-python/pull/975#pullrequestreview-4564974156
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Add Copilot custom instructionshttps://github.com/apify/apify-sdk-python/new/master?filename=.github/instructions/*.instructions.md
Learn how to get startedhttps://docs.github.com/en/copilot/customizing-copilot/adding-repository-custom-instructions-for-github-copilot
Please reload this pagehttps://github.com/apify/apify-sdk-python/pull/975
src/apify/storage_clients/_apify/_utils.pyhttps://github.com/apify/apify-sdk-python/pull/975/files/9cea9a4e3b2331b29f46452aa90e2d2abbb969b8#diff-339d157f9352242c3c29c673791bc76a165fd371b0856459e8758e7f8dda3de2
Please reload this pagehttps://github.com/apify/apify-sdk-python/pull/975
https://github.com/vdusek
fix: shield shared in-flight RQ add markers from caller cancellationhttps://github.com/apify/apify-sdk-python/pull/975/commits/fe358b5362ea1449ddcce2375c82e090e39bcd62
fe358b5https://github.com/apify/apify-sdk-python/pull/975/commits/fe358b5362ea1449ddcce2375c82e090e39bcd62
https://github.com/vdusek
vdusekhttps://github.com/vdusek
Copilothttps://github.com/apps/copilot-pull-request-reviewer
June 24, 2026 18:55https://github.com/apify/apify-sdk-python/pull/975#event-27160837538
started reviewinghttps://github.com/apify/apify-sdk-python/sessions/c2d4d292-4cde-42ee-a302-f292abae4608
vdusekhttps://github.com/vdusek
June 24, 2026 18:56https://github.com/apify/apify-sdk-python/pull/975#event-27160851444
View session https://github.com/apify/apify-sdk-python/sessions/c2d4d292-4cde-42ee-a302-f292abae4608
https://github.com/apps/copilot-pull-request-reviewer
Copilothttps://github.com/apps/copilot-pull-request-reviewer
Jun 24, 2026 https://github.com/apify/apify-sdk-python/pull/975#pullrequestreview-4565075122
View reviewed changes https://github.com/apify/apify-sdk-python/pull/975/files/fe358b5362ea1449ddcce2375c82e090e39bcd62
Copilothttps://github.com/apps/copilot-pull-request-reviewer
https://github.com/apify/apify-sdk-python/pull/975#pullrequestreview-4565075122
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/apify/apify-sdk-python/pull/975
https://github.com/Pijukatel
Pijukatelhttps://github.com/Pijukatel
Jun 25, 2026 https://github.com/apify/apify-sdk-python/pull/975#pullrequestreview-4569744436
View reviewed changes https://github.com/apify/apify-sdk-python/pull/975/files/fe358b5362ea1449ddcce2375c82e090e39bcd62
https://github.com/vdusek
vdusekhttps://github.com/vdusek
078ab87https://github.com/apify/apify-sdk-python/commit/078ab8744c96e61a5226a9d19869b5e0df71ab23
Jun 25, 2026https://github.com/apify/apify-sdk-python/pull/975#event-27191717871
Please reload this pagehttps://github.com/apify/apify-sdk-python/pull/975
https://github.com/vdusek
vdusekhttps://github.com/vdusek
June 25, 2026 10:31https://github.com/apify/apify-sdk-python/pull/975#event-27191718989
https://github.co/hiddenchars
https://github.com/apify/apify-sdk-python/pull/{{ revealButtonHref }}
Sign up for freehttps://github.com/join?source=comment-repo
Sign in to commenthttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapify%2Fapify-sdk-python%2Fpull%2F975
Copilot code review https://github.com/apps/copilot-pull-request-reviewer
Copilot https://github.com/apps/copilot-pull-request-reviewer
Learn more about Copilot code review.https://gh.io/copilot-code-review-docs
https://github.com/apify/apify-sdk-python/pull/975/files/fe358b5362ea1449ddcce2375c82e090e39bcd62
https://github.com/Pijukatel
Pijukatel https://github.com/Pijukatel
https://github.com/apify/apify-sdk-python/pull/975/files/fe358b5362ea1449ddcce2375c82e090e39bcd62
Please reload this pagehttps://github.com/apify/apify-sdk-python/pull/975
https://github.com/vdusek
vdusek https://github.com/vdusek
adhoc https://github.com/apify/apify-sdk-python/issues?q=state%3Aopen%20label%3Aadhoc
t-tooling https://github.com/apify/apify-sdk-python/issues?q=state%3Aopen%20label%3At-tooling
tested https://github.com/apify/apify-sdk-python/issues?q=state%3Aopen%20label%3Atested
142nd sprint - Tooling team https://github.com/apify/apify-sdk-python/milestone/561
Please reload this pagehttps://github.com/apify/apify-sdk-python/pull/975
https://github.com/vdusek
https://github.com/Pijukatel
https://github.com/apps/copilot-pull-request-reviewer
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.