René's URL Explorer Experiment


Title: Proposal: Request-budget-aware large-payload externalization in the Python SDK · Issue #311 · microsoft/durabletask-python · GitHub

Open Graph Title: Proposal: Request-budget-aware large-payload externalization in the Python SDK · Issue #311 · microsoft/durabletask-python

X Title: Proposal: Request-budget-aware large-payload externalization in the Python SDK · Issue #311 · microsoft/durabletask-python

Description: Summary Extend Python SDK-managed large-payload externalization so an orchestration response can offload supported payloads that are individually below the configured per-payload threshold when their combined serialized response exceeds ...

Open Graph Description: Summary Extend Python SDK-managed large-payload externalization so an orchestration response can offload supported payloads that are individually below the configured per-payload threshold when the...

X Description: Summary Extend Python SDK-managed large-payload externalization so an orchestration response can offload supported payloads that are individually below the configured per-payload threshold when the...

Opengraph URL: https://github.com/microsoft/durabletask-python/issues/311

X: @github

direct link

Domain: github.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Proposal: Request-budget-aware large-payload externalization in the Python SDK","articleBody":"## Summary\n\nExtend Python SDK-managed large-payload externalization so an orchestration response can offload supported payloads that are individually below the configured per-payload threshold when their combined serialized response exceeds a size budget.\n\nThis is a draft feature proposal; the public API, budget calculation, and defaults need design review. It is scoped as a Python SDK enhancement using the existing payload-store/reference protocol, not as a change to the DTS transport limit.\n\nParent: [#269, follow-up comment, ask 2](https://github.com/microsoft/durabletask-python/issues/269#issuecomment-6265715312).\n\n## Problem\n\nCurrent externalization considers each payload independently. A fan-out episode can schedule tens or hundreds of activities whose inputs are each below `threshold_bytes`, while the orchestration response containing those inputs exceeds the aggregate completion-request limit. No individual payload qualifies for offloading, so enabling large-payload storage alone does not address this case.\n\nThe reporter currently uses host-side `payloadStorageEnabled` and encountered repeated oversized-completion retries. They also explicitly asked whether Python's `configure_large_payloads()` would have the same per-payload limitation. It currently does.\n\nLowering the per-payload threshold can mitigate the problem, but requires applications to anticipate fan-out size and externalizes more data even when the overall response would fit.\n\n## Proposed behavior\n\nWith SDK-managed payload storage and request-budget-aware externalization enabled:\n\n1. Preserve the existing per-payload externalization policy.\n2. Measure the resulting serialized orchestration response against a defined byte budget.\n3. If it remains too large, select additional supported payload fields below the normal threshold, starting with the largest useful candidates, and replace them with existing payload-store references until the response fits or no further useful reduction is possible.\n4. Recalculate the serialized size with actual references and protocol overhead rather than treating the sum of application payload lengths as the response size.\n5. If the response cannot fit, report an explicit, actionable failure through the supported execution path. Do not silently drop actions, truncate application data, or claim that arbitrary fan-out can always be made to fit.\n\nThe exact configuration surface is intentionally unspecified. An explicit opt-in should preserve existing threshold-only behavior for applications that do not select this policy. Reuse the existing `PayloadStore`, Functions-compatible reference encoding, and hydration paths; no new protobuf fields or backend feature should be inherently necessary for the externalization mechanism.\n\n## Scope and transport boundaries\n\n- Implement the reusable policy in the core `durabletask` payload machinery and make it usable by native workers and the `azure-functions-durable` orchestration response path, including synchronous/asynchronous execution where applicable.\n- Verify that `durabletask.azuremanaged` continues to work with the shared core behavior.\n- Python Functions applications must configure SDK-managed storage through `DFApp.configure_large_payloads(payload_store=...)` to benefit. Host-side `payloadStorageEnabled` alone does not enable Python SDK externalization; changing the host/provider implementation is separate work.\n- A Python `OrchestratorResponse` is not the final DTS completion request. The Functions host constructs the downstream request, and native transports also have their own envelopes. Define the measured boundary and account for downstream expansion/overhead when selecting a budget. Do not present a Python response-size check as an exact guarantee of final DTS request size without establishing that relationship.\n- This does not raise or remove the server's aggregate request limit, introduce new acknowledged-completion semantics, or make post-execution transport failures catchable inside orchestrator compensation code.\n\n## Acceptance criteria\n\n- A response containing many individually subthreshold activity inputs can trigger additional offloading when it exceeds the selected aggregate budget.\n- Responses already within budget retain normal per-payload behavior; applications not opting in retain existing behavior.\n- Size checks use serialized bytes and cover Unicode, protobuf overhead, and the actual replacement references, not character counts or only summed payload sizes.\n- Only supported durable payload fields are externalized. Existing references remain recognizable and are not uploaded again as application payloads; replay and retry behavior remain compatible.\n- Storage-size limits and existing preflight guarantees remain respected. Storage failures and cancellation are surfaced without success-shaped fallbacks or loss of durable actions.\n- An irreducibly oversized response, including one dominated by action/reference/metadata overhead, has a documented explicit failure outcome rather than an assertion that offloading always solves the limit.\n- Regression coverage exercises the shared policy, the Python Functions response path, native/AzureManaged compatibility, threshold and budget boundaries, and round-trip hydration of newly offloaded subthreshold payloads.\n- Documentation explains the aggregate-versus-per-payload distinction, the measured transport boundary, SDK-versus-host configuration, and limitations. Record user-visible changes in each affected package's changelog.\n\n## Design questions\n\n- What is the appropriate public configuration surface and safe budget policy for native workers versus Functions-hosted responses?\n- How should downstream host request expansion be accounted for without baking an unverified DTS-specific limit into a generic payload store?\n- What supported failure path should be used when further externalization cannot bring the response within budget?\n\n## Related work\n\n- [#270](https://github.com/microsoft/durabletask-python/pull/270) added Python Functions SDK-managed payload configuration; this proposal builds on it.\n- [#292](https://github.com/microsoft/durabletask-python/pull/292) adds opt-in Unicode JSON serialization. Reduced escaping helps but does not solve aggregate fan-out limits.\n- [Azure/azure-functions-durable-extension#3569](https://github.com/Azure/azure-functions-durable-extension/issues/3569) tracks completion-failure observability. This proposal is an independent payload-size mitigation, not a replacement for that work.","author":{"url":"https://github.com/andystaples","@type":"Person","name":"andystaples"},"datePublished":"2026-10-22T16:49:29Z","url":"https://github.com/microsoft/durabletask-python/issues/311"}

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format)
route-controllervoltron_issues_fragments
route-actionissue_layout
fetch-noncev2:938cb125-fd2a-e47e-b5b9-8e5d7c216296
current-catalog-service-hash81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114
request-idAADA:F8B73:3B81E0:506A9F:6AFE1E8E
html-safe-nonce7e0f4eb55614e756a853feae98e8d850dbc0e8313a46c22702c846837a0bf8cb
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBQURBOkY4QjczOjNCODFFMDo1MDZBOUY6NkFGRTFFOEUiLCJ2aXNpdG9yX2lkIjoiMzUwNTczNzkyNDM5MTg3MDA5NCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac7d7ffd2983cf73bab476a37c6b93eeba310221cb7a9814be56f48b2059de6510
hovercard-subject-tagissue:5983692646
github-keyboard-shortcutsrepository,issues,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/issues_fragments/issue_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/microsoft/durabletask-python/311/issue_layout
twitter:imagehttps://opengraph.githubassets.com/6c75f42a004ec57c1a93b6ed01bb9efb39a58112e30349160055692e709d86c7/microsoft/durabletask-python/issues/311
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/6c75f42a004ec57c1a93b6ed01bb9efb39a58112e30349160055692e709d86c7/microsoft/durabletask-python/issues/311
og:image:altSummary Extend Python SDK-managed large-payload externalization so an orchestration response can offload supported payloads that are individually below the configured per-payload threshold when the...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernameandystaples
hostnamegithub.com
expected-hostnamegithub.com
Noned0525ab1464526bf4532a5551aa348cf100dff75ef808a96fc67a08b1d946aa9
turbo-cache-controlno-preview
go-importgithub.com/microsoft/durabletask-python git https://github.com/microsoft/durabletask-python.git
octolytics-dimension-user_id6154722
octolytics-dimension-user_loginmicrosoft
octolytics-dimension-repository_id627664515
octolytics-dimension-repository_nwomicrosoft/durabletask-python
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id627664515
octolytics-dimension-repository_network_root_nwomicrosoft/durabletask-python
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releasefef3993a71fa20f7be8e167132fbf9619bc66e12
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-nameissues

Links:

Skip to contenthttps://github.com/microsoft/durabletask-python/issues/311#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Fdurabletask-python%2Fissues%2F311
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Fdurabletask-python%2Fissues%2F311
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fissues_fragments%2Fissue_layout&source=header-repo&source_repo=microsoft%2Fdurabletask-python
Reloadhttps://github.com/microsoft/durabletask-python/issues/311
Reloadhttps://github.com/microsoft/durabletask-python/issues/311
Reloadhttps://github.com/microsoft/durabletask-python/issues/311
microsofthttps://github.com/microsoft
durabletask-pythonhttps://github.com/microsoft/durabletask-python
Codehttps://github.com/microsoft/durabletask-python
Issues15 (15)https://github.com/microsoft/durabletask-python/issues
Pull requests12 (12)https://github.com/microsoft/durabletask-python/pulls
Actionshttps://github.com/microsoft/durabletask-python/actions
Projectshttps://github.com/microsoft/durabletask-python/projects
Security and qualityhttps://github.com/microsoft/durabletask-python/security
Insightshttps://github.com/microsoft/durabletask-python/insights
https://github.com/microsoft/durabletask-python
New issuehttps://github.com/login?return_to=https://github.com/microsoft/durabletask-python/issues/311
New issuehttps://github.com/login?return_to=https://github.com/microsoft/durabletask-python/issues/311
Proposal: Request-budget-aware large-payload externalization in the Python SDKhttps://github.com/microsoft/durabletask-python/issues/311#top
enhancementNew feature or requesthttps://github.com/microsoft/durabletask-python/issues?q=state%3Aopen%20label%3A%22enhancement%22
https://github.com/andystaples
andystapleshttps://github.com/andystaples
on Oct 22, 2026https://github.com/microsoft/durabletask-python/issues/311#issue-5983692646
#269, follow-up comment, ask 2https://github.com/microsoft/durabletask-python/issues/269#issuecomment-6265715312
#270https://github.com/microsoft/durabletask-python/pull/270
#292https://github.com/microsoft/durabletask-python/pull/292
Azure/azure-functions-durable-extension#3569https://github.com/Azure/azure-functions-durable-extension/issues/3569
andystapleshttps://github.com/andystaples
enhancementNew feature or requesthttps://github.com/microsoft/durabletask-python/issues?q=state%3Aopen%20label%3A%22enhancement%22
on Nov 11, 2026https://github.com/microsoft/durabletask-python/issues/311#event-35834390644
Sign up for freehttps://github.com/signup?return_to=https://github.com/microsoft/durabletask-python/issues/311
Sign in to commenthttps://github.com/login?return_to=https://github.com/microsoft/durabletask-python/issues/311
enhancementNew feature or requesthttps://github.com/microsoft/durabletask-python/issues?q=state%3Aopen%20label%3A%22enhancement%22
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.