René's URL Explorer Experiment


Title: Python Durable Functions on DTS: oversized orchestrator completion fails the orchestration invisibly, and large-payload externalization can't be enabled · Issue #269 · microsoft/durabletask-python · GitHub

Open Graph Title: Python Durable Functions on DTS: oversized orchestrator completion fails the orchestration invisibly, and large-payload externalization can't be enabled · Issue #269 · microsoft/durabletask-python

X Title: Python Durable Functions on DTS: oversized orchestrator completion fails the orchestration invisibly, and large-payload externalization can't be enabled · Issue #269 · microsoft/durabletask-python

Description: Environment Azure Functions, Python 3.14, Elastic Premium, storageProvider.type: "azureManaged" (Durable Task Scheduler) azure-functions-durable==2.0.0rc1 (on durabletask==1.10.1), azure-functions==2.3.0 Durable extension 3.14.0 via Micr...

Open Graph Description: Environment Azure Functions, Python 3.14, Elastic Premium, storageProvider.type: "azureManaged" (Durable Task Scheduler) azure-functions-durable==2.0.0rc1 (on durabletask==1.10.1), azure-functions=...

X Description: Environment Azure Functions, Python 3.14, Elastic Premium, storageProvider.type: "azureManaged" (Durable Task Scheduler) azure-functions-durable==2.0.0rc1 (on durabletask==1.10.1), azure-...

Opengraph URL: https://github.com/microsoft/durabletask-python/issues/269

X: @github

direct link

Domain: github.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Python Durable Functions on DTS: oversized orchestrator completion fails the orchestration invisibly, and large-payload externalization can't be enabled","articleBody":"### Environment\n\n- Azure Functions, Python 3.14, Elastic Premium, `storageProvider.type: \"azureManaged\"` (Durable Task Scheduler)\n- `azure-functions-durable==2.0.0rc1` (on `durabletask==1.10.1`), `azure-functions==2.3.0`\n- Durable extension 3.14.0 via `Microsoft.Azure.Functions.ExtensionBundle.Preview [4.29.0, 5.0.0)`\n\nWe have an instance ID and task-hub details for a production occurrence and can share them privately.\n\n### What happened\n\nAn orchestrator fanned out 121 activities; each result was 2–48 KB. When the last one completed, the orchestrator scheduled one more activity whose input was the fanned-in result list. The scheduler rejected that episode and marked the orchestration Failed:\n\n```\nruntimeStatus:            FAILED\nfailureDetails.errorType: InvalidOperationException\nfailureDetails.message:   The complete orchestration work item request of size 11.05MB exceeds the 3.90MB limit.\n                          Enable large-payload externalization to Azure Blob Storage to support oversized completion requests.\nExecutionCompletedEvent:  orchestration_status 3, isNonRetriable: true\n```\n\n(Retrieved with `DurableTaskSchedulerClient.get_orchestration_state(fetch_payloads=True)` and `get_orchestration_history()`.)\n\n### Problems\n\n1. **The failure never reaches the app.** No exception surfaces in orchestrator code, so our `try/except` compensation (refund, user notification) never ran. The host and Application Insights log nothing. The last host line for the instance is `Orchestrator orchestrate_process_document yielded with 1 task(s) and 0 event(s) outstanding`. The failure exists only in scheduler state, and our users see a review stuck in \"processing\".\n2. **The rejected episode's triggering completion isn't in history.** History has 121 `TaskScheduled` events but only 120 `TaskCompleted`. The missing completion is the activity whose result triggered the rejected episode, and the host logged that activity as `Completed`. We assume this follows from the work item being rejected as a unit, but it means history and host logs disagree.\n3. **The 3.90 MB limit isn't documented.** The published DTS limits describe 1 MB per activity input/output. The cap on the orchestrator completion request, and the fact that scheduled-activity inputs count toward it, aren't documented anywhere we found. Our code had assumed the orchestrator→activity direction was safe.\n4. **The suggested fix isn't available to us.** The error message recommends large-payload externalization. `durabletask` 1.10.1 has it (`durabletask[azure-blob-payloads]`), and its worker externalizes `OrchestratorResponse` payloads when given a `payload_store`. But `azure-functions-durable` 2.0.0rc1 constructs `DurableFunctionsWorker` and `DurableFunctionsClient` without one, and exposes no way to pass one. The [large payload docs](https://learn.microsoft.com/en-us/azure/durable-task/scheduler/durable-task-scheduler-large-payloads) confirm Durable Functions support is .NET-isolated only.\n5. **Serialization inflates payloads for non-Latin text.** The stored activity results were 2.55 MB of UTF-8 (mostly Cyrillic), but the request was 11.05 MB. `azure.functions._durable_functions.df_dumps` calls `json.dumps` with the default `ensure_ascii=True`, so each Cyrillic character becomes a 6-byte `\\uXXXX` escape instead of 2 bytes of UTF-8.\n\n### Asks\n\n1. Deliver an oversized orchestrator completion as a failure the orchestrator can catch, or at least log it on the Functions host with the instance ID.\n2. Document the completion-request limit, and that scheduled-activity inputs count toward it.\n3. Is large-payload support planned for `azure-functions-durable` (Python) on DTS? We'd be glad to contribute a PR. Our rough plan:\n   - accept a `PayloadStore` in `DFApp` or via app settings, and pass it to `DurableFunctionsWorker` and `DurableFunctionsClient`. The orchestrator and entity paths then externalize through the existing `durabletask` hooks, which alone would have prevented the failure above.\n   - in the `activity_trigger` wrapper, resolve token inputs before calling the user function, and externalize outputs over the threshold. The open question is how the token should survive `df_dumps` JSON-quoting on the output side, so that `deexternalize_payloads` recognizes it in `TaskCompleted.result`. We'd like your preference before writing that part.\n4. Would you accept `ensure_ascii=False` in `df_dumps`? It's valid JSON and cuts non-Latin payloads about 3×, but it changes the bytes on the wire, so we'd rather ask first.\n","author":{"url":"https://github.com/nachogarcia","@type":"Person","name":"nachogarcia"},"datePublished":"2026-09-23T16:03:31Z","url":"https://github.com/microsoft/durabletask-python/issues/269"}

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format)
route-controllervoltron_issues_fragments
route-actionissue_layout
fetch-noncev2:ce1e523b-c9e5-53f1-1cac-6738085e8d18
current-catalog-service-hash81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114
request-id907E:4E7F1:3A4E41:4F0CAB:6AFE1E8C
html-safe-noncecd7076a2e5c5eb1bed7c76e09056f1c4bc8fdd19cfdedc8a700084fbb547db4c
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5MDdFOjRFN0YxOjNBNEU0MTo0RjBDQUI6NkFGRTFFOEMiLCJ2aXNpdG9yX2lkIjoiODY2ODUyNDkyNzU3OTQ2MzMwOCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmacd0c9cdd7ab810d25de82d0ad5e58cce99dae8a86903902569028c90e96393ee2
hovercard-subject-tagissue:5556057847
github-keyboard-shortcutsrepository,issues,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/issues_fragments/issue_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/microsoft/durabletask-python/269/issue_layout
twitter:imagehttps://opengraph.githubassets.com/f71af6960c17c9bc7006a580681f8328ba92ab01268e81fa811add2d56a72015/microsoft/durabletask-python/issues/269
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/f71af6960c17c9bc7006a580681f8328ba92ab01268e81fa811add2d56a72015/microsoft/durabletask-python/issues/269
og:image:altEnvironment Azure Functions, Python 3.14, Elastic Premium, storageProvider.type: "azureManaged" (Durable Task Scheduler) azure-functions-durable==2.0.0rc1 (on durabletask==1.10.1), azure-functions=...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamenachogarcia
hostnamegithub.com
expected-hostnamegithub.com
Noned0525ab1464526bf4532a5551aa348cf100dff75ef808a96fc67a08b1d946aa9
turbo-cache-controlno-preview
go-importgithub.com/microsoft/durabletask-python git https://github.com/microsoft/durabletask-python.git
octolytics-dimension-user_id6154722
octolytics-dimension-user_loginmicrosoft
octolytics-dimension-repository_id627664515
octolytics-dimension-repository_nwomicrosoft/durabletask-python
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id627664515
octolytics-dimension-repository_network_root_nwomicrosoft/durabletask-python
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releasefef3993a71fa20f7be8e167132fbf9619bc66e12
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-nameissues

Links:

Skip to contenthttps://github.com/microsoft/durabletask-python/issues/269#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Fdurabletask-python%2Fissues%2F269
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Fdurabletask-python%2Fissues%2F269
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fissues_fragments%2Fissue_layout&source=header-repo&source_repo=microsoft%2Fdurabletask-python
Reloadhttps://github.com/microsoft/durabletask-python/issues/269
Reloadhttps://github.com/microsoft/durabletask-python/issues/269
Reloadhttps://github.com/microsoft/durabletask-python/issues/269
microsofthttps://github.com/microsoft
durabletask-pythonhttps://github.com/microsoft/durabletask-python
Codehttps://github.com/microsoft/durabletask-python
Issues15 (15)https://github.com/microsoft/durabletask-python/issues
Pull requests12 (12)https://github.com/microsoft/durabletask-python/pulls
Actionshttps://github.com/microsoft/durabletask-python/actions
Projectshttps://github.com/microsoft/durabletask-python/projects
Security and qualityhttps://github.com/microsoft/durabletask-python/security
Insightshttps://github.com/microsoft/durabletask-python/insights
https://github.com/microsoft/durabletask-python
New issuehttps://github.com/login?return_to=https://github.com/microsoft/durabletask-python/issues/269
New issuehttps://github.com/login?return_to=https://github.com/microsoft/durabletask-python/issues/269
Python Durable Functions on DTS: oversized orchestrator completion fails the orchestration invisibly, and large-payload externalization can't be enabledhttps://github.com/microsoft/durabletask-python/issues/269#top
https://github.com/nachogarcia
Nacho García (nachogarcia)https://github.com/nachogarcia
on Sep 23, 2026https://github.com/microsoft/durabletask-python/issues/269#issue-5556057847
large payload docshttps://learn.microsoft.com/en-us/azure/durable-task/scheduler/durable-task-scheduler-large-payloads
Bernd Verst (berndverst)https://github.com/berndverst
on Oct 12, 2026https://github.com/microsoft/durabletask-python/issues/269#event-33077862182
[Azure Functions/DTS] Surface oversized orchestrator completion failures in the app or host logs #288https://github.com/microsoft/durabletask-python/issues/288
[Azure Functions/DTS] Document orchestration completion-request size limits #290https://github.com/microsoft/durabletask-python/issues/290
[Azure Functions/DTS] Enable configurable large-payload externalization #289https://github.com/microsoft/durabletask-python/issues/289
[Azure Functions] Reduce non-Latin payload inflation in df_dumps #291https://github.com/microsoft/durabletask-python/issues/291
https://github.com/berndverst
Bernd Verst (berndverst)https://github.com/berndverst
on Oct 12, 2026https://github.com/microsoft/durabletask-python/issues/269#issuecomment-6131875158
azure-functions-durable==2.0.0rc2https://github.com/microsoft/durabletask-python/releases/tag/azurefunctions-v2.0.0rc2
#270https://github.com/microsoft/durabletask-python/pull/270
#271https://github.com/microsoft/durabletask-python/issues/271
rc2 release upgrade guidancehttps://github.com/microsoft/durabletask-python/releases/tag/azurefunctions-v2.0.0rc2
Python Functions large-payload documentationhttps://github.com/microsoft/durabletask-python/blob/azurefunctions-v2.0.0rc2/azure-functions-durable/README.md#large-payloads
https://github.com/berndverst
Bernd Verst (berndverst)https://github.com/berndverst
on Oct 12, 2026https://github.com/microsoft/durabletask-python/issues/269#issuecomment-6132700919
#288https://github.com/microsoft/durabletask-python/issues/288
https://github.com/Azure/azure-functions-durable-extensionhttps://github.com/Azure/azure-functions-durable-extension
sophiatevhttps://github.com/sophiatev
#290https://github.com/microsoft/durabletask-python/issues/290
https://github.com/Azure/azure-functions-durable-extensionhttps://github.com/Azure/azure-functions-durable-extension
#291https://github.com/microsoft/durabletask-python/issues/291
https://github.com/andystaples
andystapleshttps://github.com/andystaples
on Oct 13, 2026https://github.com/microsoft/durabletask-python/issues/269#issuecomment-6150508535
Nacho García (@nachogarcia)https://github.com/nachogarcia
#249https://github.com/microsoft/durabletask-python/issues/249
https://github.com/nachogarcia
Nacho García (nachogarcia)https://github.com/nachogarcia
on Oct 19, 2026https://github.com/microsoft/durabletask-python/issues/269#issuecomment-6265715312
Bernd Verst (@berndverst)https://github.com/berndverst
andystapleshttps://github.com/andystaples
[Azure Functions/DTS] Document orchestration completion-request size limits #290https://github.com/microsoft/durabletask-python/issues/290
[Azure Functions/DTS] Surface oversized orchestrator completion failures in the app or host logs #288https://github.com/microsoft/durabletask-python/issues/288
[Azure Functions] Reduce non-Latin payload inflation in df_dumps #291https://github.com/microsoft/durabletask-python/issues/291
Allow Azure Functions Durable 2.x apps to opt in to JsonDataConverter #249https://github.com/microsoft/durabletask-python/issues/249
https://github.com/andystaples
andystapleshttps://github.com/andystaples
on Oct 22, 2026https://github.com/microsoft/durabletask-python/issues/269#issuecomment-6347017426
Nacho García (@nachogarcia)https://github.com/nachogarcia
DTS oversized orchestration completion failures bypass Functions host error reporting Azure/azure-functions-durable-extension#3569https://github.com/Azure/azure-functions-durable-extension/issues/3569
Proposal: Request-budget-aware large-payload externalization in the Python SDK #311https://github.com/microsoft/durabletask-python/issues/311
[Azure Functions] Add DTS coverage for isolation of SDK-managed missing-payload failures #312https://github.com/microsoft/durabletask-python/issues/312
[AzureManaged] Isolate host-side payload hydration failures from unrelated in-flight work Azure/azure-functions-durable-extension#3582https://github.com/Azure/azure-functions-durable-extension/issues/3582
Force-terminate operation for stuck orchestrations Azure/azure-functions-durable-extension#2081https://github.com/Azure/azure-functions-durable-extension/issues/2081
[Azure Functions] Add opt-in Unicode JSON serialization #292https://github.com/microsoft/durabletask-python/pull/292
Sign up for freehttps://github.com/signup?return_to=https://github.com/microsoft/durabletask-python/issues/269
Sign in to commenthttps://github.com/login?return_to=https://github.com/microsoft/durabletask-python/issues/269
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.