René's URL Explorer Experiment


Title: fix(billing): Skip billing on streamed workflows with byok by TheodoreSpeaks · Pull Request #4056 · simstudioai/sim · GitHub

Open Graph Title: fix(billing): Skip billing on streamed workflows with byok by TheodoreSpeaks · Pull Request #4056 · simstudioai/sim

X Title: fix(billing): Skip billing on streamed workflows with byok by TheodoreSpeaks · Pull Request #4056 · simstudioai/sim

Description: Summary BYOK users were incorrectly billed when using the streamed response. This was because the byok check is skipped for streamed responses because they're streamed live to the user. Added helper method zeroCostForBYOK to zero out cost from the execution stream, while keeping tool costs. Also added tool cost to the execution log cost summary so that the total lines up. Also upgraded logging byok so we can see the logic in prod. Type of Change Bug fix New feature Breaking change Documentation Other: ___________ Testing Replicated bug locally, validated that model costs are 0 after change was applied. Validated non-byok users are billed both for streaming and non-streaming Checklist Code follows project style guidelines Self-reviewed my changes Tests added/updated and passing No new warnings introduced I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA) Screenshots/Videos

Open Graph Description: Summary BYOK users were incorrectly billed when using the streamed response. This was because the byok check is skipped for streamed responses because they're streamed live to the user. Added h...

X Description: Summary BYOK users were incorrectly billed when using the streamed response. This was because the byok check is skipped for streamed responses because they're streamed live to the user. Add...

Opengraph URL: https://github.com/simstudioai/sim/pull/4056

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:8b8f8bd5-d76e-3c1a-d6fa-3e38edb5b496
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idCEF8:147092:694C41:93E3B5:6AFB64C7
html-safe-nonce7ddb47a429af676aae794071325665bd0937cf7b6bdd7b2c2b35c34de5300ab0
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDRUY4OjE0NzA5Mjo2OTRDNDE6OTNFM0I1OjZBRkI2NEM3IiwidmlzaXRvcl9pZCI6IjE2MjEyNjA5MTk0OTkzNTEyMzkiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmacc32fa93dd99010b3f1d659bdc7869b2c8a346acb6ddb5c41344262ef52441332
hovercard-subject-tagpull_request:3505085130
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/4056/files
twitter:imagehttps://avatars.githubusercontent.com/u/19564703?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/19564703?s=400&v=4
og:image:altSummary BYOK users were incorrectly billed when using the streamed response. This was because the byok check is skipped for streamed responses because they're streamed live to the user. Added h...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneea33d13c96d0ff66bd8fa906b193d2213536b78cb06b0c50a4632c58b1418f94
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release59ef97164c52cf59bd10558ddec9c4f482763988
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/4056/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F4056%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F4056%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/4056/files
Reloadhttps://github.com/simstudioai/sim/pull/4056/files
Reloadhttps://github.com/simstudioai/sim/pull/4056/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests197 (197)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
TheodoreSpeakshttps://github.com/TheodoreSpeaks
staginghttps://github.com/simstudioai/sim/tree/staging
debug/byok-agent-blockhttps://github.com/simstudioai/sim/tree/debug/byok-agent-block
Conversation 9 https://github.com/simstudioai/sim/pull/4056
Commits 10 https://github.com/simstudioai/sim/pull/4056/commits
Checks 11 https://github.com/simstudioai/sim/pull/4056/checks
Files changed https://github.com/simstudioai/sim/pull/4056/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/4056/files
fix(billing): Skip billing on streamed workflows with byok https://github.com/simstudioai/sim/pull/4056/files#top
Show all changes 10 commits https://github.com/simstudioai/sim/pull/4056/files
a7839a1 fix(billing): skip billing on streamed workflows with byok TheodoreSpeaks Apr 8, 2026 https://github.com/simstudioai/sim/pull/4056/commits/a7839a12c973dba42f35ae4113bcf5b70540af71
582b262 Simplify logic TheodoreSpeaks Apr 8, 2026 https://github.com/simstudioai/sim/pull/4056/commits/582b2629490379d50d7e0c75e73c8bfbbb80228a
2584bb8 Address comments, skip tokenization billing fallback TheodoreSpeaks Apr 8, 2026 https://github.com/simstudioai/sim/pull/4056/commits/2584bb8dcbfc5c719cfc5355ca1da29de297f803
90535f1 Fix tool usage billing for streamed outputs TheodoreSpeaks Apr 8, 2026 https://github.com/simstudioai/sim/pull/4056/commits/90535f1c2e151ae1542a691796edca48890a03b9
edfdc16 fix(webhook): throw webhook errors as 4xxs (#4050) TheodoreSpeaks Apr 8, 2026 https://github.com/simstudioai/sim/pull/4056/commits/edfdc16236d089dbbc4b71c96f329c11269d2be2
2824421 feat(enterprise): cloud whitelabeling for enterprise orgs (#4047) waleedlatif1 Apr 8, 2026 https://github.com/simstudioai/sim/pull/4056/commits/28244215ec180051aa64240766aa2b98744a53b1
d4ab895 fix(editor): stop highlighting start.input as blue when block is not … waleedlatif1 Apr 8, 2026 https://github.com/simstudioai/sim/pull/4056/commits/d4ab8954cf56606879d5c6da66a386e91aea7817
096bb48 fix: merge subblock values in auto-layout to prevent losing router co… waleedlatif1 Apr 8, 2026 https://github.com/simstudioai/sim/pull/4056/commits/096bb48e2c2f6f9baf3ec8c760814d9844ead9ca
e47f6aa fix(whitelabeling): eliminate logo flash by fetching org settings ser… waleedlatif1 Apr 8, 2026 https://github.com/simstudioai/sim/pull/4056/commits/e47f6aa4e1b354639d11e2ae96a72103dbd42aa4
3792e01 Merge branch 'staging' into debug/byok-agent-block TheodoreSpeaks Apr 8, 2026 https://github.com/simstudioai/sim/pull/4056/commits/3792e01e560e5ec98698bed445cca6e4645d8f49
Clear filters https://github.com/simstudioai/sim/pull/4056/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/4056/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/4056/files
log-details.tsx https://github.com/simstudioai/sim/pull/4056/files#diff-a0c3ab334c9c5dfb51e5b957a4df264e82a008965e06268dc8b8fad438b637ba
streaming.ts https://github.com/simstudioai/sim/pull/4056/files#diff-53648524cef0e25ae74e911dfb07e790d5a66b09f114013680363f771aa89b9c
index.ts https://github.com/simstudioai/sim/pull/4056/files#diff-92244480a807def297332120dcdc4194e4456e8afedcd04786ddff18f495d51a
apps/sim/app/workspace/[workspaceId]/logs/components/log-details/log-details.tsxhttps://github.com/simstudioai/sim/pull/4056/files#diff-a0c3ab334c9c5dfb51e5b957a4df264e82a008965e06268dc8b8fad438b637ba
View file https://github.com/simstudioai/sim/blob/3792e01e560e5ec98698bed445cca6e4645d8f49/apps/sim/app/workspace/%5BworkspaceId%5D/logs/components/log-details/log-details.tsx
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/4056/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/4056/files#diff-a0c3ab334c9c5dfb51e5b957a4df264e82a008965e06268dc8b8fad438b637ba
https://github.com/simstudioai/sim/pull/4056/files#diff-a0c3ab334c9c5dfb51e5b957a4df264e82a008965e06268dc8b8fad438b637ba
https://github.com/simstudioai/sim/pull/4056/files#diff-a0c3ab334c9c5dfb51e5b957a4df264e82a008965e06268dc8b8fad438b637ba
https://github.com/simstudioai/sim/pull/4056/files#diff-a0c3ab334c9c5dfb51e5b957a4df264e82a008965e06268dc8b8fad438b637ba
apps/sim/lib/tokenization/streaming.tshttps://github.com/simstudioai/sim/pull/4056/files#diff-53648524cef0e25ae74e911dfb07e790d5a66b09f114013680363f771aa89b9c
View file https://github.com/simstudioai/sim/blob/3792e01e560e5ec98698bed445cca6e4645d8f49/apps/sim/lib/tokenization/streaming.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/4056/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/4056/files#diff-53648524cef0e25ae74e911dfb07e790d5a66b09f114013680363f771aa89b9c
https://github.com/simstudioai/sim/pull/4056/files#diff-53648524cef0e25ae74e911dfb07e790d5a66b09f114013680363f771aa89b9c
apps/sim/providers/index.tshttps://github.com/simstudioai/sim/pull/4056/files#diff-92244480a807def297332120dcdc4194e4456e8afedcd04786ddff18f495d51a
View file https://github.com/simstudioai/sim/blob/3792e01e560e5ec98698bed445cca6e4645d8f49/apps/sim/providers/index.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/4056/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/4056/files#diff-92244480a807def297332120dcdc4194e4456e8afedcd04786ddff18f495d51a
Please reload this pagehttps://github.com/simstudioai/sim/pull/4056/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/4056/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/4056/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/4056/files
https://github.com/simstudioai/sim/pull/4056/files#diff-92244480a807def297332120dcdc4194e4456e8afedcd04786ddff18f495d51a
https://github.com/simstudioai/sim/pull/4056/files#diff-92244480a807def297332120dcdc4194e4456e8afedcd04786ddff18f495d51a
https://github.com/simstudioai/sim/pull/4056/files#diff-92244480a807def297332120dcdc4194e4456e8afedcd04786ddff18f495d51a
https://github.com/simstudioai/sim/pull/4056/files#diff-92244480a807def297332120dcdc4194e4456e8afedcd04786ddff18f495d51a
https://github.com/simstudioai/sim/pull/4056/files#diff-92244480a807def297332120dcdc4194e4456e8afedcd04786ddff18f495d51a
https://github.com/simstudioai/sim/pull/4056/files#diff-92244480a807def297332120dcdc4194e4456e8afedcd04786ddff18f495d51a
Please reload this pagehttps://github.com/simstudioai/sim/pull/4056/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.