René's URL Explorer Experiment


Title: fix(mothership): default chat effort back to high by waleedlatif1 · Pull Request #8659 · simstudioai/sim · GitHub

Open Graph Title: fix(mothership): default chat effort back to high by waleedlatif1 · Pull Request #8659 · simstudioai/sim

X Title: fix(mothership): default chat effort back to high by waleedlatif1 · Pull Request #8659 · simstudioai/sim

Description: Summary Restores high as the reasoning effort a Mothership chat (and a Sim Chat block) runs at until the user picks one. #8634 lowered that default to medium; this flips it back and keeps everything else from #8634. Why A paired benchmark (3 reps, 160 pairs) of main-agent medium vs high effort: medium cost 24% less and ran 27% faster. It also lost correctness: pass rate 90.0% (high) vs 86.9% (medium), 5 losses and 0 wins (one-sided McNemar p = 0.031). Follow-up chats fell from 100% to 90.5%, and late-run recall fell 11 points. The losses repeat on the same tasks: scheduling, multi-turn user correction, and plan-vs-do. The product rule is no intelligence regression, so the default goes back to high. What changed The default lives in one constant: DEFAULT_MOTHERSHIP_EFFORT in apps/sim/lib/mothership/model-options.ts. It changes from 'medium' to 'high'. #8634 already routed every default through this constant, so the change covers: The server fallback (sent effort, then the stored pick, then the default) and the effort the picker shows for a new chat, both through resolveMothershipModelSettings. The none fallback when the model can't run none. The Sim Chat block's dropdown default for new blocks. The block handler's fallback, so a block with no stored value runs at high again. No docs or UI copy state the default, so none changed. Explicit picks under the default flip Turn admission records the effort a send carries as the chat's explicit pick. If the composer sent the default on every send, every chat created while the default was medium would have medium stored as a pick, and this flip would never reach them. It doesn't. The composer sends effort only when the user picked one: the chat's pick from this session, or its stored pick (a real pick, re-sent); for a chat not yet created, the new-chat composer's pick. With no pick, the request omits effort, and admission records nothing (effortChoice is undefined, already asserted in post.test.ts). This PR adds a client test that pins this behaviour. Stored rows: #8634 is on staging only (d32d4c93f7 is not on origin/main), so production has no config.effort rows. Every stored value came from a real pick, so no data migration is needed. What stays from #8634 Low mode in the simple picker. Each label sends exactly its effort: Low/Medium/High/Extra High send low/medium/high/xhigh. A per-chat explicit pick, stored in copilot_chats.config.effort, and PUT /api/mothership/chats/[chatId]/effort. An explicit pick still beats the default: chats where the user picked medium or low keep it. The client pick logic, including #8655's rollback. Test plan post.test.ts: with no stored pick, a chat now runs at high, and a submitted none falls back to high. A stored explicit medium pick is kept. mothership-handler.test.ts: a Sim Chat block with no effort set sends high. set-effort.integration.ts (real Postgres): a chat with no pick, and one whose stored value is out of range, both run at high. use-chat.dom.test.tsx: from a new or an existing chat, a send with no pick omits effort; a medium pick is sent as medium. Red before the fix: with the constant set back to medium, the no-pick server, none fallback and block assertions fail. With the client mutated to always send an effort, the no-pick send tests fail. Local gate: lint, type-check, check:audits, docs-manifest:check, check-block-registry origin/staging, and bun run test (all 19 workspaces green).

Open Graph Description: Summary Restores high as the reasoning effort a Mothership chat (and a Sim Chat block) runs at until the user picks one. #8634 lowered that default to medium; this flips it back and keeps everythin...

X Description: Summary Restores high as the reasoning effort a Mothership chat (and a Sim Chat block) runs at until the user picks one. #8634 lowered that default to medium; this flips it back and keeps everythin...

Opengraph URL: https://github.com/simstudioai/sim/pull/8659

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:4a991f9d-e53c-40e3-37bf-878404d1c36f
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idEDEC:C876F:ACEDDE:EEB0B5:6AFB527D
html-safe-nonce10de815b564e6b5023f820b917e4aa52b7b20347c78b90f0bb163543e6711d7b
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFREVDOkM4NzZGOkFDRURERTpFRUIwQjU6NkFGQjUyN0QiLCJ2aXNpdG9yX2lkIjoiNTQ3MzIyMzA4MzYwODk4NjIzNyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac7753429a5f182c8c0ee101e6cd06d8d91afae296b3a702edeca922b930aacc09
hovercard-subject-tagpull_request:4753661024
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/8659/files
twitter:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
og:image:altSummary Restores high as the reasoning effort a Mothership chat (and a Sim Chat block) runs at until the user picks one. #8634 lowered that default to medium; this flips it back and keeps everythin...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None7122bb414b542dba14d71a3f0b9f6fd2abce715b9f5912d082800563e6c806d1
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releasecbf66c024bb6d10e6955baa7413c54cf13a201bb
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/8659/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F8659%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F8659%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/8659/files
Reloadhttps://github.com/simstudioai/sim/pull/8659/files
Reloadhttps://github.com/simstudioai/sim/pull/8659/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests197 (197)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
waleedlatif1https://github.com/waleedlatif1
staginghttps://github.com/simstudioai/sim/tree/staging
fix/mothership-effort-default-highhttps://github.com/simstudioai/sim/tree/fix/mothership-effort-default-high
Conversation 13 https://github.com/simstudioai/sim/pull/8659
Commits 2 https://github.com/simstudioai/sim/pull/8659/commits
Checks 33 https://github.com/simstudioai/sim/pull/8659/checks
Files changed https://github.com/simstudioai/sim/pull/8659/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/8659/files
fix(mothership): default chat effort back to high https://github.com/simstudioai/sim/pull/8659/files#top
Show all changes 2 commits https://github.com/simstudioai/sim/pull/8659/files
cb9ff0f fix(mothership): default chat effort back to high waleedlatif1 Oct 6, 2026 https://github.com/simstudioai/sim/pull/8659/commits/cb9ff0ff6f4ca55417054df927b67e2e5b3bd0fa
50a252c test(mothership): pin that a send carries effort only when the user p… waleedlatif1 Oct 6, 2026 https://github.com/simstudioai/sim/pull/8659/commits/50a252ce0701d25dbd038d04811cc439760e0b0f
Clear filters https://github.com/simstudioai/sim/pull/8659/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/8659/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/8659/files
use-chat.dom.test.tsx https://github.com/simstudioai/sim/pull/8659/files#diff-f13f1eaa18b785ec858b76bfef8952fc11d2c6730951634aad2c3bf4e167e62e
mothership-handler.test.ts https://github.com/simstudioai/sim/pull/8659/files#diff-b7fe0aaf1232d21318e35e5e3238d117e8b3cd933e4847c53c971d8f95dd9a2d
set-effort.integration.ts https://github.com/simstudioai/sim/pull/8659/files#diff-92ebfcf3101fd569188807bd030e2df9845e9ea865c415599843923b51d984fd
post.test.ts https://github.com/simstudioai/sim/pull/8659/files#diff-6d0b4ca3c83105bc58cee0c55acba06bb1f231570a250386296939e365c11531
model-options.ts https://github.com/simstudioai/sim/pull/8659/files#diff-00c70b2091b3db84bc21a27d838206b611cc5300acaa100197bb0633ec35bdd3
apps/sim/app/workspace/[workspaceId]/home/hooks/use-chat.dom.test.tsxhttps://github.com/simstudioai/sim/pull/8659/files#diff-f13f1eaa18b785ec858b76bfef8952fc11d2c6730951634aad2c3bf4e167e62e
View file https://github.com/simstudioai/sim/blob/50a252ce0701d25dbd038d04811cc439760e0b0f/apps/sim/app/workspace/%5BworkspaceId%5D/home/hooks/use-chat.dom.test.tsx
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/8659/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/8659/files#diff-f13f1eaa18b785ec858b76bfef8952fc11d2c6730951634aad2c3bf4e167e62e
https://github.com/simstudioai/sim/pull/8659/files#diff-f13f1eaa18b785ec858b76bfef8952fc11d2c6730951634aad2c3bf4e167e62e
https://github.com/simstudioai/sim/pull/8659/files#diff-f13f1eaa18b785ec858b76bfef8952fc11d2c6730951634aad2c3bf4e167e62e
https://github.com/simstudioai/sim/pull/8659/files#diff-f13f1eaa18b785ec858b76bfef8952fc11d2c6730951634aad2c3bf4e167e62e
https://github.com/simstudioai/sim/pull/8659/files#diff-f13f1eaa18b785ec858b76bfef8952fc11d2c6730951634aad2c3bf4e167e62e
apps/sim/executor/handlers/mothership/mothership-handler.test.tshttps://github.com/simstudioai/sim/pull/8659/files#diff-b7fe0aaf1232d21318e35e5e3238d117e8b3cd933e4847c53c971d8f95dd9a2d
View file https://github.com/simstudioai/sim/blob/50a252ce0701d25dbd038d04811cc439760e0b0f/apps/sim/executor/handlers/mothership/mothership-handler.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/8659/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/8659/files#diff-b7fe0aaf1232d21318e35e5e3238d117e8b3cd933e4847c53c971d8f95dd9a2d
Please reload this pagehttps://github.com/simstudioai/sim/pull/8659/files
https://github.com/simstudioai/sim/pull/8659/files#diff-b7fe0aaf1232d21318e35e5e3238d117e8b3cd933e4847c53c971d8f95dd9a2d
apps/sim/lib/mothership/chat/application/set-effort.integration.tshttps://github.com/simstudioai/sim/pull/8659/files#diff-92ebfcf3101fd569188807bd030e2df9845e9ea865c415599843923b51d984fd
View file https://github.com/simstudioai/sim/blob/50a252ce0701d25dbd038d04811cc439760e0b0f/apps/sim/lib/mothership/chat/application/set-effort.integration.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/8659/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/8659/files#diff-92ebfcf3101fd569188807bd030e2df9845e9ea865c415599843923b51d984fd
https://github.com/simstudioai/sim/pull/8659/files#diff-92ebfcf3101fd569188807bd030e2df9845e9ea865c415599843923b51d984fd
https://github.com/simstudioai/sim/pull/8659/files#diff-92ebfcf3101fd569188807bd030e2df9845e9ea865c415599843923b51d984fd
apps/sim/lib/mothership/chat/post.test.tshttps://github.com/simstudioai/sim/pull/8659/files#diff-6d0b4ca3c83105bc58cee0c55acba06bb1f231570a250386296939e365c11531
View file https://github.com/simstudioai/sim/blob/50a252ce0701d25dbd038d04811cc439760e0b0f/apps/sim/lib/mothership/chat/post.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/8659/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/8659/files#diff-6d0b4ca3c83105bc58cee0c55acba06bb1f231570a250386296939e365c11531
https://github.com/simstudioai/sim/pull/8659/files#diff-6d0b4ca3c83105bc58cee0c55acba06bb1f231570a250386296939e365c11531
https://github.com/simstudioai/sim/pull/8659/files#diff-6d0b4ca3c83105bc58cee0c55acba06bb1f231570a250386296939e365c11531
apps/sim/lib/mothership/model-options.tshttps://github.com/simstudioai/sim/pull/8659/files#diff-00c70b2091b3db84bc21a27d838206b611cc5300acaa100197bb0633ec35bdd3
View file https://github.com/simstudioai/sim/blob/50a252ce0701d25dbd038d04811cc439760e0b0f/apps/sim/lib/mothership/model-options.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/8659/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/8659/files#diff-00c70b2091b3db84bc21a27d838206b611cc5300acaa100197bb0633ec35bdd3
https://github.com/simstudioai/sim/pull/8659/files#diff-00c70b2091b3db84bc21a27d838206b611cc5300acaa100197bb0633ec35bdd3
Please reload this pagehttps://github.com/simstudioai/sim/pull/8659/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.