René's URL Explorer Experiment


Title: fix(computer-use): tighten batch and click-to-focus edge cases from the staging audit by waleedlatif1 · Pull Request #10012 · simstudioai/sim · GitHub

Open Graph Title: fix(computer-use): tighten batch and click-to-focus edge cases from the staging audit by waleedlatif1 · Pull Request #10012 · simstudioai/sim

X Title: fix(computer-use): tighten batch and click-to-focus edge cases from the staging audit by waleedlatif1 · Pull Request #10012 · simstudioai/sim

Description: Summary Follow-ups from a deep audit of the computer-use changes on staging (#9994, #9995, #9997, #10004): Batch: every step is validated before step 1 runs (key names, required element/text/value/action, button and clickCount), so a typo never leaves a half-applied batch; a refused first step is reported as "Batch step 1 failed: …" so it is not mistaken for an unsupported batch; the first-step check is completed == 0 && !inputDispatched; cancellation is checked before every later step; dropped dead parameter copying Batch observation: a batch now observes the one window all of its steps target (any untargeted step keeps the focused-window default), like single element/coordinate actions Click-to-focus: waits up to 250 ms for an Accessibility focus request before clicking; a click refused by the mouse guards sends nothing and falls through to the focus check; after a click the caret moves to the end so typing inserts there; activation_required no longer claims nothing was dispatched after a click Accessibility reads: the per-attribute fallback runs only when an element cannot answer a batched read (unsupported / illegal / not implemented), not on timeouts, so a hung app is not asked once per attribute Projection: a wrapper cycle can no longer make a node its own parent; legend describes label/value/placeholder and omitted parents accurately Contract synced from mothership (activateFirst wording); README describes the structure check's limits and the new coverage; removed a dead test parameter Companion: simstudioai/mothership#960 Type of Change Bug fix Testing Native checks on macOS 26 (PASS), including new batch pre-validation cases Live fixture: new case — a click-only editor that already has text inserts at the end (live run pending a free VM; will confirm before merge) desktop computer-use + IPC (101), projection (15), mothership-chat suites; new tests (batch window, wrapper cycle) fail on the previous code Checklist Code follows project style guidelines Self-reviewed my changes Tests added/updated and passing (new tests pass the test-audit authoring gate) No new warnings introduced I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

Open Graph Description: Summary Follow-ups from a deep audit of the computer-use changes on staging (#9994, #9995, #9997, #10004): Batch: every step is validated before step 1 runs (key names, required element/text/value...

X Description: Summary Follow-ups from a deep audit of the computer-use changes on staging (#9994, #9995, #9997, #10004): Batch: every step is validated before step 1 runs (key names, required element/text/value...

Opengraph URL: https://github.com/simstudioai/sim/pull/10012

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:a3f61df1-15e1-cc19-fff8-4ecff55c1082
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idD090:151C40:8F946:CE484:6AFB1BAC
html-safe-nonce933428b9e78dae86e08066669aa362310457b2aab4683c1be0cbff5578f3c942
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJEMDkwOjE1MUM0MDo4Rjk0NjpDRTQ4NDo2QUZCMUJBQyIsInZpc2l0b3JfaWQiOiIyMjQ5NTA1OTgwODIxNDc4MzE2IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac39a23123993838ba82759afb8ae2d9a3175ecf28713dab5f588207de2caed02d
hovercard-subject-tagpull_request:5303045927
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/10012/files
twitter:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
og:image:altSummary Follow-ups from a deep audit of the computer-use changes on staging (#9994, #9995, #9997, #10004): Batch: every step is validated before step 1 runs (key names, required element/text/value...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None24933791aba0f10b2f189f8b953a1452dd79933933ac13a0a67b8ad3acee3d9f
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release030711cc180b563614a434f4376acf7da5d445fa
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/10012/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F10012%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F10012%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/10012/files
Reloadhttps://github.com/simstudioai/sim/pull/10012/files
Reloadhttps://github.com/simstudioai/sim/pull/10012/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests198 (198)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
waleedlatif1https://github.com/waleedlatif1
staginghttps://github.com/simstudioai/sim/tree/staging
fix/computer-use-batch-audithttps://github.com/simstudioai/sim/tree/fix/computer-use-batch-audit
Conversation 21 https://github.com/simstudioai/sim/pull/10012
Commits 3 https://github.com/simstudioai/sim/pull/10012/commits
Checks 88 https://github.com/simstudioai/sim/pull/10012/checks
Files changed https://github.com/simstudioai/sim/pull/10012/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/10012/files
fix(computer-use): tighten batch and click-to-focus edge cases from the staging audit https://github.com/simstudioai/sim/pull/10012/files#top
Show all changes 3 commits https://github.com/simstudioai/sim/pull/10012/files
940cfa9 fix(computer-use): tighten batch and click-to-focus edge cases from t… waleedlatif1 Nov 13, 2026 https://github.com/simstudioai/sim/pull/10012/commits/940cfa9ac174c88280624acacc4b580229109df7
8ec2773 fix(computer-use): check Stop before every batch step, validate click… waleedlatif1 Nov 13, 2026 https://github.com/simstudioai/sim/pull/10012/commits/8ec2773fdcbb7864497d32646782ee28744c99f8
b3da664 fix(computer-use): send no text when the caret cannot be moved to the… waleedlatif1 Nov 13, 2026 https://github.com/simstudioai/sim/pull/10012/commits/b3da66485b03c526de1d5184540aadb4d4e7aaf6
Clear filters https://github.com/simstudioai/sim/pull/10012/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/10012/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/10012/files
ComputerUse.swift https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
README.md https://github.com/simstudioai/sim/pull/10012/files#diff-03fc5e0250cdf6ef5d5dd01b4f430847bd8745da6b657dd1afe6cda2f3d7fc64
NativeTests.swift https://github.com/simstudioai/sim/pull/10012/files#diff-cd5d1989fe678eb5fa91e7bc7ba401d5bf41e3d0a902083097345cabd86944b5
live.py https://github.com/simstudioai/sim/pull/10012/files#diff-c4c5d4127e98667220262780db3add8a3cffa103580548accb07f89c95232d06
service.test.ts https://github.com/simstudioai/sim/pull/10012/files#diff-c6970a4d79eed17b79ba75ba44800ddfb70b269263aa05e9646be91d72ca47a4
service.ts https://github.com/simstudioai/sim/pull/10012/files#diff-ce1c51357a80d69159986c3f4353cbf608bb98703cf84fc65841abe26e32e194
rollout-controls.test.tsx https://github.com/simstudioai/sim/pull/10012/files#diff-e3e1a9237b702a749d3572f5284bdc9cdf9ca5d5dffda3d1947bb32c819e08a3
computer-tool-result.test.ts https://github.com/simstudioai/sim/pull/10012/files#diff-d474c2472b980e3cc5a6db5fadbedac3fbdc84edce15e9f6fec5ab49ae55f2c8
computer-tool-result.ts https://github.com/simstudioai/sim/pull/10012/files#diff-715f275d77b643a72da64fcdeff6a9b76ac8d30d7ade6e619b0459ec02e6a4cb
computer-use.generated.ts https://github.com/simstudioai/sim/pull/10012/files#diff-527b771cb8411b5397ed272d9b3a8eca55a0253bd07f73e9766d10a42475f9b8
apps/desktop/native/computer-use/ComputerUse.swifthttps://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
View file https://github.com/simstudioai/sim/blob/b3da66485b03c526de1d5184540aadb4d4e7aaf6/apps/desktop/native/computer-use/ComputerUse.swift
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/10012/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
Please reload this pagehttps://github.com/simstudioai/sim/pull/10012/files
https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
https://github.com/simstudioai/sim/pull/10012/files#diff-8e77406c8b4bdb699d65031fc9054f5d47a9422c1cdaf440deb111c29853b303
apps/desktop/native/computer-use/README.mdhttps://github.com/simstudioai/sim/pull/10012/files#diff-03fc5e0250cdf6ef5d5dd01b4f430847bd8745da6b657dd1afe6cda2f3d7fc64
View file https://github.com/simstudioai/sim/blob/b3da66485b03c526de1d5184540aadb4d4e7aaf6/apps/desktop/native/computer-use/README.md
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/10012/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/10012/files#diff-03fc5e0250cdf6ef5d5dd01b4f430847bd8745da6b657dd1afe6cda2f3d7fc64
https://github.com/simstudioai/sim/pull/10012/files#diff-03fc5e0250cdf6ef5d5dd01b4f430847bd8745da6b657dd1afe6cda2f3d7fc64
Please reload this pagehttps://github.com/simstudioai/sim/pull/10012/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/10012/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.