René's URL Explorer Experiment


Title: feat(browser): batch planned page actions and keep snapshot ids after refused clicks by waleedlatif1 · Pull Request #8214 · simstudioai/sim · GitHub

Open Graph Title: feat(browser): batch planned page actions and keep snapshot ids after refused clicks by waleedlatif1 · Pull Request #8214 · simstudioai/sim

X Title: feat(browser): batch planned page actions and keep snapshot ids after refused clicks by waleedlatif1 · Pull Request #8214 · simstudioai/sim

Description: Summary Keep snapshot element ids valid when an observed action is refused before dispatch (e.g. covered by an overlay), so the agent can click the overlay's own close button without re-snapshotting. A failed observed action now only cancels an in-flight capture, which clears refs itself when it starts Add browser_batch: the desktop runs 2–8 single-page interactions from one authorized call, in order, stopping at the first failure or after an action navigates, switches tabs, or invalidates snapshot ids. A batch stopped by a failure reports an error status; once an action has run, a cancelled or timed-out batch reports an unknown outcome so it isn't repeated Companion mothership PR adds the catalog tool, stale-observation pruning, and the benchmark harness changes Companion: simstudioai/mothership#515 Type of Change New feature Bug fix Testing Paired A/B on the production browser model (gemini-3.8-flash), staging vs this branch plus the mothership side: WebGames: 68 → 76 of 104 (exact McNemar p=0.02) REAL web clones: 66 → 64 of 112 (p=0.82); on shared successes −13% rounds, −25% input tokens, −19% wall time Capability suite: 55 → 54 of 56 (p=1); the two misses are a pre-existing download-stall flake seen on every arm Refused-overlay clicks followed by a wasted "ids not valid" round: 11 of 20 → 0 of 20 Desktop 1,878 tests, Sim browser client 1,160 tests, type-check, lint, and all 49 audits pass. New tests were checked to fail without their fix. Checklist Code follows project style guidelines Self-reviewed my changes Tests added/updated and passing No new warnings introduced I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

Open Graph Description: Summary Keep snapshot element ids valid when an observed action is refused before dispatch (e.g. covered by an overlay), so the agent can click the overlay's own close button without re-snapsh...

X Description: Summary Keep snapshot element ids valid when an observed action is refused before dispatch (e.g. covered by an overlay), so the agent can click the overlay's own close button without re-sn...

Opengraph URL: https://github.com/simstudioai/sim/pull/8214

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:caaf7c4a-f61d-717d-a312-62e45340d567
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idDFDC:7C051:F0C61D:14BBD3E:6AFB6424
html-safe-nonce797234d174c07d7be3aa9367208211aa477a69b0edb84a69cef81fc3e30c83c1
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJERkRDOjdDMDUxOkYwQzYxRDoxNEJCRDNFOjZBRkI2NDI0IiwidmlzaXRvcl9pZCI6IjM5NzgwOTUyOTIyNzk2NDUyMjAiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac2af8498d2e73f444e157f1d0d1fa20d25a7ed4ea9c143e9ea221d45c10e0d156
hovercard-subject-tagpull_request:4619876041
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/8214/files
twitter:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
og:image:altSummary Keep snapshot element ids valid when an observed action is refused before dispatch (e.g. covered by an overlay), so the agent can click the overlay's own close button without re-snapsh...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneea33d13c96d0ff66bd8fa906b193d2213536b78cb06b0c50a4632c58b1418f94
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release59ef97164c52cf59bd10558ddec9c4f482763988
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/8214/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F8214%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F8214%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/8214/files
Reloadhttps://github.com/simstudioai/sim/pull/8214/files
Reloadhttps://github.com/simstudioai/sim/pull/8214/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests197 (197)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
waleedlatif1https://github.com/waleedlatif1
staginghttps://github.com/simstudioai/sim/tree/staging
feat/browser-agent-efficiencyhttps://github.com/simstudioai/sim/tree/feat/browser-agent-efficiency
Conversation 20 https://github.com/simstudioai/sim/pull/8214
Commits 3 https://github.com/simstudioai/sim/pull/8214/commits
Checks 36 https://github.com/simstudioai/sim/pull/8214/checks
Files changed https://github.com/simstudioai/sim/pull/8214/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/8214/files
feat(browser): batch planned page actions and keep snapshot ids after refused clicks https://github.com/simstudioai/sim/pull/8214/files#top
Show all changes 3 commits https://github.com/simstudioai/sim/pull/8214/files
b6df969 fix(browser): keep snapshot ids valid after an observed action is ref… waleedlatif1 Sep 23, 2026 https://github.com/simstudioai/sim/pull/8214/commits/b6df969a9f737ede4ce82951793b7c15a1076f48
4548dfa feat(browser): run planned page actions in order with browser_batch waleedlatif1 Sep 23, 2026 https://github.com/simstudioai/sim/pull/8214/commits/4548dfadf48ecb4484453650d3496f3b0fbc24c6
d9295b2 fix(browser): mark batched actions pending and stop batches on same-d… waleedlatif1 Sep 24, 2026 https://github.com/simstudioai/sim/pull/8214/commits/d9295b2d751663091b8b38f194f1c2d3876b4633
Clear filters https://github.com/simstudioai/sim/pull/8214/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/8214/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/8214/files
driver.test.ts https://github.com/simstudioai/sim/pull/8214/files#diff-e3f3e254574c9ace38cf400e9ef8600989b25e602629bb7e6c7e4927a27830c5
driver.ts https://github.com/simstudioai/sim/pull/8214/files#diff-515694ac7beaa3b13cb8b2224e3c5ec946ddc589bf9d8c294986e76a8c270ed6
post-action-observation.ts https://github.com/simstudioai/sim/pull/8214/files#diff-5575d4749c7f6bace7239ae640afa83e56706b1e9cae6e18e6ca61b1e413ae1e
utils.ts https://github.com/simstudioai/sim/pull/8214/files#diff-db31ba942ae594e24fdda28f8c35ae042a43cbfc5721fcd6adf91f221f84d4a7
tool-catalog-v1.ts https://github.com/simstudioai/sim/pull/8214/files#diff-6a87003a578cadaa676ffa90eeb02a8eb938346617f4ad521bdf3031880bd3ab
tool-schemas-v1.ts https://github.com/simstudioai/sim/pull/8214/files#diff-da19aaa0b9fdea9ae041cfaae64f263d8a9eaf68cf3221a7f31e5adb5bc7bbac
browser-tool-execution.test.ts https://github.com/simstudioai/sim/pull/8214/files#diff-c395e5360aa0e76912da9f12b41a11bbbbbaaa51564afd3dc799f0fa45b531c8
browser-tool-execution.ts https://github.com/simstudioai/sim/pull/8214/files#diff-8f905f5e874cb0a596f2b1d94ccaaf419d995620aec1a4a5d7e677e6190cbd8d
tool-display.ts https://github.com/simstudioai/sim/pull/8214/files#diff-35f28ff25984da4cd0dd999280f570b08f5788005a7bb3845a4e97210a493937
index.ts https://github.com/simstudioai/sim/pull/8214/files#diff-7bf024cc51a5498c6b4d087358740c2011c9d5ea86c03391bd1d4623026224d3
apps/desktop/src/main/browser-agent/driver.test.tshttps://github.com/simstudioai/sim/pull/8214/files#diff-e3f3e254574c9ace38cf400e9ef8600989b25e602629bb7e6c7e4927a27830c5
View file https://github.com/simstudioai/sim/blob/d9295b2d751663091b8b38f194f1c2d3876b4633/apps/desktop/src/main/browser-agent/driver.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/8214/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/8214/files#diff-e3f3e254574c9ace38cf400e9ef8600989b25e602629bb7e6c7e4927a27830c5
https://github.com/simstudioai/sim/pull/8214/files#diff-e3f3e254574c9ace38cf400e9ef8600989b25e602629bb7e6c7e4927a27830c5
https://github.com/simstudioai/sim/pull/8214/files#diff-e3f3e254574c9ace38cf400e9ef8600989b25e602629bb7e6c7e4927a27830c5
https://github.com/simstudioai/sim/pull/8214/files#diff-e3f3e254574c9ace38cf400e9ef8600989b25e602629bb7e6c7e4927a27830c5
https://github.com/simstudioai/sim/pull/8214/files#diff-e3f3e254574c9ace38cf400e9ef8600989b25e602629bb7e6c7e4927a27830c5
Please reload this pagehttps://github.com/simstudioai/sim/pull/8214/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/8214/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.