René's URL Explorer Experiment


Title: Bench oracle: an absorbed marginal trace spot is only visible in a green CI step log · Issue #356 · purescript-lua/purescript-lua · GitHub

Open Graph Title: Bench oracle: an absorbed marginal trace spot is only visible in a green CI step log · Issue #356 · purescript-lua/purescript-lua

X Title: Bench oracle: an absorbed marginal trace spot is only visible in a green CI step log · Issue #356 · purescript-lua/purescript-lua

Description: Problem ./bench/ci compares freshly generated LuaJIT counter reports against committed oracles in bench/goldens/. One of those reports, the per-spec trace report, records which artifact source locations ended up carrying a compiled trace...

Open Graph Description: Problem ./bench/ci compares freshly generated LuaJIT counter reports against committed oracles in bench/goldens/. One of those reports, the per-spec trace report, records which artifact source loca...

X Description: Problem ./bench/ci compares freshly generated LuaJIT counter reports against committed oracles in bench/goldens/. One of those reports, the per-spec trace report, records which artifact source loca...

Opengraph URL: https://github.com/purescript-lua/purescript-lua/issues/356

X: @github

direct link

Domain: github.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Bench oracle: an absorbed marginal trace spot is only visible in a green CI step log","articleBody":"## Problem\n\n`./bench/ci` compares freshly generated LuaJIT counter reports against committed oracles in `bench/goldens/`. One of those reports, the per-spec trace report, records which artifact source locations ended up carrying a compiled trace or a blacklist, and whether a given location does is a per-process dice roll for spots sitting on LuaJIT's hot-count boundary. `bench/tools/diff_counters` absorbs that by re-measuring a report that differs from its golden only in the nondeterministic sets, passing if a fresh measurement matches.\n\nWhen it does absorb a flip it prints the entries that flickered, deliberately — a golden entry that is not decisive is the one property a reviewer cannot see by reading the committed goldens, so swallowing it silently would hide the fact that the oracle is pinning something marginal. But the notice goes to stderr and the script exits 0, so it lands in a *green* step's log:\n\n```\ntrace_ref_loop.txt: differs in the measured sets; re-measuring (1 of 2)\ntrace_ref_loop.txt: matched on re-measurement 1 -- the entries below are trace-formation noise, not a codegen change\n@@ -5,7 +5,6 @@\n   Bench.RefLoop.lua:40 -- NYI: bytecode FNEW\n bytecode end state (J*=compiled, I*=blacklisted):\n   Bench.RefLoop.lua:10 JFUNCF\n-  Bench.RefLoop.lua:32 JFUNCF\n   Bench.RefLoop.lua:34 JFORI\n   Bench.RefLoop.lua:34 JFORL\n-counts: aborts=1 compiled=4 blacklisted=0\n+counts: aborts=1 compiled=3 blacklisted=0\n```\n\nNobody expands a green step. Measured at roughly 3% of runs on the current goldens, that means the signal is emitted a few times a year into a place no one reads.\n\n## Approach\n\nEmit a GitHub Actions annotation alongside the stderr notice, so an absorbed flip appears on the PR itself rather than only in the step log:\n\n```bash\nif [ -n \"${GITHUB_ACTIONS:-}\" ]; then\n  printf '::warning::%s\\n' \"$name: absorbed a marginal trace spot on re-measurement $attempt\"\nfi\n```\n\nGuarded on `GITHUB_ACTIONS` so a local `./bench/ci` is unchanged.\n\nThe cost is that a vendor-neutral bench tool grows a branch that knows about one CI provider, which is why it was left out of the change that introduced the re-measurement rather than folded in. That is the decision to make here: accept the coupling for the visibility, or find a vendor-neutral equivalent (for instance, having `bench/ci` exit with a distinct non-failing status or write a marker file that a workflow step turns into an annotation, keeping the provider knowledge in the workflow).\n\n## Prerequisites / Relations\n\nIndependent; follows the re-measurement introduced in #346. Confined to `bench/` plus possibly `.github/workflows/ci.yaml`; no compiler code involved.\n\n## Acceptance criteria\n\n- An absorbed marginal trace spot is visible without expanding a green CI step's log.\n- A local `./bench/ci` run's output is unchanged.\n- Whichever way the vendor coupling is resolved is recorded next to the existing explanation in `bench/README.md`.\n","author":{"url":"https://github.com/Unisay","@type":"Person","name":"Unisay"},"datePublished":"2026-07-29T17:11:36Z","url":"https://github.com/purescript-lua/purescript-lua/issues/356"}

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format)
route-controllervoltron_issues_fragments
route-actionissue_layout
fetch-noncev2:99759dd0-7939-0bd2-c6a7-a4c153632a87
current-catalog-service-hash81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114
request-idC186:2E124E:4BAA53:621480:6B00D93D
html-safe-noncee7443d182bd6ab018e5febd9e5ebc319c7505eee07369e4939514c042cb4e724
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDMTg2OjJFMTI0RTo0QkFBNTM6NjIxNDgwOjZCMDBEOTNEIiwidmlzaXRvcl9pZCI6IjQwNDg2ODk2NzI1NjQ1NjIyMzciLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmacfb8dd9f41d8d7b1cd237ce406e8471b6a970489fb9fc2cb8c708b36251e0b4e3
hovercard-subject-tagissue:5011833782
github-keyboard-shortcutsrepository,issues,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/issues_fragments/issue_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/purescript-lua/purescript-lua/356/issue_layout
twitter:imagehttps://opengraph.githubassets.com/70b15749c2d63492dcb232a9805a5873cca8e624329835c3f65b741ad9caa6c7/purescript-lua/purescript-lua/issues/356
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/70b15749c2d63492dcb232a9805a5873cca8e624329835c3f65b741ad9caa6c7/purescript-lua/purescript-lua/issues/356
og:image:altProblem ./bench/ci compares freshly generated LuaJIT counter reports against committed oracles in bench/goldens/. One of those reports, the per-spec trace report, records which artifact source loca...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernameUnisay
hostnamegithub.com
expected-hostnamegithub.com
Nonea481f62a1e04c9b9bdcb5628230682c66d59006f5b13b080f79cba84a176905b
turbo-cache-controlno-preview
go-importgithub.com/purescript-lua/purescript-lua git https://github.com/purescript-lua/purescript-lua.git
octolytics-dimension-user_id131581790
octolytics-dimension-user_loginpurescript-lua
octolytics-dimension-repository_id587200487
octolytics-dimension-repository_nwopurescript-lua/purescript-lua
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id587200487
octolytics-dimension-repository_network_root_nwopurescript-lua/purescript-lua
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release84c8c5cc25e2fb7f2308428458538436baecc6d2
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-nameissues

Links:

Skip to contenthttps://github.com/purescript-lua/purescript-lua/issues/356#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpurescript-lua%2Fpurescript-lua%2Fissues%2F356
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpurescript-lua%2Fpurescript-lua%2Fissues%2F356
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fissues_fragments%2Fissue_layout&source=header-repo&source_repo=purescript-lua%2Fpurescript-lua
Reloadhttps://github.com/purescript-lua/purescript-lua/issues/356
Reloadhttps://github.com/purescript-lua/purescript-lua/issues/356
Reloadhttps://github.com/purescript-lua/purescript-lua/issues/356
purescript-luahttps://github.com/purescript-lua
purescript-luahttps://github.com/purescript-lua/purescript-lua
Codehttps://github.com/purescript-lua/purescript-lua
Issues48 (48)https://github.com/purescript-lua/purescript-lua/issues
Pull requestshttps://github.com/purescript-lua/purescript-lua/pulls
Discussionshttps://github.com/purescript-lua/purescript-lua/discussions
Actionshttps://github.com/purescript-lua/purescript-lua/actions
Projectshttps://github.com/purescript-lua/purescript-lua/projects
Security and qualityhttps://github.com/purescript-lua/purescript-lua/security
Insightshttps://github.com/purescript-lua/purescript-lua/insights
https://github.com/purescript-lua/purescript-lua
New issuehttps://github.com/login?return_to=https://github.com/purescript-lua/purescript-lua/issues/356
New issuehttps://github.com/login?return_to=https://github.com/purescript-lua/purescript-lua/issues/356
Bench oracle: an absorbed marginal trace spot is only visible in a green CI step loghttps://github.com/purescript-lua/purescript-lua/issues/356#top
area: toolchainnix / spago / purs / buildhttps://github.com/purescript-lua/purescript-lua/issues?q=state%3Aopen%20label%3A%22area%3A%20toolchain%22
choreMaintenance / infrastructurehttps://github.com/purescript-lua/purescript-lua/issues?q=state%3Aopen%20label%3A%22chore%22
https://github.com/Unisay
Unisayhttps://github.com/Unisay
on Jul 29, 2026https://github.com/purescript-lua/purescript-lua/issues/356#issue-5011833782
#346https://github.com/purescript-lua/purescript-lua/issues/346
Unisayhttps://github.com/Unisay
area: toolchainnix / spago / purs / buildhttps://github.com/purescript-lua/purescript-lua/issues?q=state%3Aopen%20label%3A%22area%3A%20toolchain%22
choreMaintenance / infrastructurehttps://github.com/purescript-lua/purescript-lua/issues?q=state%3Aopen%20label%3A%22chore%22
on Jul 29, 2026https://github.com/purescript-lua/purescript-lua/issues/356#event-28675471740
Sign up for freehttps://github.com/signup?return_to=https://github.com/purescript-lua/purescript-lua/issues/356
Sign in to commenthttps://github.com/login?return_to=https://github.com/purescript-lua/purescript-lua/issues/356
area: toolchainnix / spago / purs / buildhttps://github.com/purescript-lua/purescript-lua/issues?q=state%3Aopen%20label%3A%22area%3A%20toolchain%22
choreMaintenance / infrastructurehttps://github.com/purescript-lua/purescript-lua/issues?q=state%3Aopen%20label%3A%22chore%22
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.