René's URL Explorer Experiment


Title: The formatter allocates over 1,000 times its input, and the native binary spends most of its run collecting it · Issue #229 · openjavaformat/open-java-format · GitHub

Open Graph Title: The formatter allocates over 1,000 times its input, and the native binary spends most of its run collecting it · Issue #229 · openjavaformat/open-java-format

X Title: The formatter allocates over 1,000 times its input, and the native binary spends most of its run collecting it · Issue #229 · openjavaformat/open-java-format

Description: What happens Formatting allocates more than a thousand times the size of its input, and the native binary spends most of its run collecting it. 865 files from java.base of JDK 21, 15 MB of source, --replace with 21.0.2 on 10 cores: Wall ...

Open Graph Description: What happens Formatting allocates more than a thousand times the size of its input, and the native binary spends most of its run collecting it. 865 files from java.base of JDK 21, 15 MB of source, ...

X Description: What happens Formatting allocates more than a thousand times the size of its input, and the native binary spends most of its run collecting it. 865 files from java.base of JDK 21, 15 MB of source, ...

Opengraph URL: https://github.com/openjavaformat/open-java-format/issues/229

X: @github

direct link

Domain: github.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"The formatter allocates over 1,000 times its input, and the native binary spends most of its run collecting it","articleBody":"### What happens\n\nFormatting allocates more than a thousand times the size of its input, and the native binary spends most of its run collecting it. 865 files from `java.base` of JDK 21, 15 MB of source, `--replace` with 21.0.2 on 10 cores:\n\n| | Wall | Of it in GC pauses | Peak RSS |\n|---|---|---|---|\n| Native binary | 6.9 s | 5.0 s: 17 full collections for 3.05 s, 23 incremental for 1.94 s | 2.4 GB |\n| `java -cp ... Main`, JDK 21 | 6.2 s | | 4.3 GB |\n\nThe native run's GC log adds up to at least 16.6 GB allocated, about 1,100 bytes for each byte of source. The image is built without `--gc`, so its serial collector stops all 20 threads for each collection, and they format on about 2 of the 10 cores (15 s of CPU in 6.9 s).\n\nInput and output are not where it goes: reading the 865 files takes 0.04 s, and `Main`'s reading and writing are 0.5% of the allocation, so memory-mapped files or other I/O changes cannot help.\n\n### Where it goes\n\nFlight Recorder on the JVM run, with `-XX:FlightRecorderOptions:stackdepth=2048` so that no stack was cut, 1,611 allocation samples and 469 CPU samples:\n\n| Step of `FormatFileCallable.formatFile` | Allocation | CPU |\n|---|---|---|\n| `Formatter.formatSource`, the layout | 65.5% | 56.1% |\n| `StringWrapper.wrap` | 16.8% | 23.5% |\n| `RemoveUnusedImports` | 12.9% | 19.8% |\n| `ImportOrderer` | 4.0% | 0.6% |\n| `Main`, reading and writing | 0.5% | |\n\n- **The file is parsed several times.** 42% of the CPU is in javac's parser and scanner: 16% for the layout, 16% for the parse of its own that `RemoveUnusedImports` makes, 10% in `StringWrapper`, whose rounds parse again and parse before and after to compare the trees.\n- **Each parse sets javac up from scratch: 18.1% of the allocation.** `Formatter.parseJcCompilationUnit`, `JavacTokens.getTokens` and `JavaInput.buildToks` each create a new `Context`, and with it a `SharedNameTable` (`NameImpl[0x8000]` and `byte[0x20000]`), the writers of `Log`, and the buffers of `ClassWriter` (through `Modules`), `ClassReader` and even `Gen`, which parsing does not use. javac keeps disposed name tables for reuse (`SharedNameTable.create`), but nothing here calls `Names.dispose()`.\n- **The top sites otherwise:** `OpsBuilder.build` 11.5%, the memoizing supplier of `HasUniqueId.ord` 4.6% plus 2.3% for its `Suppliers` objects, `Doc.\u003cinit>` 4.3%, `InputOutput.makeKToIJ` 3.1%, `JavaOutput.append` 2.7%. By class: `byte[]` 23.4%, `char[]` 8.3%, `Object[]` 8.1%, boxed `Integer` 7.2%, Guava `Range` 2.7%.\n\n### Proposal\n\nIn order of what each is likely to give for its work, each measured on the run above:\n\n1. **The native image's collector:** a larger young generation, another collector where GraalVM offers one for the platform, fewer threads under the serial one (#228).\n2. **javac set up once per thread, or reused:** call `Names.dispose()` after each parse so that javac hands the name table out again, and find what makes a parse create `Modules`, `ClassWriter`, `ClassReader` and `Gen`, and stop it.\n3. **One parse per file:** `RemoveUnusedImports` and `StringWrapper` work from the compilation unit and tokens of the formatting pass where the text did not change, as google-java-format's `Cleanups` reuse its parse (google/google-java-format@633ce6be, #224).\n4. **Fewer small objects in the layout:** token positions as `int`, not boxed `Integer` in `Range`s, and the unique ids of `Doc`s without a memoizing supplier for each.\n","author":{"url":"https://github.com/abashev","@type":"Person","name":"abashev"},"datePublished":"2026-11-14T06:54:56Z","url":"https://github.com/openjavaformat/open-java-format/issues/229"}

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format)
route-controllervoltron_issues_fragments
route-actionissue_layout
fetch-noncev2:b2f0c6b7-e547-aba9-fa17-91554133da11
current-catalog-service-hash81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114
request-idD708:1189F5:29AB24:37751D:6AFBB791
html-safe-nonceb88e21854c0cee6b7bfcd290c5d6fa194e45d2b8c1a29a01f65eeb40631a7aee
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJENzA4OjExODlGNToyOUFCMjQ6Mzc3NTFEOjZBRkJCNzkxIiwidmlzaXRvcl9pZCI6IjI1NTg0NjE4MjgwMDgzMjQwMSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac2b443f3de214beb31ee56708a336d4f8aab77177ba8382dd4b50291ad16cb8a7
hovercard-subject-tagissue:6386584088
github-keyboard-shortcutsrepository,issues,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/issues_fragments/issue_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/openjavaformat/open-java-format/229/issue_layout
twitter:imagehttps://opengraph.githubassets.com/ac12d09ab01da568490cfcf74e183dd1de1910375ddcc13c88293dae8ce9e747/openjavaformat/open-java-format/issues/229
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/ac12d09ab01da568490cfcf74e183dd1de1910375ddcc13c88293dae8ce9e747/openjavaformat/open-java-format/issues/229
og:image:altWhat happens Formatting allocates more than a thousand times the size of its input, and the native binary spends most of its run collecting it. 865 files from java.base of JDK 21, 15 MB of source, ...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernameabashev
hostnamegithub.com
expected-hostnamegithub.com
None2b2ef9c1578c18d8ed27027940544c958743213cf4461659f14d3ccdf51e162c
turbo-cache-controlno-preview
go-importgithub.com/openjavaformat/open-java-format git https://github.com/openjavaformat/open-java-format.git
octolytics-dimension-user_id325177626
octolytics-dimension-user_loginopenjavaformat
octolytics-dimension-repository_id1288055459
octolytics-dimension-repository_nwoopenjavaformat/open-java-format
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id214273098
octolytics-dimension-repository_parent_nwopalantir/palantir-java-format
octolytics-dimension-repository_network_root_id214273098
octolytics-dimension-repository_network_root_nwopalantir/palantir-java-format
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releasee4cce0e99cf61481a318ff12c2e8580153a6c7c6
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-nameissues

Links:

Skip to contenthttps://github.com/openjavaformat/open-java-format/issues/229#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenjavaformat%2Fopen-java-format%2Fissues%2F229
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenjavaformat%2Fopen-java-format%2Fissues%2F229
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fissues_fragments%2Fissue_layout&source=header-repo&source_repo=openjavaformat%2Fopen-java-format
Reloadhttps://github.com/openjavaformat/open-java-format/issues/229
Reloadhttps://github.com/openjavaformat/open-java-format/issues/229
Reloadhttps://github.com/openjavaformat/open-java-format/issues/229
openjavaformathttps://github.com/openjavaformat
open-java-formathttps://github.com/openjavaformat/open-java-format
Codehttps://github.com/openjavaformat/open-java-format
Issues30 (30)https://github.com/openjavaformat/open-java-format/issues
Pull requests5 (5)https://github.com/openjavaformat/open-java-format/pulls
Discussionshttps://github.com/openjavaformat/open-java-format/discussions
Actionshttps://github.com/openjavaformat/open-java-format/actions
Security and qualityhttps://github.com/openjavaformat/open-java-format/security
Insightshttps://github.com/openjavaformat/open-java-format/pulse
https://github.com/openjavaformat/open-java-format
New issuehttps://github.com/login?return_to=https://github.com/openjavaformat/open-java-format/issues/229
New issuehttps://github.com/login?return_to=https://github.com/openjavaformat/open-java-format/issues/229
The formatter allocates over 1,000 times its input, and the native binary spends most of its run collecting ithttps://github.com/openjavaformat/open-java-format/issues/229#top
enhancementNew feature or requesthttps://github.com/openjavaformat/open-java-format/issues?q=state%3Aopen%20label%3A%22enhancement%22
https://github.com/abashev
abashevhttps://github.com/abashev
on Nov 14, 2026https://github.com/openjavaformat/open-java-format/issues/229#issue-6386584088
Read, format and write each file on a worker thread, and keep only what the output needs #228https://github.com/openjavaformat/open-java-format/issues/228
google/google-java-format@633ce6behttps://github.com/google/google-java-format/commit/633ce6be
Fix the imports before the layout or after it? #224https://github.com/openjavaformat/open-java-format/issues/224
abashevhttps://github.com/abashev
enhancementNew feature or requesthttps://github.com/openjavaformat/open-java-format/issues?q=state%3Aopen%20label%3A%22enhancement%22
on Nov 14, 2026https://github.com/openjavaformat/open-java-format/issues/229#event-36106724188
Sign up for freehttps://github.com/signup?return_to=https://github.com/openjavaformat/open-java-format/issues/229
Sign in to commenthttps://github.com/login?return_to=https://github.com/openjavaformat/open-java-format/issues/229
enhancementNew feature or requesthttps://github.com/openjavaformat/open-java-format/issues?q=state%3Aopen%20label%3A%22enhancement%22
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.