René's URL Explorer Experiment


Title: NodeGit does not expose a proper API for displaying large binary diffs · Issue #1369 · nodegit/nodegit · GitHub

Open Graph Title: NodeGit does not expose a proper API for displaying large binary diffs · Issue #1369 · nodegit/nodegit

X Title: NodeGit does not expose a proper API for displaying large binary diffs · Issue #1369 · nodegit/nodegit

Description: The diff process in libgit2 automatically assumes that files over ~536MB are binary files. This causes the diff process to assign a GIT_DIFF_FLAG_BINARY to the file (see here). When the GIT_DIFF_FLAG_BINARY flag is set on a file it will ...

Open Graph Description: The diff process in libgit2 automatically assumes that files over ~536MB are binary files. This causes the diff process to assign a GIT_DIFF_FLAG_BINARY to the file (see here). When the GIT_DIFF_FL...

X Description: The diff process in libgit2 automatically assumes that files over ~536MB are binary files. This causes the diff process to assign a GIT_DIFF_FLAG_BINARY to the file (see here). When the GIT_DIFF_FL...

Opengraph URL: https://github.com/nodegit/nodegit/issues/1369

X: @github

direct link

Domain: github.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"NodeGit does not expose a proper API for displaying large binary diffs","articleBody":"The diff process in libgit2 automatically assumes that files over ~536MB are binary files. This causes the diff process to assign a `GIT_DIFF_FLAG_BINARY` to the file ([see here](https://github.com/libgit2/libgit2/blob/master/src/diff_file.c#L23)). When the `GIT_DIFF_FLAG_BINARY` flag is set on a file it will eventually set that flag on the delta too causing the diff process to avoid generating hunks for the patches on the diff. Instead, it generates a [binary](https://github.com/libgit2/libgit2/blob/master/src/patch_generate.c#L256) object on any patch (I assume there is only one at this point, I have not seen otherwise).\r\n\r\nThe binary object is not exposed properly via the `ConvenientPatch` object in NodeGit. It should be so we can then expose the content of the binary object. Normally, this would probably not be an issue, but if we filter the binary content--say with Git LFS--we cannot see any diff output for files over the max file size threshold. \r\n\r\n[Here is where the binary object will be generated instead of hunks](https://github.com/libgit2/libgit2/blob/master/src/patch_generate.c#L383) as any delta with the `GIT_DIFF_FLAG_BINARY` flag calls the binary callback instead of the diff callback and never emits the diff.\r\n\r\nAnother potential issue is [deflating](https://github.com/libgit2/libgit2/blob/master/src/patch_generate.c#L274) the filtered content on the binary object. It appears that libgit2 deflates the content regardless of what it is, so this could mean that even if we expose the binary object we won't be able to actually see the filtered content. This may not be an issue, I guess we will need to see that the final content of the binary object is after it has been exposed.\r\n\r\n@implausible, if you could look into this that would be amazing. If not I will look into it in a couple weeks.","author":{"url":"https://github.com/cjhoward92","@type":"Person","name":"cjhoward92"},"datePublished":"2017-09-07T22:58:49.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/1369/nodegit/issues/1369"}

route-pattern/_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format)
route-controllervoltron_issues_fragments
route-actionissue_layout
fetch-noncev2:2ecfe807-234e-ab4c-97fa-68382687e261
current-catalog-service-hash81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114
request-idD1D2:1F2E21:DA469:11F104:6A5FE709
html-safe-nonce3c71b3f7cc02e6123197c35cc1e6731eff3f32913f2f86e199844f3e4ab0a4cc
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJEMUQyOjFGMkUyMTpEQTQ2OToxMUYxMDQ6NkE1RkU3MDkiLCJ2aXNpdG9yX2lkIjoiNzQyMzkxNzIyNzA4NjE3ODA1NyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac343570528f6e58a8a7533283fb177f6d162f25fcd3ece19bf194334cf88d52fa
hovercard-subject-tagissue:256094282
github-keyboard-shortcutsrepository,issues,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/issues_fragments/issue_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/nodegit/nodegit/1369/issue_layout
twitter:imagehttps://opengraph.githubassets.com/5e5b46e0709c4ea898770256a8f8fa7151a1f0fbd655b8fc4fff7e3d47b70557/nodegit/nodegit/issues/1369
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/5e5b46e0709c4ea898770256a8f8fa7151a1f0fbd655b8fc4fff7e3d47b70557/nodegit/nodegit/issues/1369
og:image:altThe diff process in libgit2 automatically assumes that files over ~536MB are binary files. This causes the diff process to assign a GIT_DIFF_FLAG_BINARY to the file (see here). When the GIT_DIFF_FL...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamecjhoward92
hostnamegithub.com
expected-hostnamegithub.com
None78938542173c0d8e4ad1aefc7954896e81c10ce2620286603ef14cf593bd5a11
turbo-cache-controlno-preview
go-importgithub.com/nodegit/nodegit git https://github.com/nodegit/nodegit.git
octolytics-dimension-user_id657068
octolytics-dimension-user_loginnodegit
octolytics-dimension-repository_id1383170
octolytics-dimension-repository_nwonodegit/nodegit
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id1383170
octolytics-dimension-repository_network_root_nwonodegit/nodegit
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release1a427601e09953033b696253e754ebc7328096a7
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/nodegit/nodegit/issues/1369#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fnodegit%2Fnodegit%2Fissues%2F1369
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
Code QualityEnforce quality at mergehttps://github.com/features/code-quality
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/open-source/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/open-source/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fnodegit%2Fnodegit%2Fissues%2F1369
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fissues_fragments%2Fissue_layout&source=header-repo&source_repo=nodegit%2Fnodegit
Reloadhttps://github.com/nodegit/nodegit/issues/1369
Reloadhttps://github.com/nodegit/nodegit/issues/1369
Reloadhttps://github.com/nodegit/nodegit/issues/1369
Please reload this pagehttps://github.com/nodegit/nodegit/issues/1369
nodegit https://github.com/nodegit
nodegithttps://github.com/nodegit/nodegit
Notifications https://github.com/login?return_to=%2Fnodegit%2Fnodegit
Fork 698 https://github.com/login?return_to=%2Fnodegit%2Fnodegit
Star 5.8k https://github.com/login?return_to=%2Fnodegit%2Fnodegit
Code https://github.com/nodegit/nodegit
Issues 343 https://github.com/nodegit/nodegit/issues
Pull requests 20 https://github.com/nodegit/nodegit/pulls
Actions https://github.com/nodegit/nodegit/actions
Projects https://github.com/nodegit/nodegit/projects
Security and quality 0 https://github.com/nodegit/nodegit/security
Insights https://github.com/nodegit/nodegit/pulse
Code https://github.com/nodegit/nodegit
Issues https://github.com/nodegit/nodegit/issues
Pull requests https://github.com/nodegit/nodegit/pulls
Actions https://github.com/nodegit/nodegit/actions
Projects https://github.com/nodegit/nodegit/projects
Security and quality https://github.com/nodegit/nodegit/security
Insights https://github.com/nodegit/nodegit/pulse
NodeGit does not expose a proper API for displaying large binary diffshttps://github.com/nodegit/nodegit/issues/1369#top
https://github.com/cjhoward92
cjhoward92https://github.com/cjhoward92
on Sep 7, 2017https://github.com/nodegit/nodegit/issues/1369#issue-256094282
see herehttps://github.com/libgit2/libgit2/blob/master/src/diff_file.c#L23
binaryhttps://github.com/libgit2/libgit2/blob/master/src/patch_generate.c#L256
Here is where the binary object will be generated instead of hunkshttps://github.com/libgit2/libgit2/blob/master/src/patch_generate.c#L383
deflatinghttps://github.com/libgit2/libgit2/blob/master/src/patch_generate.c#L274
@implausiblehttps://github.com/implausible
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.