René's URL Explorer Experiment


Title: Begin simplifying CrossAttention so that it works better on the Apple Neural Engine by MatthewWaller · Pull Request #691 · huggingface/diffusers · GitHub

Open Graph Title: Begin simplifying CrossAttention so that it works better on the Apple Neural Engine by MatthewWaller · Pull Request #691 · huggingface/diffusers

X Title: Begin simplifying CrossAttention so that it works better on the Apple Neural Engine by MatthewWaller · Pull Request #691 · huggingface/diffusers

Description: 🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch. - Begin simplifying CrossAttention so that it works better on the Apple Neural Engine by MatthewWaller · Pull Request #691 · huggingface/diffusers

Open Graph Description: Hi folks, This is to address this issue. I converted this CrossAttention portion with coremltools, and it does in fact remove about 4 reshape operation and a few transposes, getting down to, 4 tran...

X Description: Hi folks, This is to address this issue. I converted this CrossAttention portion with coremltools, and it does in fact remove about 4 reshape operation and a few transposes, getting down to, 4 tran...

Opengraph URL: https://github.com/huggingface/diffusers/pull/691

X: @github

direct link

Domain: github.com

route-pattern/_view_fragments/voltron/pull_requests/show/:user_id/:repository/:id/pull_request_layout(.:format)
route-controllervoltron_pull_requests_fragments
route-actionpull_request_layout
fetch-noncev2:2024d34f-dc32-21a0-322a-e397de9bd9bb
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idA124:A6347:2D7FCEA:3D0CF98:6A5DAF3D
html-safe-nonce95c59839fa01f31c6936a67e0da55b4ea7458c1a0001671f5a7fb91379894134
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBMTI0OkE2MzQ3OjJEN0ZDRUE6M0QwQ0Y5ODo2QTVEQUYzRCIsInZpc2l0b3JfaWQiOiI1ODI5MDQ3NjE2NDAwMTA5MzczIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmacbf10c86e8cfe8f308c1d15e5cb08321e478773a6545af80b11c405afda808f02
hovercard-subject-tagpull_request:1072953329
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/pull_requests_fragments/pull_request_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/voltron/pull_requests/show/huggingface/diffusers/691/pull_request_layout
twitter:imagehttps://opengraph.githubassets.com/bed91475b7bc63770c2f8728a940e921f373a8168491d451ab3129201384e3fb/huggingface/diffusers/pull/691
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/bed91475b7bc63770c2f8728a940e921f373a8168491d451ab3129201384e3fb/huggingface/diffusers/pull/691
og:image:altHi folks, This is to address this issue. I converted this CrossAttention portion with coremltools, and it does in fact remove about 4 reshape operation and a few transposes, getting down to, 4 tran...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernameMatthewWaller
hostnamegithub.com
expected-hostnamegithub.com
None5290d7e14309ad1e76106a9c4237bd1041517e83ea182c8ab756752cb0c6940b
turbo-cache-controlno-cache
go-importgithub.com/huggingface/diffusers git https://github.com/huggingface/diffusers.git
octolytics-dimension-user_id25720743
octolytics-dimension-user_loginhuggingface
octolytics-dimension-repository_id498011141
octolytics-dimension-repository_nwohuggingface/diffusers
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id498011141
octolytics-dimension-repository_network_root_nwohuggingface/diffusers
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release9c975978430e9ad293956f2bbdaf153b1bd84a99
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/huggingface/diffusers/pull/691#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fhuggingface%2Fdiffusers%2Fpull%2F691
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/open-source/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/open-source/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fhuggingface%2Fdiffusers%2Fpull%2F691
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fpull_requests_fragments%2Fpull_request_layout&source=header-repo&source_repo=huggingface%2Fdiffusers
Reloadhttps://github.com/huggingface/diffusers/pull/691
Reloadhttps://github.com/huggingface/diffusers/pull/691
Reloadhttps://github.com/huggingface/diffusers/pull/691
Please reload this pagehttps://github.com/huggingface/diffusers/pull/691
huggingface https://github.com/huggingface
diffusershttps://github.com/huggingface/diffusers
Notifications https://github.com/login?return_to=%2Fhuggingface%2Fdiffusers
Fork 7.2k https://github.com/login?return_to=%2Fhuggingface%2Fdiffusers
Star 34.1k https://github.com/login?return_to=%2Fhuggingface%2Fdiffusers
Code https://github.com/huggingface/diffusers
Issues 753 https://github.com/huggingface/diffusers/issues
Pull requests 538 https://github.com/huggingface/diffusers/pulls
Discussions https://github.com/huggingface/diffusers/discussions
Actions https://github.com/huggingface/diffusers/actions
Projects https://github.com/huggingface/diffusers/projects
Security and quality 3 https://github.com/huggingface/diffusers/security
Insights https://github.com/huggingface/diffusers/pulse
Code https://github.com/huggingface/diffusers
Issues https://github.com/huggingface/diffusers/issues
Pull requests https://github.com/huggingface/diffusers/pulls
Discussions https://github.com/huggingface/diffusers/discussions
Actions https://github.com/huggingface/diffusers/actions
Projects https://github.com/huggingface/diffusers/projects
Security and quality https://github.com/huggingface/diffusers/security
Insights https://github.com/huggingface/diffusers/pulse
MatthewWallerhttps://github.com/MatthewWaller
huggingface:mainhttps://github.com/huggingface/diffusers/tree/main
MatthewWaller:mainhttps://github.com/MatthewWaller/diffusers/tree/main
Conversationhttps://github.com/huggingface/diffusers/pull/691
Commits8 (8)https://github.com/huggingface/diffusers/pull/691/commits
Checkshttps://github.com/huggingface/diffusers/pull/691/checks
Files changedhttps://github.com/huggingface/diffusers/pull/691/files
Begin simplifying CrossAttention so that it works better on the Apple Neural Enginehttps://github.com/huggingface/diffusers/pull/691#top
MatthewWallerhttps://github.com/MatthewWaller
huggingface:mainhttps://github.com/huggingface/diffusers/tree/main
MatthewWaller:mainhttps://github.com/MatthewWaller/diffusers/tree/main
https://github.com/MatthewWaller
MatthewWallerhttps://github.com/MatthewWaller
Sep 30, 2022https://github.com/huggingface/diffusers/pull/691#issue-1392716556
address this issuehttps://github.com/huggingface/diffusers/issues/669
Please reload this pagehttps://github.com/huggingface/diffusers/pull/691
CephalopodStudiohttps://github.com/CephalopodStudio
September 30, 2022 11:42https://github.com/huggingface/diffusers/pull/691#commits-pushed-0908fdd
https://github.com/CephalopodStudio
Add initial einsum to start some simplification.https://github.com/huggingface/diffusers/pull/691/commits/0908fdd8a7058390dc9d6fdf395f3a32121cd8e3
0908fddhttps://github.com/huggingface/diffusers/pull/691/commits/0908fdd8a7058390dc9d6fdf395f3a32121cd8e3
https://github.com/MatthewWaller
Merge pull requesthttps://github.com/huggingface/diffusers/pull/691/commits/49a7adb39d8eb5ae54870438d7d7aca148ae1f99
#1https://github.com/MatthewWaller/diffusers/pull/1
from huggingface/mainhttps://github.com/huggingface/diffusers/pull/691/commits/49a7adb39d8eb5ae54870438d7d7aca148ae1f99
49a7adbhttps://github.com/huggingface/diffusers/pull/691/commits/49a7adb39d8eb5ae54870438d7d7aca148ae1f99
https://github.com/CephalopodStudio
Remove commented code.https://github.com/huggingface/diffusers/pull/691/commits/e398ddefd8cbc260c8c65bdd9e271a52fb68bf18
e398ddehttps://github.com/huggingface/diffusers/pull/691/commits/e398ddefd8cbc260c8c65bdd9e271a52fb68bf18
https://github.com/CephalopodStudio
Undo the last changehttps://github.com/huggingface/diffusers/pull/691/commits/8c1500b12a49729d67db85923680e49f75ad6b5c
8c1500bhttps://github.com/huggingface/diffusers/pull/691/commits/8c1500b12a49729d67db85923680e49f75ad6b5c
https://github.com/CephalopodStudio
Merge branch 'main' ofhttps://github.com/huggingface/diffusers/pull/691/commits/c433774bd5cf1536f1827f59d81667b3ae8b0ea1
https://github.com/MatthewWaller/diffusershttps://github.com/MatthewWaller/diffusers
c433774https://github.com/huggingface/diffusers/pull/691/commits/c433774bd5cf1536f1827f59d81667b3ae8b0ea1
https://github.com/CephalopodStudio
Remove some changeshttps://github.com/huggingface/diffusers/pull/691/commits/7f84eba321fee1888cecd55173b38172806af724
7f84ebahttps://github.com/huggingface/diffusers/pull/691/commits/7f84eba321fee1888cecd55173b38172806af724
https://github.com/CephalopodStudio
Fix conflicthttps://github.com/huggingface/diffusers/pull/691/commits/5fcbf61191664de31cce8c5a218f4fe838df50fb
5fcbf61https://github.com/huggingface/diffusers/pull/691/commits/5fcbf61191664de31cce8c5a218f4fe838df50fb
https://github.com/MatthewWaller
MatthewWallerhttps://github.com/MatthewWaller
Sep 30, 2022https://github.com/huggingface/diffusers/pull/691#issuecomment-1263809246
@patrickvonplatenhttps://github.com/patrickvonplaten
@pcuencahttps://github.com/pcuenca
Please reload this pagehttps://github.com/huggingface/diffusers/pull/691
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDevhttps://github.com/HuggingFaceDocBuilderDev
Sep 30, 2022https://github.com/huggingface/diffusers/pull/691#issuecomment-1263812094
Please reload this pagehttps://github.com/huggingface/diffusers/pull/691
Please reload this pagehttps://github.com/huggingface/diffusers/pull/691
https://github.com/CephalopodStudio
Reformat code for lintinghttps://github.com/huggingface/diffusers/pull/691/commits/1d462a1ec4be3ab6114878fa8f15afb1441f41d6
1d462a1https://github.com/huggingface/diffusers/pull/691/commits/1d462a1ec4be3ab6114878fa8f15afb1441f41d6
https://github.com/patrickvonplaten
patrickvonplatenhttps://github.com/patrickvonplaten
Oct 3, 2022 https://github.com/huggingface/diffusers/pull/691#pullrequestreview-1129035302
View reviewed changes https://github.com/huggingface/diffusers/pull/691/files/1d462a1ec4be3ab6114878fa8f15afb1441f41d6
src/diffusers/models/attention.pyhttps://github.com/huggingface/diffusers/pull/691/files/1d462a1ec4be3ab6114878fa8f15afb1441f41d6#diff-852d5806e41c100ee99c68c9e1059bfad9c0177e6f4416f0faf5a2f2a6a64067
patrickvonplatenhttps://github.com/patrickvonplaten
Oct 3, 2022https://github.com/huggingface/diffusers/pull/691#discussion_r986236600
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
@anton-lhttps://github.com/anton-l
Please reload this pagehttps://github.com/huggingface/diffusers/pull/691
nmntzhttps://github.com/nmntz
Oct 5, 2022https://github.com/huggingface/diffusers/pull/691#discussion_r988162856
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
@pcuencahttps://github.com/pcuenca
Please reload this pagehttps://github.com/huggingface/diffusers/pull/691
https://github.com/MatthewWaller
MatthewWallerhttps://github.com/MatthewWaller
Oct 13, 2022https://github.com/huggingface/diffusers/pull/691#issuecomment-1278148473
Please reload this pagehttps://github.com/huggingface/diffusers/pull/691
https://github.com/MatthewWaller
MatthewWallerhttps://github.com/MatthewWaller
Oct 13, 2022https://github.com/huggingface/diffusers/pull/691#event-7584880266
PhaneeshBhttps://github.com/PhaneeshB
Mar 1, 2023 https://github.com/huggingface/diffusers/pull/691#ref-commit-b01f29f
https://github.com/dan-garvey
add support for clear_all (https://github.com/nod-ai/diffusers/commit/b01f29f10dcacde311d58767bd72162bba0b23b5
huggingface#691https://github.com/huggingface/diffusers/pull/691
)https://github.com/nod-ai/diffusers/commit/b01f29f10dcacde311d58767bd72162bba0b23b5
b01f29fhttps://github.com/nod-ai/diffusers/commit/b01f29f10dcacde311d58767bd72162bba0b23b5
https://github.co/hiddenchars
https://github.com/huggingface/diffusers/pull/{{ revealButtonHref }}
Sign up for freehttps://github.com/join?source=comment-repo
Sign in to commenthttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fhuggingface%2Fdiffusers%2Fpull%2F691
https://github.com/nmntz
nmntz https://github.com/nmntz
https://github.com/huggingface/diffusers/pull/691/files/1d462a1ec4be3ab6114878fa8f15afb1441f41d6
https://github.com/patrickvonplaten
patrickvonplaten https://github.com/patrickvonplaten
https://github.com/huggingface/diffusers/pull/691/files/1d462a1ec4be3ab6114878fa8f15afb1441f41d6
Please reload this pagehttps://github.com/huggingface/diffusers/pull/691
https://github.com/MatthewWaller
https://github.com/HuggingFaceDocBuilderDev
https://github.com/patrickvonplaten
https://github.com/nmntz
https://github.com/CephalopodStudio
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.