René's URL Explorer Experiment


Title: feat(file-upload): generalized storage to support azure blob, enhanced error logging in kb, added xlsx parser by waleedlatif1 · Pull Request #506 · simstudioai/sim · GitHub

Open Graph Title: feat(file-upload): generalized storage to support azure blob, enhanced error logging in kb, added xlsx parser by waleedlatif1 · Pull Request #506 · simstudioai/sim

X Title: feat(file-upload): generalized storage to support azure blob, enhanced error logging in kb, added xlsx parser by waleedlatif1 · Pull Request #506 · simstudioai/sim

Description: Description Generalized file upload to be provider agnostic, added azure blob as an option for cloud storage. Previously, we only had S3 but now we also give the option for Azure. All user's need to do is to supply the environment variables AZURE_ACCOUNT_NAME, AZURE_ACCOUNT_KEY, AZURE_CONNECTION_STRING, AZURE_STORAGE_CONTAINER_NAME, AZURE_STORAGE_KB_CONTAINER_NAME and we use blob in place of S3. Alternatively, if you want to use S3 you can just specify the aws envvars (all documented in env.ts). Also added some better error logging to the KB and support for parsing .xlsx and .xls Type of chan New feature (non-breaking change which adds functionality) Code refactoring (no functional changes to S3) How Has This Been Tested? Tested file upload block and kb with AWS credentials, ensured that it was unchanged behavior from before Tested file upload block and kb with Azure credentials, ensured that we were using blob and that it was fully functional and had parity with S3 Added unit tests for everything Checklist: My code follows the style guidelines of this project I have performed a self-review of my own code I have commented my code, particularly in hard-to-understand areas I have added tests that prove my fix is effective or that my feature works All tests pass locally and in CI (bun run test) My changes generate no new warnings Any dependent changes have been merged and published in downstream modules I have updated version numbers as needed (if needed) I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA) Security Considerations: My changes do not introduce any new security vulnerabilities I have considered the security implications of my changes

Open Graph Description: Description Generalized file upload to be provider agnostic, added azure blob as an option for cloud storage. Previously, we only had S3 but now we also give the option for Azure. All user's ne...

X Description: Description Generalized file upload to be provider agnostic, added azure blob as an option for cloud storage. Previously, we only had S3 but now we also give the option for Azure. All user'...

Opengraph URL: https://github.com/simstudioai/sim/pull/506

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:45cc8929-06a8-9b79-8355-bdd5995e9267
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idAAF0:9D91A:3BB205:5487EA:6AFB59AC
html-safe-noncefd8b4e2c29b40812c828af073c3805d4e2aabe07b2fc4a93c061469edfb10b5c
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBQUYwOjlEOTFBOjNCQjIwNTo1NDg3RUE6NkFGQjU5QUMiLCJ2aXNpdG9yX2lkIjoiNTc1NTI1MjAwODAyMTYxMjk3MiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmacebeeb16e882e2e91d7fbece0ff015522f6e315e5b855bb2a6db90921b75ff6eb
hovercard-subject-tagpull_request:2596997544
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/506/files
twitter:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
og:image:altDescription Generalized file upload to be provider agnostic, added azure blob as an option for cloud storage. Previously, we only had S3 but now we also give the option for Azure. All user's ne...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneea33d13c96d0ff66bd8fa906b193d2213536b78cb06b0c50a4632c58b1418f94
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release59ef97164c52cf59bd10558ddec9c4f482763988
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/506/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F506%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F506%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/506/files
Reloadhttps://github.com/simstudioai/sim/pull/506/files
Reloadhttps://github.com/simstudioai/sim/pull/506/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests197 (197)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
waleedlatif1https://github.com/waleedlatif1
mainhttps://github.com/simstudioai/sim/tree/main
feat/azurehttps://github.com/simstudioai/sim/tree/feat/azure
Conversation 29 https://github.com/simstudioai/sim/pull/506
Commits 8 https://github.com/simstudioai/sim/pull/506/commits
Checks 0 https://github.com/simstudioai/sim/pull/506/checks
Files changed https://github.com/simstudioai/sim/pull/506/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/506/files
feat(file-upload): generalized storage to support azure blob, enhanced error logging in kb, added xlsx parser https://github.com/simstudioai/sim/pull/506/files#top
Show all changes 8 commits https://github.com/simstudioai/sim/pull/506/files
1a5025d added blob storage option for azure, refactored storage client to be … waleedlatif1 Jun 16, 2025 https://github.com/simstudioai/sim/pull/506/commits/1a5025d22aab294654948f4133ee7ae8da99f385
6c8f0da updated CORS policy for blob, added azure blob-specific headers waleedlatif1 Jun 16, 2025 https://github.com/simstudioai/sim/pull/506/commits/6c8f0da4faa976150e554826a9b57537968f123e
14906e1 remove extraneous comments waleedlatif1 Jun 16, 2025 https://github.com/simstudioai/sim/pull/506/commits/14906e10ae5cc92fb85cfa557edf72eeabb42c41
0f498d7 add file size limit and timeout waleedlatif1 Jun 16, 2025 https://github.com/simstudioai/sim/pull/506/commits/0f498d721288bd20f7f839b120d38a3b5fa382ec
3982529 added some extra error handling in kb add documents waleedlatif1 Jun 16, 2025 https://github.com/simstudioai/sim/pull/506/commits/39825293299a8198baa588d95f997286ea1fc7e7
b660160 grouped envvars waleedlatif1 Jun 16, 2025 https://github.com/simstudioai/sim/pull/506/commits/b6601608692ce49e178e545bd511a07c1d5a8749
7defa15 ack PR comments waleedlatif1 Jun 16, 2025 https://github.com/simstudioai/sim/pull/506/commits/7defa15fa9c01485263cece4d0d03f88224efa95
10f0ec5 added sheetjs and xlsx parser waleedlatif1 Jun 17, 2025 https://github.com/simstudioai/sim/pull/506/commits/10f0ec5c409c8bc5e4777495d36f49d4c8426128
Clear filters https://github.com/simstudioai/sim/pull/506/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/506/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/506/files
.gitignore https://github.com/simstudioai/sim/pull/506/files#diff-bc37d034bad564583790a46f19d807abfe519c5671395fd494d8cce506c42947
route.test.ts https://github.com/simstudioai/sim/pull/506/files#diff-0aeb4068b7758d4ef1411371426ad6fc010051f1f9afc5abecf9b2987f37702d
route.ts https://github.com/simstudioai/sim/pull/506/files#diff-5594eb05157ba8b2972f052e6f0feca5014f8ce4a9e74a471935347b0cd45194
route.test.ts https://github.com/simstudioai/sim/pull/506/files#diff-94b695313032a8ece810a35226318b21b74f1eec2fa53d6fd95f5d3e4cec20e2
route.ts https://github.com/simstudioai/sim/pull/506/files#diff-5de8408eba335984f30d739706963bb60ea778413ab6a54836d2524ef2b7c968
route.test.ts https://github.com/simstudioai/sim/pull/506/files#diff-9a380a36165a2c6c2d46586d280bf22d896cc481033d062503c9db60ce0db1e3
route.ts https://github.com/simstudioai/sim/pull/506/files#diff-8afbc69ee8a248a0b4f51fb065b51a2d1004ae80cf2d93578a2d2a6bab5923e4
route.test.ts https://github.com/simstudioai/sim/pull/506/files#diff-aaa040f5cf2c4f4a89280a9560728fcb6c688e410ee0f6945faee6a913a8634f
route.ts https://github.com/simstudioai/sim/pull/506/files#diff-2e1bb2cb6d37718fb0edc1164a1eea09d303379d4717f3844d00ac38e92d8ae9
route.test.ts https://github.com/simstudioai/sim/pull/506/files#diff-06d9cc518713cb1b4e4d1b0e6c1a8fed2f1c8e05d91ca372b4913e2d14ada1bf
route.ts https://github.com/simstudioai/sim/pull/506/files#diff-ce9d09ae154528087734e3e471bff2f2e1615d7924140fb91813b745e68e5f2c
utils.ts https://github.com/simstudioai/sim/pull/506/files#diff-cf0dbd7a02f4ac25fd4c864b014708c1d978d75efe972fae5ffcb021be58a9d3
route.ts https://github.com/simstudioai/sim/pull/506/files#diff-f1d5d8d09e645055941934dde39924b79fab29e996d6939b20803f848694dad0
utils.test.ts https://github.com/simstudioai/sim/pull/506/files#diff-23b670a77c544ff5ccc0c31dd1c6700ef269c8eddeaddc29039f960c17ca2ac6
utils.ts https://github.com/simstudioai/sim/pull/506/files#diff-f99ea65263ae54187521f6ab7f604e99a868addb01f4a7f10809e027a8ac5a4f
route.ts https://github.com/simstudioai/sim/pull/506/files#diff-4005073f5cff5e2142ee3dc0725d96539110e327ba4bbd831f06aa19604d1efc
file-upload.tsx https://github.com/simstudioai/sim/pull/506/files#diff-89c2600d0bd012c35470557ac89ddc10b2fa3645ef10a3729693fc52e10a62f0
base.tsx https://github.com/simstudioai/sim/pull/506/files#diff-d065e74cef8b3e7832ceef0d2eea1480e5e5c7b4f9abdbee37e3dbf4a41f67e9
create-form.tsx https://github.com/simstudioai/sim/pull/506/files#diff-f859733f8f106f94e3cf38ddffe618e8a170fa74d2d31bf8ba265cec84448763
document-processor.ts https://github.com/simstudioai/sim/pull/506/files#diff-9ffe431f34b16e70bb64888c5a346e5988837d634b69bfc26933bfb0b9abd54a
env.ts https://github.com/simstudioai/sim/pull/506/files#diff-4c5303340db5794863fbbb103b6e5e24f4f3e3d78aad090cfd45bc695f2ae46c
index.ts https://github.com/simstudioai/sim/pull/506/files#diff-5340b2eaee20e0208a9b187e5946c1b1bf273be94c0e2da72d79adedc2a399f7
types.ts https://github.com/simstudioai/sim/pull/506/files#diff-65f59f17af217bd0758197a935b918001153deab15a0fcdf21618a6ca1c7633d
xlsx-parser.ts https://github.com/simstudioai/sim/pull/506/files#diff-2d008d967e1c9e51820d451dcb43f90f82ce8dab768a3a3db8a9afd5594f5bff
blob-client.test.ts https://github.com/simstudioai/sim/pull/506/files#diff-1bf9b35777f58eb6bd7c7ec5366a046dcc20bc4db56c00cd7a623acbeb18818e
blob-client.ts https://github.com/simstudioai/sim/pull/506/files#diff-67f3984cc927e24316625b2bc3495402dd757d7a0151becc307aa551be607add
index.ts https://github.com/simstudioai/sim/pull/506/files#diff-b196014612674622e4d35200ab13763cf939e07816a1191683a92ed6b73adecf
index.ts https://github.com/simstudioai/sim/pull/506/files#diff-e2cf65fd1a091f16295587de18c8892e3359331366e67103f8c3f597a5901ff6
index.ts https://github.com/simstudioai/sim/pull/506/files#diff-9c97608a3c89c7ff63c67b22f7c776c3318651a1ed43f9b2cab4329e8648be49
s3-client.test.ts https://github.com/simstudioai/sim/pull/506/files#diff-06f6da0279e96a5aad587ad1e888cb137e50ed48db991eab9df0204c430193d6
s3-client.ts https://github.com/simstudioai/sim/pull/506/files#diff-78ec2b8343db4d2ab61b2dc6ce53c22c8f4beacbd4e75e367372069b4133569a
setup.server.ts https://github.com/simstudioai/sim/pull/506/files#diff-f1175769f64c10328202b0a01a0a8e3830f192e02cdaf34007bb9fa95fadbec6
setup.ts https://github.com/simstudioai/sim/pull/506/files#diff-f3cfef3e57187f6c3a3168f797cfead633567dbf1598581d6311b5d551bcafef
storage-client.ts https://github.com/simstudioai/sim/pull/506/files#diff-01ba114ede703d703aca287ebdd73528e9f7d74e57245277b4b6dbd2548c697a
next.config.ts https://github.com/simstudioai/sim/pull/506/files#diff-a2e0d564b8bf660a492f7abe431643db390b0f5696809465afc46475f552f15f
package.json https://github.com/simstudioai/sim/pull/506/files#diff-43a1bb37ce68ac536b0a4ed9e973d9d52da3975d74b37865f591bb37e191be64
store.ts https://github.com/simstudioai/sim/pull/506/files#diff-f203be7d5a0e9af086ced6469d131d145b395622b9bb2c81a148c78fb36791c0
parser.ts https://github.com/simstudioai/sim/pull/506/files#diff-cc9a669c10968d83639e823a80a7463877e4cc3a2b92dbf18102f7ef4ae4a411
bun.lock https://github.com/simstudioai/sim/pull/506/files#diff-bfd0ef82a01108fa1e836c2500b98b7de8a92bb1ae352a8efcbd9d6ffcaabd60
.gitignorehttps://github.com/simstudioai/sim/pull/506/files#diff-bc37d034bad564583790a46f19d807abfe519c5671395fd494d8cce506c42947
View file https://github.com/simstudioai/sim/blob/10f0ec5c409c8bc5e4777495d36f49d4c8426128/.gitignore
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/506/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/506/files#diff-bc37d034bad564583790a46f19d807abfe519c5671395fd494d8cce506c42947
https://github.com/simstudioai/sim/pull/506/files#diff-bc37d034bad564583790a46f19d807abfe519c5671395fd494d8cce506c42947
apps/sim/app/api/files/delete/route.test.tshttps://github.com/simstudioai/sim/pull/506/files#diff-0aeb4068b7758d4ef1411371426ad6fc010051f1f9afc5abecf9b2987f37702d
View file https://github.com/simstudioai/sim/blob/10f0ec5c409c8bc5e4777495d36f49d4c8426128/apps/sim/app/api/files/delete/route.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/506/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/506/files#diff-0aeb4068b7758d4ef1411371426ad6fc010051f1f9afc5abecf9b2987f37702d
https://github.com/simstudioai/sim/pull/506/files#diff-0aeb4068b7758d4ef1411371426ad6fc010051f1f9afc5abecf9b2987f37702d
https://github.com/simstudioai/sim/pull/506/files#diff-0aeb4068b7758d4ef1411371426ad6fc010051f1f9afc5abecf9b2987f37702d
Please reload this pagehttps://github.com/simstudioai/sim/pull/506/files
https://github.com/simstudioai/sim/pull/506/files#diff-0aeb4068b7758d4ef1411371426ad6fc010051f1f9afc5abecf9b2987f37702d
apps/sim/app/api/files/delete/route.tshttps://github.com/simstudioai/sim/pull/506/files#diff-5594eb05157ba8b2972f052e6f0feca5014f8ce4a9e74a471935347b0cd45194
View file https://github.com/simstudioai/sim/blob/10f0ec5c409c8bc5e4777495d36f49d4c8426128/apps/sim/app/api/files/delete/route.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/506/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/506/files#diff-5594eb05157ba8b2972f052e6f0feca5014f8ce4a9e74a471935347b0cd45194
https://github.com/simstudioai/sim/pull/506/files#diff-5594eb05157ba8b2972f052e6f0feca5014f8ce4a9e74a471935347b0cd45194
https://github.com/simstudioai/sim/pull/506/files#diff-5594eb05157ba8b2972f052e6f0feca5014f8ce4a9e74a471935347b0cd45194
https://github.com/simstudioai/sim/pull/506/files#diff-5594eb05157ba8b2972f052e6f0feca5014f8ce4a9e74a471935347b0cd45194
https://github.com/simstudioai/sim/pull/506/files#diff-5594eb05157ba8b2972f052e6f0feca5014f8ce4a9e74a471935347b0cd45194
Please reload this pagehttps://github.com/simstudioai/sim/pull/506/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.