René's URL Explorer Experiment


Title: feat(api): expand the public v2 files surface by TheodoreSpeaks · Pull Request #6160 · simstudioai/sim · GitHub

Open Graph Title: feat(api): expand the public v2 files surface by TheodoreSpeaks · Pull Request #6160 · simstudioai/sim

X Title: feat(api): expand the public v2 files surface by TheodoreSpeaks · Pull Request #6160 · simstudioai/sim

Description: Summary Expands /api/v2/files from list + upload + download + archive-one to cover what the internal files surface does: folders, rename, restore, move, bulk archive, share, and content replace v2FileSchema gains folderId / folderPath / updatedAt, the list gains scope=active|archived (Recently Deleted was unreachable, which made the restore endpoints useless), and upload gains folderId No folder-management routes. Files are folder-aware (folderId / folderPath on the projection, folderId on upload, and POST /api/v2/files/move) but this PR publishes no folder CRUD. File folders already live in the shared folder table as resourceType: 'file' (#6045 cut them over, #6051 dropped workspace_file_folders), and the remaining file-specific folder machinery is being folded into the generic folder engine — publishing /api/v2/files/folders/** would pin that transitional split into a public contract. A folder id is a folder.id and survives the unification, so the file-side fields are safe; folder management belongs on /api/v2/folders once it serves resourceType: 'file' Share and content replace had real logic sitting in the session routes, so it moved into lib/workspace-files/orchestration/ first (performUpsertWorkspaceFileShare, performGetWorkspaceFileShare, performUpdateWorkspaceFileContent) and the internal routes now call it — one implementation, not a parallel one WorkspaceFilesOrchestrationErrorCode was a narrower private copy of the shared OrchestrationErrorCode; reconciled onto the shared union so every route uses v2ErrorForOrchestration and the hand-rolled status switch in files/[fileId]/route.ts is gone Extracted the file projection that was inlined twice into app/api/v2/files/utils.ts (toV2File, toV2FileFolder) OpenAPI: 7 new operations in openapi-v2-files-audit.json, all under the existing Files tag — no new sidebar entries Two deliberate departures from the internal surface: Presigned upload is not exposed. Presign only does an advisory quota pre-check; the storage debit happens in the separate /register step, so presign → PUT bytes → never register leaves unaccounted bytes in the bucket with no orphan reaper. The buffered multipart path debits inside uploadWorkspaceFile's own transaction, so it's the only public path. Share drops the caller-supplied token. It exists so the UI can copy a link before saving; over an API key it lets a caller mint predictable public URLs (any string ≥16 chars, no entropy check) and a collision surfaces as an unhandled unique-index 500. v2 tokens are always server-generated. The OpenAPI description also spells out that disable is not revoke — upsertFileShare preserves the token and stored password/allow-list, so re-enabling resurrects the identical URL. Also fixed at the source rather than propagated: updateWorkspaceFileContent, renameWorkspaceFile, and restoreWorkspaceFile now throw a classified OrchestrationError('not_found') instead of a bare Error, so nothing downstream string-sniffs 'File not found' or 'Storage limit exceeded' (the latter was already a classified payload_too_large). Out of scope, on purpose: bulk zip download (~150 lines of budget accounting and archiver wiring with no lib home — needs its own extraction pass), style / csv-preview / compiled-check / inline-image (editor-internal), and /api/tools/file/manage's write/append/compress/decompress. Known gaps (not fixed here) No v2 way to enumerate file folders. /api/v2/folders currently rejects resourceType=file, so a caller can set folderId on upload/move only with an id it already holds. This is the deliberate consequence of not publishing a transitional folder surface; it closes when the generic folder engine takes over file folders (it needs the path-segment name rules and the per-workspace advisory lock first). v2 list pagination is still in-memory — listWorkspaceFiles returns the full set for the scope and the route sorts and slices. Adding scope makes the set larger, so this gets worse before it gets better. Shares have no expiry column, no per-workspace cap, and no creation-side rate limit. The EE disablePublicFileSharing policy resolves against getUserPermissionConfig(userId, workspaceId) — worth confirming it behaves for a workspace-scoped API key, whose userId is the billed account rather than the acting human. Duplicate-name semantics are unchanged and shared: both surfaces auto-suffix via allocateUniqueWorkspaceFileName, so an upload can return 201 with a name different from the one sent — clients must read name back off the response. CONFLICT fires only when a unique name can't be allocated after several attempts. (My first draft of the OpenAPI description claimed 409 on any collision; Bugbot caught it and it's corrected.) PATCH /api/v2/files/{fileId} is the exact-or-fail path. v2 access denials stay 403 rather than being masked as 404 on reads — that matches every existing v2 route (v2WorkspaceAccessError); masking would be a surface-wide change, not a files-only one. Type of Change New feature Testing bun run check:api-validation:strict — passes (route baseline bumped 1041 → 1049 for the 8 new route files) bun run check:openapi — passes, 7 specs / 94 operations / 85 contracts cross-checked bun run type-check — passes bun run lint:check — passes bunx vitest run app/api/v2/files lib/workspace-files lib/uploads app/api/workspaces — 48 files, 425 tests passing One route.test.ts per route file: gate-off, invalid input, 403, 429, and happy path each, plus targeted cases for share PUT rejecting an unknown token, a bare re-enable keeping the existing token, scope=archived listing only archived items, and an upload landing in the folder named by folderId Checklist Code follows project style guidelines Self-reviewed my changes Tests added/updated and passing No new warnings introduced I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

Open Graph Description: Summary Expands /api/v2/files from list + upload + download + archive-one to cover what the internal files surface does: folders, rename, restore, move, bulk archive, share, and content replace v2...

X Description: Summary Expands /api/v2/files from list + upload + download + archive-one to cover what the internal files surface does: folders, rename, restore, move, bulk archive, share, and content replace v2...

Opengraph URL: https://github.com/simstudioai/sim/pull/6160

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:c702f332-9ff6-5be0-caad-d218af15b10e
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idE64C:2833F1:63CFD4:89BC1A:6AFB3FD9
html-safe-nonce5901e3fb0a57c165cf35660c2ec5312c687b1ca0e42bd59118483f0bd7cae1de
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFNjRDOjI4MzNGMTo2M0NGRDQ6ODlCQzFBOjZBRkIzRkQ5IiwidmlzaXRvcl9pZCI6IjE5MzQyMzExNzQ4NTk0MDczMjEiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac8858834bea5634a86df42ba171c3dd7761c44bdf633ffaf1529ddd8b9f5758cd
hovercard-subject-tagpull_request:4183232300
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/6160/files
twitter:imagehttps://avatars.githubusercontent.com/u/19564703?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/19564703?s=400&v=4
og:image:altSummary Expands /api/v2/files from list + upload + download + archive-one to cover what the internal files surface does: folders, rename, restore, move, bulk archive, share, and content replace v2...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noned849b928f455c800985398e7f1b659425adb312a5fa14fba5d9a14e62e9fe5dd
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releasea6c2f87cbcb6414452377b4967858ed6a66f1109
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/6160/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F6160%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F6160%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/6160/files
Reloadhttps://github.com/simstudioai/sim/pull/6160/files
Reloadhttps://github.com/simstudioai/sim/pull/6160/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests202 (202)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
TheodoreSpeakshttps://github.com/TheodoreSpeaks
improvement/v2-endpointshttps://github.com/simstudioai/sim/tree/improvement/v2-endpoints
feat/v2-files-surfacehttps://github.com/simstudioai/sim/tree/feat/v2-files-surface
Conversation 30 https://github.com/simstudioai/sim/pull/6160
Commits 5 https://github.com/simstudioai/sim/pull/6160/commits
Checks 4 https://github.com/simstudioai/sim/pull/6160/checks
Files changed https://github.com/simstudioai/sim/pull/6160/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/6160/files
feat(api): expand the public v2 files surface https://github.com/simstudioai/sim/pull/6160/files#top
Show all changes 5 commits https://github.com/simstudioai/sim/pull/6160/files
6bb9e7e feat(api): expand the public v2 files surface TheodoreSpeaks Aug 1, 2026 https://github.com/simstudioai/sim/pull/6160/commits/6bb9e7e33497f2ee780fa0832ba07a0e7ab60e0d
3d8e489 fix(files): classify folder and content failures instead of 500ing them TheodoreSpeaks Aug 1, 2026 https://github.com/simstudioai/sim/pull/6160/commits/3d8e489d752a6f83b0250d08e0a93196b0724273
5bb4c37 fix(files): surface a failed upload read-back as the real error TheodoreSpeaks Aug 1, 2026 https://github.com/simstudioai/sim/pull/6160/commits/5bb4c37c0ce2e571459e0618e0ef81809cc0f8f7
ff1d964 revert(api): drop the dedicated v2 file-folder routes TheodoreSpeaks Aug 1, 2026 https://github.com/simstudioai/sim/pull/6160/commits/ff1d96432a6c452b4ebabf95b5d42b10543a2b4f
850f742 fix(files): classify upload failures instead of matching their wording TheodoreSpeaks Aug 1, 2026 https://github.com/simstudioai/sim/pull/6160/commits/850f742a5f5b1f9d79862ed67bb59e953b2f9f24
Clear filters https://github.com/simstudioai/sim/pull/6160/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/6160/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/6160/files
openapi-v2-files-audit.json https://github.com/simstudioai/sim/pull/6160/files#diff-c6918d7f933ec43ee8b8a4983d19f272b35962e2510bad721fc05d6d82b41b8d
middleware.ts https://github.com/simstudioai/sim/pull/6160/files#diff-92f74d9ee4f123e429cd83a651c51fe276952d40ddd7fea7b0cb32bc48593ffe
route.test.ts https://github.com/simstudioai/sim/pull/6160/files#diff-8429640e4c6b9d1f3e92a21c7be1d902e599b20d77b13a86346a5801f27da7ff
route.ts https://github.com/simstudioai/sim/pull/6160/files#diff-07d82c533abd14bfe90fd1f6977f3a060fec0eaa6f271e9a34e40729f3884470
route.test.ts https://github.com/simstudioai/sim/pull/6160/files#diff-bfb6e85357753d25b75f410a4cd15e98c2307faf23381884d0a7e67b944fff52
route.ts https://github.com/simstudioai/sim/pull/6160/files#diff-ab428f4410aeb79f4d092bad751f34357de4b6e595b33dcc14dfadeb5c2660de
route.test.ts https://github.com/simstudioai/sim/pull/6160/files#diff-b4052196c356f11a02557754378b84a52b53866d0de6b8ac4491c39c5abbb353
route.ts https://github.com/simstudioai/sim/pull/6160/files#diff-d7a59921045705b9e3c2edeaddfbf7324da89998685abf7064df2c9ed9d57cc7
route.test.ts https://github.com/simstudioai/sim/pull/6160/files#diff-d3779ff2b2a35b5b08984bc7cc27e79a25a2155068e710735d18cafc5baf4395
route.ts https://github.com/simstudioai/sim/pull/6160/files#diff-1e89c0e06d4ebf047313180e149fffe336728894b822d561e512144245d89e6f
route.test.ts https://github.com/simstudioai/sim/pull/6160/files#diff-e7ce0b16a93cce7ac1ea63f2ed65cb14590dda1afa73cdb90845d790b9847fca
route.ts https://github.com/simstudioai/sim/pull/6160/files#diff-758c01f1ceda5b312a103ad8edb3b33f1cbde2989556b0783bdf8fffa193a1bc
route.test.ts https://github.com/simstudioai/sim/pull/6160/files#diff-335404a1fff8a94e8b17c3465dea0d1c1bdbc488e3a996fca92e12a0b26912f0
route.ts https://github.com/simstudioai/sim/pull/6160/files#diff-965366a8f413647fb0dbf5ed1b63b16c71d30e60be6067ffc0419a442b0a0c79
route.test.ts https://github.com/simstudioai/sim/pull/6160/files#diff-f65aa35a42eb4e0fba80ec75874cfed54277848efeedcaed76a38eaef1e70ebb
route.ts https://github.com/simstudioai/sim/pull/6160/files#diff-fd3d80549f88f47c880a2eb988cf60c80e4b32ef4e566a10ace7a92a5efea16e
utils.ts https://github.com/simstudioai/sim/pull/6160/files#diff-d7177d55c049dceced2d942257670d1591863a9bb7e031b5096cd086deb96388
route.ts https://github.com/simstudioai/sim/pull/6160/files#diff-081179a407af91623abd97121a5b2850e323845505010d2e8fb1b207d0a826e1
route.ts https://github.com/simstudioai/sim/pull/6160/files#diff-541f227f742d2c6fea1aa126d2c8b5551589d611cb0ae2f56f8dcd98c22ef373
route.ts https://github.com/simstudioai/sim/pull/6160/files#diff-4c5918b8148bb318ebc7cf01a6bcfeca5934bb49665bd5ef90d0828d71cf817e
route.ts https://github.com/simstudioai/sim/pull/6160/files#diff-4873b87e2895e96de60ae6bcf176fe21b7f33451b50e08508b57b08fc868899c
route.ts https://github.com/simstudioai/sim/pull/6160/files#diff-0ee527ae44fbe74eecc26272fb70f34e5e1fea3235be3c42f56984ea3d4ed82f
files.ts https://github.com/simstudioai/sim/pull/6160/files#diff-615f44153f90418dc013f064e82e3f80f38bee63452ab7612e669651365c90b9
workspace-file-folder-manager.ts https://github.com/simstudioai/sim/pull/6160/files#diff-7ab6712e7e7b3b214000c022f68393bf7da60abb4ec2a557d5fa912f10c245cc
workspace-file-manager.ts https://github.com/simstudioai/sim/pull/6160/files#diff-fcf305d0b37403347596bca42fc6889e9038c9f8e2c69ba20676c0f0d8fead34
content.ts https://github.com/simstudioai/sim/pull/6160/files#diff-d3a826da82a449eb4baa6f3b7daa653c72539ec6c092004fc36c40370d85f591
file-folder-lifecycle.test.ts https://github.com/simstudioai/sim/pull/6160/files#diff-fbe93d3144354543a5f834900e32cb73c96637f9a85aaaf48db30f273327dea3
file-folder-lifecycle.ts https://github.com/simstudioai/sim/pull/6160/files#diff-093d25b0c251d88237399b2808c5daefad838b5ed28e8754a6b60b182ab71d64
index.ts https://github.com/simstudioai/sim/pull/6160/files#diff-a43bfca3e40644eae5dc9d49340ba3d4169bae90d75ea8284408feb47047b8cb
share.ts https://github.com/simstudioai/sim/pull/6160/files#diff-7154c81624664fc9647e4d2d58f0664eb09c95aa4857690f0ef6a150b02b5ba7
check-api-validation-contracts.ts https://github.com/simstudioai/sim/pull/6160/files#diff-48ae6a4d0c1f820d5b644522d25742bb29af758bc8350f1a3cf3f8afa0bd00b0
apps/docs/openapi-v2-files-audit.jsonhttps://github.com/simstudioai/sim/pull/6160/files#diff-c6918d7f933ec43ee8b8a4983d19f272b35962e2510bad721fc05d6d82b41b8d
View file https://github.com/simstudioai/sim/blob/850f742a5f5b1f9d79862ed67bb59e953b2f9f24/apps/docs/openapi-v2-files-audit.json
Open in desktop https://desktop.github.com
Please reload this pagehttps://github.com/simstudioai/sim/pull/6160/files
apps/sim/app/api/v1/middleware.tshttps://github.com/simstudioai/sim/pull/6160/files#diff-92f74d9ee4f123e429cd83a651c51fe276952d40ddd7fea7b0cb32bc48593ffe
View file https://github.com/simstudioai/sim/blob/850f742a5f5b1f9d79862ed67bb59e953b2f9f24/apps/sim/app/api/v1/middleware.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/6160/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/6160/files#diff-92f74d9ee4f123e429cd83a651c51fe276952d40ddd7fea7b0cb32bc48593ffe
https://github.com/simstudioai/sim/pull/6160/files#diff-92f74d9ee4f123e429cd83a651c51fe276952d40ddd7fea7b0cb32bc48593ffe
apps/sim/app/api/v2/files/[fileId]/content/route.test.tshttps://github.com/simstudioai/sim/pull/6160/files#diff-8429640e4c6b9d1f3e92a21c7be1d902e599b20d77b13a86346a5801f27da7ff
View file https://github.com/simstudioai/sim/blob/850f742a5f5b1f9d79862ed67bb59e953b2f9f24/apps/sim/app/api/v2/files/%5BfileId%5D/content/route.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/6160/{{ revealButtonHref }}
apps/sim/app/api/v2/files/[fileId]/content/route.tshttps://github.com/simstudioai/sim/pull/6160/files#diff-07d82c533abd14bfe90fd1f6977f3a060fec0eaa6f271e9a34e40729f3884470
View file https://github.com/simstudioai/sim/blob/850f742a5f5b1f9d79862ed67bb59e953b2f9f24/apps/sim/app/api/v2/files/%5BfileId%5D/content/route.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/6160/{{ revealButtonHref }}
Please reload this pagehttps://github.com/simstudioai/sim/pull/6160/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/6160/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.