René's URL Explorer Experiment


Title: Feat/rag url langchain by jondwillis · Pull Request #122 · stackwiseai/stackwise · GitHub

Open Graph Title: Feat/rag url langchain by jondwillis · Pull Request #122 · stackwiseai/stackwise

X Title: Feat/rag url langchain by jondwillis · Pull Request #122 · stackwiseai/stackwise

Description: rag-url-langchain-demo.mp4 some new features: uses a langchain RAG agent supports rag over multiple urls url highlighting in editor change the underlying model chat history streaming agent final output (nextjs app template says this isn't possible, but it is!) further improvements: streaming agent actions/intermediate steps (too lazy to build this right now) gemini (actually goes out and does work ( try adding LANGCHAIN_VERBOSE="true" to .env), but output is not rendered) smart ingest (on url detected, instead of waiting) possible issues: the puppeteer endpoint has to be nodejs, so I split it out into another API route. therefore the entire backend code won't be copied without more work. What are the next steps for deploying this?

Open Graph Description: rag-url-langchain-demo.mp4 some new features: uses a langchain RAG agent supports rag over multiple urls url highlighting in editor change the underlying model chat history ...

X Description: rag-url-langchain-demo.mp4 some new features: uses a langchain RAG agent supports rag over multiple urls url highlighting in editor change the underlying model chat history ...

Opengraph URL: https://github.com/stackwiseai/stackwise/pull/122

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:22e82afd-fef3-af97-59d5-7dbbd28bc47b
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idD4E0:1F3B04:1DE1CA4:25D55F4:69918996
html-safe-nonce012a8a09b65c57183cbcd9f5996ce62f7628a59cd223f9fe33aa268dbbcd51dc
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJENEUwOjFGM0IwNDoxREUxQ0E0OjI1RDU1RjQ6Njk5MTg5OTYiLCJ2aXNpdG9yX2lkIjoiMTcwMzA3MjEzOTQyOTY0NDY5NCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmacd307c473517913d99d29b91950f63331a04ccd629220d9b48ef7e2431b5bbde6
hovercard-subject-tagpull_request:1654295786
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/stackwiseai/stackwise/pull/122/files
twitter:imagehttps://avatars.githubusercontent.com/u/906671?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/906671?s=400&v=4
og:image:altrag-url-langchain-demo.mp4 some new features: uses a langchain RAG agent supports rag over multiple urls url highlighting in editor change the underlying model chat history ...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None42c603b9d642c4a9065a51770f75e5e27132fef0e858607f5c9cb7e422831a7b
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/stackwiseai/stackwise git https://github.com/stackwiseai/stackwise.git
octolytics-dimension-user_id148515831
octolytics-dimension-user_loginstackwiseai
octolytics-dimension-repository_id724355244
octolytics-dimension-repository_nwostackwiseai/stackwise
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id724355244
octolytics-dimension-repository_network_root_nwostackwiseai/stackwise
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release848bc6032dcc93a9a7301dcc3f379a72ba13b96e
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fstackwiseai%2Fstackwise%2Fpull%2F122%2Ffiles
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fstackwiseai%2Fstackwise%2Fpull%2F122%2Ffiles
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=stackwiseai%2Fstackwise
Reloadhttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files
Reloadhttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files
Reloadhttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files
stackwiseai https://patch-diff.githubusercontent.com/stackwiseai
stackwisehttps://patch-diff.githubusercontent.com/stackwiseai/stackwise
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2Fstackwiseai%2Fstackwise
Fork 34 https://patch-diff.githubusercontent.com/login?return_to=%2Fstackwiseai%2Fstackwise
Star 184 https://patch-diff.githubusercontent.com/login?return_to=%2Fstackwiseai%2Fstackwise
Code https://patch-diff.githubusercontent.com/stackwiseai/stackwise
Issues 25 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/issues
Pull requests 9 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pulls
Actions https://patch-diff.githubusercontent.com/stackwiseai/stackwise/actions
Projects 0 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/projects
Security 0 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/security
Insights https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pulse
Code https://patch-diff.githubusercontent.com/stackwiseai/stackwise
Issues https://patch-diff.githubusercontent.com/stackwiseai/stackwise/issues
Pull requests https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pulls
Actions https://patch-diff.githubusercontent.com/stackwiseai/stackwise/actions
Projects https://patch-diff.githubusercontent.com/stackwiseai/stackwise/projects
Security https://patch-diff.githubusercontent.com/stackwiseai/stackwise/security
Insights https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pulse
Sign up for GitHub https://patch-diff.githubusercontent.com/signup?return_to=%2Fstackwiseai%2Fstackwise%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://patch-diff.githubusercontent.com/login?return_to=%2Fstackwiseai%2Fstackwise%2Fissues%2Fnew%2Fchoose
jondwillishttps://patch-diff.githubusercontent.com/jondwillis
mainhttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/tree/main
feat/rag-url-langchainhttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/tree/feat/rag-url-langchain
Conversation 1 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122
Commits 10 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/commits
Checks 0 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/checks
Files changed https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files
Please reload this pagehttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files
Feat/rag url langchain https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#top
Show all changes 10 commits https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files
a7d76fa wip langchain nextjs template adaptation jondwillis Dec 19, 2023 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/commits/a7d76facf6a8c28bf69ef16a9416b13d0755876b
55c25dc wip rag url jondwillis Dec 20, 2023 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/commits/55c25dca80dc093b55377f32c80a6bf3f938d65e
82bb10c wip jondwillis Dec 20, 2023 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/commits/82bb10c08e36ea12362a241f9165c079b73b4471
4e019aa config, optimization, simplification, gemini doesn't work jondwillis Dec 21, 2023 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/commits/4e019aa36a8542e780a8e4d19f1cc77b3ffe8828
d49f746 always show placeholder while empty jondwillis Dec 21, 2023 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/commits/d49f746247bf4152fdeea211179ff761afb6ff9b
a8cbd49 do not export run puppeteer function jondwillis Dec 21, 2023 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/commits/a8cbd49092c37eca6b6eff44ca401b564a1baf80
82c0e1e try chrome-aws-lambda jondwillis Dec 21, 2023 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/commits/82c0e1e035d1b6c6b26077e738cf8b54d685193b
dd58aa6 use aws-lambda-chrome path and use puppeteer-core only jondwillis Dec 21, 2023 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/commits/dd58aa668d2ce485a4796f7bbbc1fb0d55dafd91
ea56717 downgrading puppeteer-core to fix version conflict jondwillis Dec 21, 2023 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/commits/ea56717cad8187587933161612da399de218b93d
02c99ba remove some extra padding jondwillis Dec 21, 2023 https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/commits/02c99ba17c4cd2a2a75eb61b1aae58bf51c71b0a
Clear filters https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files
Please reload this pagehttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files
Please reload this pagehttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files
launch.json https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#diff-0f3101a95b7164c46f95c6c569ae7f6ccbdb0b93f32be18f4b8cdc1b7f7d94ce
route.ts https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#diff-b2c62efb716c2f6429f1877241d8c22f65ef0bb088e5152ef24cd065fdbcf7fc
route.ts https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#diff-b3e51158c0e5fcda3aa97585b6c3b67197c859ca13eb71cd22f7abfe486a6f26
rag-url-with-langchain.tsx https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#diff-e41ee572fe32348ad8553ade5f150dc90e7bc797080aa86fb5421bed9983d318
next.config.js https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#diff-891482a40a36c2725b4cf9d1af74308ee5b895273bbb0ff61abca7c7b52931dc
package-lock.json https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#diff-86dd4842508e2d279ac0a1b9a660d6494b53ee7ccf321d641c0421cb15202fa6
package.json https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#diff-193b27d62e4fbda3d563009fed5ec6761a05f73558d94b39fab63ae948c679ea
ui/.vscode/launch.jsonhttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#diff-0f3101a95b7164c46f95c6c569ae7f6ccbdb0b93f32be18f4b8cdc1b7f7d94ce
View file https://patch-diff.githubusercontent.com/stackwiseai/stackwise/blob/02c99ba17c4cd2a2a75eb61b1aae58bf51c71b0a/ui/.vscode/launch.json
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/{{ revealButtonHref }}
https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#diff-0f3101a95b7164c46f95c6c569ae7f6ccbdb0b93f32be18f4b8cdc1b7f7d94ce
ui/app/api/rag-url-with-langchain/puppeteer/route.tshttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#diff-b2c62efb716c2f6429f1877241d8c22f65ef0bb088e5152ef24cd065fdbcf7fc
View file https://patch-diff.githubusercontent.com/stackwiseai/stackwise/blob/02c99ba17c4cd2a2a75eb61b1aae58bf51c71b0a/ui/app/api/rag-url-with-langchain/puppeteer/route.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/{{ revealButtonHref }}
ui/app/api/rag-url-with-langchain/route.tshttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files#diff-b3e51158c0e5fcda3aa97585b6c3b67197c859ca13eb71cd22f7abfe486a6f26
View file https://patch-diff.githubusercontent.com/stackwiseai/stackwise/blob/02c99ba17c4cd2a2a75eb61b1aae58bf51c71b0a/ui/app/api/rag-url-with-langchain/route.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/{{ revealButtonHref }}
Please reload this pagehttps://patch-diff.githubusercontent.com/stackwiseai/stackwise/pull/122/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.