René's URL Explorer Experiment


Title: feat: support redis by jupyterjazz · Pull Request #1550 · docarray/docarray · GitHub

Open Graph Title: feat: support redis by jupyterjazz · Pull Request #1550 · docarray/docarray

X Title: feat: support redis by jupyterjazz · Pull Request #1550 · docarray/docarray

Description: Redis as a Document Index Backend Simple usage: class MyDoc(BaseDoc): text: str embedding: NdArray[10] docs = [MyDoc(text=f'text {i}', embedding=np.random.rand(10)) for i in range(10)] query = np.random.rand(10) db = RedisDocumentIndex[MyDoc](host='localhost') db.index(docs) results = index.find(query, search_field='embedding', limit=10) Supported functionality: Find (vector search) Filter (filtering on textual and numeric data using redis syntax) Text Search (text search using various approaches, e.g. BM25..) Get/Del Hybrid Search (currently, only combining find and filter) Subindex

Open Graph Description: Redis as a Document Index Backend Simple usage: class MyDoc(BaseDoc): text: str embedding: NdArray[10] docs = [MyDoc(text=f'text {i}', embedding=np.random.rand(10)) for i in range(...

X Description: Redis as a Document Index Backend Simple usage: class MyDoc(BaseDoc): text: str embedding: NdArray[10] docs = [MyDoc(text=f'text {i}', embedding=np.random.rand(10)) for i i...

Opengraph URL: https://github.com/docarray/docarray/pull/1550

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository/pull/:id/commits/:range(.:format)
route-controllerpull_requests
route-actioncommits
fetch-noncev2:c4b0298c-baf1-7eee-c007-290414fca32c
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-id8116:C93C5:12D28B:1A8A9E:69972DDB
html-safe-nonce0cfad1d308a622699fcaa65f39a067f7446268fab1cabd3c9029f4f0c31fc5a4
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4MTE2OkM5M0M1OjEyRDI4QjoxQThBOUU6Njk5NzJEREIiLCJ2aXNpdG9yX2lkIjoiMzYxOTEwNTc5Mzc1OTQ1NjczMSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmaced7b72dd109f5004b503ac87d491db87b8175c33f5c60a52c5b9051ad33da960
hovercard-subject-tagpull_request:1354287756
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/commits
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349
twitter:imagehttps://avatars.githubusercontent.com/u/45267439?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/45267439?s=400&v=4
og:image:altRedis as a Document Index Backend Simple usage: class MyDoc(BaseDoc): text: str embedding: NdArray[10] docs = [MyDoc(text=f'text {i}', embedding=np.random.rand(10)) for i in range(...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None7e6af791057690a60ffd9f5bb19a1e7b7637429945357211e6d6d09f15f081ae
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/docarray/docarray git https://github.com/docarray/docarray.git
octolytics-dimension-user_id117445116
octolytics-dimension-user_logindocarray
octolytics-dimension-repository_id438303578
octolytics-dimension-repository_nwodocarray/docarray
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id438303578
octolytics-dimension-repository_network_root_nwodocarray/docarray
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release130554a977f1d6328840e1d48b33fb0b1e61db9a
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fdocarray%2Fdocarray%2Fpull%2F1550%2Fcommits%2F51558b7df8dbc16c74619a23849f7c1bf6a7f349
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fdocarray%2Fdocarray%2Fpull%2F1550%2Fcommits%2F51558b7df8dbc16c74619a23849f7c1bf6a7f349
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Fcommits&source=header-repo&source_repo=docarray%2Fdocarray
Reloadhttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349
Reloadhttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349
Reloadhttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349
docarray https://github.com/docarray
docarrayhttps://github.com/docarray/docarray
Notifications https://github.com/login?return_to=%2Fdocarray%2Fdocarray
Fork 235 https://github.com/login?return_to=%2Fdocarray%2Fdocarray
Star 3.1k https://github.com/login?return_to=%2Fdocarray%2Fdocarray
Code https://github.com/docarray/docarray
Issues 68 https://github.com/docarray/docarray/issues
Pull requests 37 https://github.com/docarray/docarray/pulls
Discussions https://github.com/docarray/docarray/discussions
Actions https://github.com/docarray/docarray/actions
Security 0 https://github.com/docarray/docarray/security
Insights https://github.com/docarray/docarray/pulse
Code https://github.com/docarray/docarray
Issues https://github.com/docarray/docarray/issues
Pull requests https://github.com/docarray/docarray/pulls
Discussions https://github.com/docarray/docarray/discussions
Actions https://github.com/docarray/docarray/actions
Security https://github.com/docarray/docarray/security
Insights https://github.com/docarray/docarray/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fdocarray%2Fdocarray%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fdocarray%2Fdocarray%2Fissues%2Fnew%2Fchoose
JoanFMhttps://github.com/JoanFM
mainhttps://github.com/docarray/docarray/tree/main
feat-add-redishttps://github.com/docarray/docarray/tree/feat-add-redis
Conversation 58 https://github.com/docarray/docarray/pull/1550
Commits 36 https://github.com/docarray/docarray/pull/1550/commits
Checks 0 https://github.com/docarray/docarray/pull/1550/checks
Files changed https://github.com/docarray/docarray/pull/1550/files
Please reload this pagehttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349
feat: support redis https://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#top
Show all changes 36 commits https://github.com/docarray/docarray/pull/1550/files
df47474 feat: support redis jupyterjazz May 17, 2023 https://github.com/docarray/docarray/pull/1550/commits/df474741e5b24e2641da63ff66d6f4e9b3daa7d9
0920adc chore: merge main jupyterjazz Jun 12, 2023 https://github.com/docarray/docarray/pull/1550/commits/0920adc2b0df7d3a69b13b2809e62b86a7bc0a79
51558b7 fix: index creation jupyterjazz Jun 15, 2023 https://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349
12da714 feat: 1st draft, needs polishing jupyterjazz Jun 21, 2023 https://github.com/docarray/docarray/pull/1550/commits/12da714a673af63045f11fbc226f6895687ddae0
be7bed7 feat: query builder, tests jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/be7bed7792448abd857dab0afe240228d58df939
9365327 Merge branch 'main' into feat-add-redis jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/936532786ea3426a40878f2b5a030b7cd6c37127
cb25869 chore: update poetry lock jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/cb25869c0e46b952ea18a5dbfd2fd8204e18ef69
341fa9a chore: run tests jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/341fa9afca2d4542e6b5249dd5b23d67e7fbd851
d37b28f Merge branch 'main' into feat-add-redis jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/d37b28f25782dbf23329f5978aba25f1a74f7250
abca1dd fix: defaultdict for column config jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/abca1dd228fa4df59d385250e6d540908390d334
edc8a34 chore: update branch jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/edc8a342e3910b4f72a85984299da77cc973ce60
c5abd80 style: ignore mypy errors jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/c5abd80320136e5989b4e90a1d2666ddc4c9bc8a
22434f1 refactor: put vectorfield args in column info jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/22434f16b91175c636a97a6abc7dccb45bb897a7
4a96194 chore: remove unused code jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/4a961946469d3a232e892beb14bdd925d2ffa10f
a52cdfd docs: add docstrings jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/a52cdfde72d8dd41867e1735aeb33e1e0e9ad608
9ac683f test: add tensorflow test jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/9ac683f31bcbae1193593fbc6023a3cd77a07154
a7f54c3 fix: tensorflow test jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/a7f54c387ba5d3f199c1aceb91fe502b7ea8aae0
be9d771 fix: tf tst jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/be9d771168f609dc68dce20543ecbca349cb9abc
4dc99e6 refactor: reduce ignore types jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/4dc99e61520665eb222765886ed4c3e25ca861f8
d2718b4 style: remove other type ignores jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/d2718b44a1089bdd11fe177cac39c6fefb070a9f
9f58474 style: try removing import ignores jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/9f58474fc4f6674d14e90f93d69f65fa89b82c5f
7e791da style: i think mypy hates me jupyterjazz Jun 28, 2023 https://github.com/docarray/docarray/pull/1550/commits/7e791dac79533ed70d463ea3a73944b55df09589
8ed3dbb feat: batch indexing jupyterjazz Jun 29, 2023 https://github.com/docarray/docarray/pull/1550/commits/8ed3dbbebff238cb583cd4b9881a18b6d2b8fb7a
83afb5f chore: bump redis version jupyterjazz Jun 29, 2023 https://github.com/docarray/docarray/pull/1550/commits/83afb5f51b79df676555ff21d8eba1b95161765c
4b0bc73 feat: subindex not fully finished jupyterjazz Jul 2, 2023 https://github.com/docarray/docarray/pull/1550/commits/4b0bc73f8fc1d199fb81eec6def303e16cbc4440
0b15adc feat: finalize subindex jupyterjazz Jul 5, 2023 https://github.com/docarray/docarray/pull/1550/commits/0b15adc5fe2dea5410123203ecc2ae2fd3ce9497
e8fbc47 docs: update readme jupyterjazz Jul 5, 2023 https://github.com/docarray/docarray/pull/1550/commits/e8fbc4795cf170c806cbea81a9bf61069418d9bf
848e95d chore: commits not showing jupyterjazz Jul 5, 2023 https://github.com/docarray/docarray/pull/1550/commits/848e95dc3be7b6b4c49217d3cc8044e367fc2b57
c00abe2 Merge branch 'main' into feat-add-redis jupyterjazz Jul 5, 2023 https://github.com/docarray/docarray/pull/1550/commits/c00abe2227dbf981df0340f6e58cd05e79641b69
27dd29a feat: del and get batched jupyterjazz Jul 6, 2023 https://github.com/docarray/docarray/pull/1550/commits/27dd29ac1dc56ca156eb9e6085616d32aa0bc4ac
162c6a8 docs: update batchsize docstring jupyterjazz Jul 6, 2023 https://github.com/docarray/docarray/pull/1550/commits/162c6a8b565dd6f8a3731065d7be901711f1c06b
16c4323 Merge branch 'main' into feat-add-redis jupyterjazz Jul 6, 2023 https://github.com/docarray/docarray/pull/1550/commits/16c43238a1e8c69e404a4f18dd2961347abb8b8f
56829d6 refactor: index name jupyterjazz Jul 9, 2023 https://github.com/docarray/docarray/pull/1550/commits/56829d6986ef5d21e48e097397b506c3ca028f63
c414836 Merge branch 'main' into feat-add-redis jupyterjazz Jul 9, 2023 https://github.com/docarray/docarray/pull/1550/commits/c4148360f37412f6a23a1ce56449327f16a8f287
7a5ed5e refactor: default index name following schema jupyterjazz Jul 9, 2023 https://github.com/docarray/docarray/pull/1550/commits/7a5ed5e1ab400f02b01271ae1f29886b26d3e947
0fecb48 chore: update branch jupyterjazz Jul 9, 2023 https://github.com/docarray/docarray/pull/1550/commits/0fecb48a3599a117cd6b4309cc957ab3d0dcb938
Clear filters https://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349
Please reload this pagehttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349
Please reload this pagehttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349
redis.py https://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#diff-337e36adb36b2880d4b2924fa397dafd50e55d5080c07a14d7bb04263fd3fb8c
docker-compose.yml https://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#diff-ba9bfb8d5081078ce907b4f6a512ca4d42ea3cf183e648b2c52ccfb5ba695532
fixtures.py https://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#diff-6c13894029428c334c648f19a8009ad40e04a73265539e30ff111c1d08c693da
Prev https://github.com/docarray/docarray/pull/1550/commits/0920adc2b0df7d3a69b13b2809e62b86a7bc0a79
Next https://github.com/docarray/docarray/pull/1550/commits/12da714a673af63045f11fbc226f6895687ddae0
Please reload this pagehttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349
https://github.com/jupyterjazz
jupyterjazzhttps://github.com/docarray/docarray/commits?author=jupyterjazz
docarray/index/backends/redis.pyhttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#diff-337e36adb36b2880d4b2924fa397dafd50e55d5080c07a14d7bb04263fd3fb8c
View file https://github.com/docarray/docarray/blob/51558b7df8dbc16c74619a23849f7c1bf6a7f349/docarray/index/backends/redis.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/docarray/docarray/pull/1550/commits/{{ revealButtonHref }}
https://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#diff-337e36adb36b2880d4b2924fa397dafd50e55d5080c07a14d7bb04263fd3fb8c
https://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#diff-337e36adb36b2880d4b2924fa397dafd50e55d5080c07a14d7bb04263fd3fb8c
https://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#diff-337e36adb36b2880d4b2924fa397dafd50e55d5080c07a14d7bb04263fd3fb8c
Please reload this pagehttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349
tests/index/redis/docker-compose.ymlhttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#diff-ba9bfb8d5081078ce907b4f6a512ca4d42ea3cf183e648b2c52ccfb5ba695532
View file https://github.com/docarray/docarray/blob/0920adc2b0df7d3a69b13b2809e62b86a7bc0a79/tests/index/redis/docker-compose.yml
Open in desktop https://desktop.github.com
Please reload this pagehttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349
tests/index/redis/fixtures.pyhttps://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#diff-6c13894029428c334c648f19a8009ad40e04a73265539e30ff111c1d08c693da
View file https://github.com/docarray/docarray/blob/51558b7df8dbc16c74619a23849f7c1bf6a7f349/tests/index/redis/fixtures.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/docarray/docarray/pull/1550/commits/{{ revealButtonHref }}
https://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#diff-6c13894029428c334c648f19a8009ad40e04a73265539e30ff111c1d08c693da
https://github.com/docarray/docarray/pull/1550/commits/51558b7df8dbc16c74619a23849f7c1bf6a7f349#diff-6c13894029428c334c648f19a8009ad40e04a73265539e30ff111c1d08c693da
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.