René's URL Explorer Experiment


Title: How to use filter_docs with multiple filter from the same key (bug?) · docarray/docarray · Discussion #1749 · GitHub

Open Graph Title: How to use filter_docs with multiple filter from the same key (bug?) · docarray/docarray · Discussion #1749

X Title: How to use filter_docs with multiple filter from the same key (bug?) · docarray/docarray · Discussion #1749

Description: How to use filter_docs with multiple filter from the same key (bug?)

Open Graph Description: Hey there! Thanks for the great work! I am currently struggling a bit with the filter_docs: I have a docsList of a doc like this: class ImageDoc(BaseDoc): url: ImageUrl test_index: Optional[int] lo...

X Description: Hey there! Thanks for the great work! I am currently struggling a bit with the filter_docs: I have a docsList of a doc like this: class ImageDoc(BaseDoc): url: ImageUrl test_index: Optional[int] lo...

Opengraph URL: https://github.com/docarray/docarray/discussions/1749

X: @github

direct link

Domain: github.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"QAPage","mainEntity":{"@type":"Question","name":"How to use filter_docs with multiple filter from the same key (bug?)","text":"

Hey there!
\nThanks for the great work!

\n

I am currently struggling a bit with the filter_docs:

\n

I have a docsList of a doc like this:

\n
class ImageDoc(BaseDoc):\n    url: ImageUrl\n    test_index: Optional[int]\n    local_path: Optional[str]\n    tensor: Optional[ImageTorchTensor]\n    embedding: Optional[AnyEmbedding]
\n

Now I want to filter out all the docs which have either test_index 3 or 9 . What would be the query for this? This does not work:

\n
query = {\n    '$and': {\n        'test_index' : {'$neq' : 3},\n        'test_index' : {'$neq' : 9}\n    }\n}\n
\n

And only filters out only the 9 (second part of the query). This seems to be always happening when using two times the same index in the query.

\n

What would be the correct approach for this?

\n

Currently I am solving this with a regex expression, but that does not seem right haha
\nThanks!

","upvoteCount":1,"answerCount":3,"acceptedAnswer":{"@type":"Answer","text":"

Hello @simonschoenhofen .

\n

I finally got time to look at this issue.

\n

This does not seem to be a bug, since the query is a dictionary, a dictionary cannot contain 2 entries of the same key and this is why docarray only sees one of the entries.

\n

I would say that the query should be designed differently using the nin (not in a set) clause:

\n

query = {
\n'test_index' : {'$nin' : [3, 9]},
\n}

","upvoteCount":2,"url":"https://github.com/docarray/docarray/discussions/1749#discussioncomment-6798945"}}}

route-pattern/_view_fragments/Voltron::DiscussionsFragmentsController/show/:user_id/:repository/:discussion_number/discussion_layout(.:format)
route-controllervoltron_discussions_fragments
route-actiondiscussion_layout
fetch-noncev2:996e40c4-5d43-e43f-a5d7-59a79bcf03ef
current-catalog-service-hash9f0abe34da433c9b6db74bffa2466494a717b579a96b30a5d252e5090baea7be
request-idA484:2A271A:2ACA1CF:37D686C:69648EF3
html-safe-nonce1c13ef5d9c9842ba05cb18e3039e7dc11149912fd35f8e13f609b970487b672e
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBNDg0OjJBMjcxQToyQUNBMUNGOjM3RDY4NkM6Njk2NDhFRjMiLCJ2aXNpdG9yX2lkIjoiNTA0MjEwNzExMTM5MDk0MjU5IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmacc67c1a420b8a5262e59735bdf934179179310f68f622bac9f80a61652cb4ac9e
hovercard-subject-tagdiscussion:5509231
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/discussions_fragments/discussion_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/Voltron::DiscussionsFragmentsController/show/docarray/docarray/1749/discussion_layout
twitter:imagehttps://opengraph.githubassets.com/166d24cf124d8e8e30b6fb92f162872f3320c554140ea555d33928c1d12aae45/docarray/docarray/discussions/1749
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/166d24cf124d8e8e30b6fb92f162872f3320c554140ea555d33928c1d12aae45/docarray/docarray/discussions/1749
og:image:altHey there! Thanks for the great work! I am currently struggling a bit with the filter_docs: I have a docsList of a doc like this: class ImageDoc(BaseDoc): url: ImageUrl test_index: Optional[int] lo...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Nonebaa7d9900fdf7b27d604f36887af878d569cfbdcf97126832a5f4f0caf0c6ba5
turbo-cache-controlno-preview
go-importgithub.com/docarray/docarray git https://github.com/docarray/docarray.git
octolytics-dimension-user_id117445116
octolytics-dimension-user_logindocarray
octolytics-dimension-repository_id438303578
octolytics-dimension-repository_nwodocarray/docarray
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id438303578
octolytics-dimension-repository_network_root_nwodocarray/docarray
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release842eff1d11f899d02b6b3b98fa3ea4860e64b34e
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/docarray/docarray/discussions/1749#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fdocarray%2Fdocarray%2Fdiscussions%2F1749
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fdocarray%2Fdocarray%2Fdiscussions%2F1749
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fdiscussions_fragments%2Fdiscussion_layout&source=header-repo&source_repo=docarray%2Fdocarray
Reloadhttps://github.com/docarray/docarray/discussions/1749
Reloadhttps://github.com/docarray/docarray/discussions/1749
Reloadhttps://github.com/docarray/docarray/discussions/1749
docarray https://github.com/docarray
docarrayhttps://github.com/docarray/docarray
Notifications https://github.com/login?return_to=%2Fdocarray%2Fdocarray
Fork 234 https://github.com/login?return_to=%2Fdocarray%2Fdocarray
Star 3.1k https://github.com/login?return_to=%2Fdocarray%2Fdocarray
Code https://github.com/docarray/docarray
Issues 68 https://github.com/docarray/docarray/issues
Pull requests 36 https://github.com/docarray/docarray/pulls
Discussions https://github.com/docarray/docarray/discussions
Actions https://github.com/docarray/docarray/actions
Security Uh oh! There was an error while loading. Please reload this page. https://github.com/docarray/docarray/security
Please reload this pagehttps://github.com/docarray/docarray/discussions/1749
Insights https://github.com/docarray/docarray/pulse
Code https://github.com/docarray/docarray
Issues https://github.com/docarray/docarray/issues
Pull requests https://github.com/docarray/docarray/pulls
Discussions https://github.com/docarray/docarray/discussions
Actions https://github.com/docarray/docarray/actions
Security https://github.com/docarray/docarray/security
Insights https://github.com/docarray/docarray/pulse
Answered https://github.com/docarray/docarray/discussions/1749#discussioncomment-6798945
JoanFMhttps://github.com/JoanFM
simonschoenhofen https://github.com/simonschoenhofen
Q&Ahttps://github.com/docarray/docarray/discussions/categories/q-a
How to use filter_docs with multiple filter from the same key (bug?) https://github.com/docarray/docarray/discussions/1749#top
simonschoenhofen https://github.com/simonschoenhofen
Answered https://github.com/docarray/docarray/discussions/1749#discussioncomment-6798945
JoanFMhttps://github.com/JoanFM
Return to tophttps://github.com/docarray/docarray/discussions/1749#top
Please reload this pagehttps://github.com/docarray/docarray/discussions/1749
https://github.com/docarray/docarray/discussions/1749
Please reload this pagehttps://github.com/docarray/docarray/discussions/1749
https://github.com/docarray/docarray/discussions/1749
simonschoenhofen https://github.com/simonschoenhofen
Aug 10, 2023 https://github.com/docarray/docarray/discussions/1749#discussion-5509231
Give feedback.https://github.com/docarray/docarray/discussions/1749
JoanFM https://github.com/JoanFM
Aug 23, 2023 https://github.com/docarray/docarray/discussions/1749#discussioncomment-6798945
@simonschoenhofenhttps://github.com/simonschoenhofen
View full answer https://github.com/docarray/docarray/discussions/1749#discussioncomment-6798945
Oldest https://github.com/docarray/docarray/discussions/1749?sort=old
Newest https://github.com/docarray/docarray/discussions/1749?sort=new
Top https://github.com/docarray/docarray/discussions/1749?sort=top
Please reload this pagehttps://github.com/docarray/docarray/discussions/1749
https://github.com/docarray/docarray/discussions/1749
JoanFM https://github.com/JoanFM
Aug 11, 2023 https://github.com/docarray/docarray/discussions/1749#discussioncomment-6696878
Give feedback.https://github.com/docarray/docarray/discussions/1749
https://github.com/simonschoenhofen
Please reload this pagehttps://github.com/docarray/docarray/discussions/1749
https://github.com/docarray/docarray/discussions/1749
simonschoenhofenhttps://github.com/simonschoenhofen
Aug 11, 2023 https://github.com/docarray/docarray/discussions/1749#discussioncomment-6696883
Give feedback.https://github.com/docarray/docarray/discussions/1749
Please reload this pagehttps://github.com/docarray/docarray/discussions/1749
https://github.com/docarray/docarray/discussions/1749
JoanFM https://github.com/JoanFM
Aug 11, 2023 https://github.com/docarray/docarray/discussions/1749#discussioncomment-6696884
Give feedback.https://github.com/docarray/docarray/discussions/1749
Please reload this pagehttps://github.com/docarray/docarray/discussions/1749
https://github.com/docarray/docarray/discussions/1749
JoanFM https://github.com/JoanFM
Aug 23, 2023 https://github.com/docarray/docarray/discussions/1749#discussioncomment-6798945
@simonschoenhofenhttps://github.com/simonschoenhofen
Give feedback.https://github.com/docarray/docarray/discussions/1749
https://github.com/simonschoenhofen
Please reload this pagehttps://github.com/docarray/docarray/discussions/1749
https://github.com/docarray/docarray/discussions/1749
simonschoenhofenhttps://github.com/simonschoenhofen
Aug 23, 2023 https://github.com/docarray/docarray/discussions/1749#discussioncomment-6807082
Give feedback.https://github.com/docarray/docarray/discussions/1749
https://github.com/JoanFM
Please reload this pagehttps://github.com/docarray/docarray/discussions/1749
https://github.com/docarray/docarray/discussions/1749
Please reload this pagehttps://github.com/docarray/docarray/discussions/1749
https://github.com/docarray/docarray/discussions/1749
JoanFMhttps://github.com/JoanFM
Aug 24, 2023 https://github.com/docarray/docarray/discussions/1749#discussioncomment-6809631
#1762https://github.com/docarray/docarray/pull/1762
Give feedback.https://github.com/docarray/docarray/discussions/1749
https://github.com/simonschoenhofen
Please reload this pagehttps://github.com/docarray/docarray/discussions/1749
https://github.com/docarray/docarray/discussions/1749
simonschoenhofenhttps://github.com/simonschoenhofen
Aug 24, 2023 https://github.com/docarray/docarray/discussions/1749#discussioncomment-6817147
Give feedback.https://github.com/docarray/docarray/discussions/1749
JoanFMhttps://github.com/JoanFM
Sign up for freehttps://github.com/join?source=comment-repo
Sign in to commenthttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fdocarray%2Fdocarray%2Fdiscussions%2F1749
🙏 Q&A https://github.com/docarray/docarray/discussions/categories/q-a
https://github.com/simonschoenhofen
https://github.com/JoanFM
https://github.com/docarray/docarray/discussions/1749
https://github.com/settings/replies?return_to=1
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.