René's URL Explorer Experiment


Title: Disable Spark Catalog caching for integration tests by kevinjqliu · Pull Request #501 · apache/iceberg-python · GitHub

Open Graph Title: Disable Spark Catalog caching for integration tests by kevinjqliu · Pull Request #501 · apache/iceberg-python

X Title: Disable Spark Catalog caching for integration tests by kevinjqliu · Pull Request #501 · apache/iceberg-python

Description: PyIceberg. Contribute to apache/iceberg-python development by creating an account on GitHub.

Open Graph Description: Fix #482 While working on #444, I couldn't get integration tests working since using spark.sql to count the number of data files returns the wrong result. This becomes more bizarre when Python&...

X Description: Fix #482 While working on #444, I couldn't get integration tests working since using spark.sql to count the number of data files returns the wrong result. This becomes more bizarre when Pyt...

Opengraph URL: https://github.com/apache/iceberg-python/pull/501

X: @github

direct link

Domain: github.com

route-pattern/_view_fragments/voltron/pull_requests/show/:user_id/:repository/:id/pull_request_layout(.:format)
route-controllervoltron_pull_requests_fragments
route-actionpull_request_layout
fetch-noncev2:6cbf49eb-3aed-cb1e-ebea-1c79a156d95d
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idD412:147E0:D95E0B:117D5E7:699243F4
html-safe-noncee1ce5a528efb7cdf268b313a4fd65b03ef4650eb4a134655fda64b21c0580fce
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJENDEyOjE0N0UwOkQ5NUUwQjoxMTdENUU3OjY5OTI0M0Y0IiwidmlzaXRvcl9pZCI6IjM2NTU4NDcxMzAxNDc0NzIzNzIiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmaca3103bf5a84fa1eb9621ff56f5674a1ab791149796c704ff4c67a39eddbcc260
hovercard-subject-tagpull_request:1759847109
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/pull_requests_fragments/pull_request_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/voltron/pull_requests/show/apache/iceberg-python/501/pull_request_layout
twitter:imagehttps://opengraph.githubassets.com/f8481418c0ba0b23f5febc7bca482fc8db89ab80a182daf822a5b642e7554e99/apache/iceberg-python/pull/501
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/f8481418c0ba0b23f5febc7bca482fc8db89ab80a182daf822a5b642e7554e99/apache/iceberg-python/pull/501
og:image:altFix #482 While working on #444, I couldn't get integration tests working since using spark.sql to count the number of data files returns the wrong result. This becomes more bizarre when Python&...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamekevinjqliu
hostnamegithub.com
expected-hostnamegithub.com
None42c603b9d642c4a9065a51770f75e5e27132fef0e858607f5c9cb7e422831a7b
turbo-cache-controlno-cache
go-importgithub.com/apache/iceberg-python git https://github.com/apache/iceberg-python.git
octolytics-dimension-user_id47359
octolytics-dimension-user_loginapache
octolytics-dimension-repository_id677260606
octolytics-dimension-repository_nwoapache/iceberg-python
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id677260606
octolytics-dimension-repository_network_root_nwoapache/iceberg-python
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release848bc6032dcc93a9a7301dcc3f379a72ba13b96e
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/apache/iceberg-python/pull/501#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapache%2Ficeberg-python%2Fpull%2F501
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapache%2Ficeberg-python%2Fpull%2F501
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fpull_requests_fragments%2Fpull_request_layout&source=header-repo&source_repo=apache%2Ficeberg-python
Reloadhttps://github.com/apache/iceberg-python/pull/501
Reloadhttps://github.com/apache/iceberg-python/pull/501
Reloadhttps://github.com/apache/iceberg-python/pull/501
apache https://github.com/apache
iceberg-pythonhttps://github.com/apache/iceberg-python
Notifications https://github.com/login?return_to=%2Fapache%2Ficeberg-python
Fork 440 https://github.com/login?return_to=%2Fapache%2Ficeberg-python
Star 1k https://github.com/login?return_to=%2Fapache%2Ficeberg-python
Code https://github.com/apache/iceberg-python
Issues 115 https://github.com/apache/iceberg-python/issues
Pull requests 119 https://github.com/apache/iceberg-python/pulls
Actions https://github.com/apache/iceberg-python/actions
Projects 0 https://github.com/apache/iceberg-python/projects
Security 0 https://github.com/apache/iceberg-python/security
Insights https://github.com/apache/iceberg-python/pulse
Code https://github.com/apache/iceberg-python
Issues https://github.com/apache/iceberg-python/issues
Pull requests https://github.com/apache/iceberg-python/pulls
Actions https://github.com/apache/iceberg-python/actions
Projects https://github.com/apache/iceberg-python/projects
Security https://github.com/apache/iceberg-python/security
Insights https://github.com/apache/iceberg-python/pulse
amogh-jahagirdarhttps://github.com/amogh-jahagirdar
apache:mainhttps://github.com/apache/iceberg-python/tree/main
kevinjqliu:kevinjqliu/fix-multiple-spark-sql-querieshttps://github.com/kevinjqliu/iceberg-python/tree/kevinjqliu/fix-multiple-spark-sql-queries
Conversationhttps://github.com/apache/iceberg-python/pull/501
Commits4 (4)https://github.com/apache/iceberg-python/pull/501/commits
Checkshttps://github.com/apache/iceberg-python/pull/501/checks
Files changedhttps://github.com/apache/iceberg-python/pull/501/files
Disable Spark Catalog caching for integration testshttps://github.com/apache/iceberg-python/pull/501#top
amogh-jahagirdarhttps://github.com/amogh-jahagirdar
apache:mainhttps://github.com/apache/iceberg-python/tree/main
kevinjqliu:kevinjqliu/fix-multiple-spark-sql-querieshttps://github.com/kevinjqliu/iceberg-python/tree/kevinjqliu/fix-multiple-spark-sql-queries
https://github.com/kevinjqliu
kevinjqliuhttps://github.com/kevinjqliu
Mar 6, 2024https://github.com/apache/iceberg-python/pull/501#issue-2172536212
#482https://github.com/apache/iceberg-python/issues/482
#444https://github.com/apache/iceberg-python/pull/444
https://iceberg.apache.org/docs/latest/spark-configuration/#catalog-configurationhttps://iceberg.apache.org/docs/latest/spark-configuration/#catalog-configuration
Please reload this pagehttps://github.com/apache/iceberg-python/pull/501
kevinjqliuhttps://github.com/kevinjqliu
March 6, 2024 14:07https://github.com/apache/iceberg-python/pull/501#commits-pushed-c300fee
https://github.com/kevinjqliu
add testhttps://github.com/apache/iceberg-python/pull/501/commits/c300fee151a6f8d89c5c673e652072987d1fde74
c300feehttps://github.com/apache/iceberg-python/pull/501/commits/c300fee151a6f8d89c5c673e652072987d1fde74
https://github.com/kevinjqliu
dont cache iceberg metadata in testshttps://github.com/apache/iceberg-python/pull/501/commits/22e8a2169de4eaa4f6465fb4e4035a1434dcf8c9
22e8a21https://github.com/apache/iceberg-python/pull/501/commits/22e8a2169de4eaa4f6465fb4e4035a1434dcf8c9
https://github.com/kevinjqliu
kevinjqliuhttps://github.com/kevinjqliu
Mar 6, 2024https://github.com/apache/iceberg-python/pull/501#event-12034170757
https://github.com/kevinjqliu
kevinjqliuhttps://github.com/kevinjqliu
Mar 6, 2024 https://github.com/apache/iceberg-python/pull/501#ref-pullrequest-2142941035
Bin-pack Writes Operation into multiple parquet files, and parallelize writing WriteTasks #444 https://github.com/apache/iceberg-python/pull/444
https://github.com/amogh-jahagirdar
amogh-jahagirdarhttps://github.com/amogh-jahagirdar
Mar 6, 2024https://github.com/apache/iceberg-python/pull/501#event-12034826522
https://github.com/amogh-jahagirdar
amogh-jahagirdarhttps://github.com/amogh-jahagirdar
Mar 6, 2024https://github.com/apache/iceberg-python/pull/501#issuecomment-1982063186
@kevinjqliuhttps://github.com/kevinjqliu
Please reload this pagehttps://github.com/apache/iceberg-python/pull/501
https://github.com/amogh-jahagirdar
amogh-jahagirdarhttps://github.com/amogh-jahagirdar
Mar 6, 2024 https://github.com/apache/iceberg-python/pull/501#pullrequestreview-1921053550
View reviewed changes https://github.com/apache/iceberg-python/pull/501/files/22e8a2169de4eaa4f6465fb4e4035a1434dcf8c9
https://github.com/amogh-jahagirdar
amogh-jahagirdarhttps://github.com/amogh-jahagirdar
Mar 6, 2024 https://github.com/apache/iceberg-python/pull/501#pullrequestreview-1921056709
View reviewed changes https://github.com/apache/iceberg-python/pull/501/files/22e8a2169de4eaa4f6465fb4e4035a1434dcf8c9
tests/integration/test_writes.pyhttps://github.com/apache/iceberg-python/pull/501/files/22e8a2169de4eaa4f6465fb4e4035a1434dcf8c9#diff-ae89704e133e5eb800112d7a84557f2976819b2c5d989a62af97bf922865631b
amogh-jahagirdarhttps://github.com/amogh-jahagirdar
Mar 6, 2024https://github.com/apache/iceberg-python/pull/501#discussion_r1515300598
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/apache/iceberg-python/pull/501
kevinjqliuhttps://github.com/kevinjqliu
Mar 6, 2024https://github.com/apache/iceberg-python/pull/501#discussion_r1515301588
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/apache/iceberg-python/pull/501
kevinjqliuhttps://github.com/kevinjqliu
March 6, 2024 15:58https://github.com/apache/iceberg-python/pull/501#commits-pushed-cd5dc3f
https://github.com/kevinjqliu
renamehttps://github.com/apache/iceberg-python/pull/501/commits/cd5dc3f0e32b5dced5e833f1680a2ce0c397f7de
cd5dc3fhttps://github.com/apache/iceberg-python/pull/501/commits/cd5dc3f0e32b5dced5e833f1680a2ce0c397f7de
https://github.com/kevinjqliu
make linthttps://github.com/apache/iceberg-python/pull/501/commits/e36186ee44fdcabb0a0c5be3f79f95e950506675
e36186ehttps://github.com/apache/iceberg-python/pull/501/commits/e36186ee44fdcabb0a0c5be3f79f95e950506675
https://github.com/sungwy
sungwyhttps://github.com/sungwy
Mar 7, 2024https://github.com/apache/iceberg-python/pull/501#issuecomment-1982096927
@kevinjqliuhttps://github.com/kevinjqliu
Please reload this pagehttps://github.com/apache/iceberg-python/pull/501
https://github.com/amogh-jahagirdar
amogh-jahagirdarhttps://github.com/amogh-jahagirdar
Mar 7, 2024https://github.com/apache/iceberg-python/pull/501#issuecomment-1982123757
@kevinjqliuhttps://github.com/kevinjqliu
Please reload this pagehttps://github.com/apache/iceberg-python/pull/501
https://github.com/amogh-jahagirdar
amogh-jahagirdarhttps://github.com/amogh-jahagirdar
e56326dhttps://github.com/apache/iceberg-python/commit/e56326d4a3ba74eb279bf57202a9121c4f2c731d
Mar 7, 2024https://github.com/apache/iceberg-python/pull/501#event-12035088207
https://github.com/kevinjqliu
kevinjqliuhttps://github.com/kevinjqliu
March 7, 2024 01:10https://github.com/apache/iceberg-python/pull/501#event-12035287436
https://github.co/hiddenchars
https://github.com/apache/iceberg-python/pull/{{ revealButtonHref }}
Sign up for freehttps://github.com/join?source=comment-repo
Sign in to commenthttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapache%2Ficeberg-python%2Fpull%2F501
https://github.com/amogh-jahagirdar
amogh-jahagirdar https://github.com/amogh-jahagirdar
https://github.com/apache/iceberg-python/pull/501/files/22e8a2169de4eaa4f6465fb4e4035a1434dcf8c9
Spark <> Iceberg bug integration test https://github.com/apache/iceberg-python/issues/482
Please reload this pagehttps://github.com/apache/iceberg-python/pull/501
https://github.com/kevinjqliu
https://github.com/amogh-jahagirdar
https://github.com/sungwy
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.