René's URL Explorer Experiment


Title: fix: reduce bigquery table modification via DML for to_gbq by chelsea-lin · Pull Request #1737 · googleapis/python-bigquery-dataframes · GitHub

Open Graph Title: fix: reduce bigquery table modification via DML for to_gbq by chelsea-lin · Pull Request #1737 · googleapis/python-bigquery-dataframes

X Title: fix: reduce bigquery table modification via DML for to_gbq by chelsea-lin · Pull Request #1737 · googleapis/python-bigquery-dataframes

Description: To avoid exceeding BigQuery's 1500 daily table modification limit, to_gbq now prioritizes INSERT or MERGE DMLs. This method is used when the target table exists and shares the same schema, supporting both data replacement and appending. If schema discrepancies are found, to_gbq will default back to its original table modification process. Fixes internal issue 409086472 🦕

Open Graph Description: To avoid exceeding BigQuery's 1500 daily table modification limit, to_gbq now prioritizes INSERT or MERGE DMLs. This method is used when the target table exists and shares the same schema, supp...

X Description: To avoid exceeding BigQuery's 1500 daily table modification limit, to_gbq now prioritizes INSERT or MERGE DMLs. This method is used when the target table exists and shares the same schema, ...

Opengraph URL: https://github.com/googleapis/python-bigquery-dataframes/pull/1737

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:20b66987-3039-928b-f1c3-4446b751d74d
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idDBEC:3F6DDE:1D479:2816D:6A571B2A
html-safe-noncebef4dce1d9a965f8a90677970978eb77f1cfbeaf6ad1ea60861f2609a109a845
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJEQkVDOjNGNkRERToxRDQ3OToyODE2RDo2QTU3MUIyQSIsInZpc2l0b3JfaWQiOiI1NTQyMTYyMDk3NTg3NTU5MjEwIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac6d8dcd1dce230c9b0a0b93c90debb470a64b60216ddbb15cf7717c0587609146
hovercard-subject-tagpull_request:2520541829
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
twitter:imagehttps://avatars.githubusercontent.com/u/124939984?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/124939984?s=400&v=4
og:image:altTo avoid exceeding BigQuery's 1500 daily table modification limit, to_gbq now prioritizes INSERT or MERGE DMLs. This method is used when the target table exists and shares the same schema, supp...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None4e7a7296a3830877cf21a6ad2a972c9e618a48915e03966cf0c53eb08e5aad98
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/googleapis/python-bigquery-dataframes git https://github.com/googleapis/python-bigquery-dataframes.git
octolytics-dimension-user_id16785467
octolytics-dimension-user_logingoogleapis
octolytics-dimension-repository_id667598363
octolytics-dimension-repository_nwogoogleapis/python-bigquery-dataframes
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id667598363
octolytics-dimension-repository_network_root_nwogoogleapis/python-bigquery-dataframes
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release2576d1f0198cf1588faf2edf27f1ed120903be10
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgoogleapis%2Fpython-bigquery-dataframes%2Fpull%2F1737%2Ffiles
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/open-source/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/open-source/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgoogleapis%2Fpython-bigquery-dataframes%2Fpull%2F1737%2Ffiles
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=googleapis%2Fpython-bigquery-dataframes
Reloadhttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
Reloadhttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
Reloadhttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
Please reload this pagehttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
googleapis https://github.com/googleapis
python-bigquery-dataframeshttps://github.com/googleapis/python-bigquery-dataframes
Notifications https://github.com/login?return_to=%2Fgoogleapis%2Fpython-bigquery-dataframes
Fork 68 https://github.com/login?return_to=%2Fgoogleapis%2Fpython-bigquery-dataframes
Star 289 https://github.com/login?return_to=%2Fgoogleapis%2Fpython-bigquery-dataframes
Code https://github.com/googleapis/python-bigquery-dataframes
Issues 0 https://github.com/googleapis/python-bigquery-dataframes/issues
Pull requests 0 https://github.com/googleapis/python-bigquery-dataframes/pulls
Actions https://github.com/googleapis/python-bigquery-dataframes/actions
Projects https://github.com/googleapis/python-bigquery-dataframes/projects
Security and quality 0 https://github.com/googleapis/python-bigquery-dataframes/security
Insights https://github.com/googleapis/python-bigquery-dataframes/pulse
Code https://github.com/googleapis/python-bigquery-dataframes
Issues https://github.com/googleapis/python-bigquery-dataframes/issues
Pull requests https://github.com/googleapis/python-bigquery-dataframes/pulls
Actions https://github.com/googleapis/python-bigquery-dataframes/actions
Projects https://github.com/googleapis/python-bigquery-dataframes/projects
Security and quality https://github.com/googleapis/python-bigquery-dataframes/security
Insights https://github.com/googleapis/python-bigquery-dataframes/pulse
chelsea-linhttps://github.com/chelsea-lin
mainhttps://github.com/googleapis/python-bigquery-dataframes/tree/main
main_chelsealin_togbqmergehttps://github.com/googleapis/python-bigquery-dataframes/tree/main_chelsealin_togbqmerge
Conversation 5 https://github.com/googleapis/python-bigquery-dataframes/pull/1737
Commits 2 https://github.com/googleapis/python-bigquery-dataframes/pull/1737/commits
Checks 0 https://github.com/googleapis/python-bigquery-dataframes/pull/1737/checks
Files changed https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
Please reload this pagehttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
fix: reduce bigquery table modification via DML for to_gbq https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#top
Show all changes 2 commits https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
d8ce12f fix: avoid table modification for to_gbq chelsea-lin May 14, 2025 https://github.com/googleapis/python-bigquery-dataframes/pull/1737/commits/d8ce12f0ce850f4495229509abf5d8b1d00c51f3
c1f59b2 Apply suggestions from code review tswast May 16, 2025 https://github.com/googleapis/python-bigquery-dataframes/pull/1737/commits/c1f59b2b42e5acd25392a33f828e205b81eafa2d
Clear filters https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
Please reload this pagehttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
Please reload this pagehttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
sqlglot_ir.py https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-7e28812c1ccb19d8f967666cd8dac8bdc4e4766fd74eadc6ce947068be607e6c
bq_caching_executor.py https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-a086e80c41226d1dbd5ef6380e9df082cb842b26a84185c4955aac95fe013b50
test_dataframe_io.py https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-96483e6374e43da926825afbb4d140a7e74cc2188cf02f0a3205bb1c2d3e99cf
test_dataframe_io.py https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-a9e734b9daf0ec803663c728d9e4e49f59eb5a6eec9716b71f566906e33a3b36
https://github.com/googleapis/python-bigquery-dataframes/blob/main/.github/CODEOWNERS#L9
bigframes/core/compile/sqlglot/sqlglot_ir.pyhttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-7e28812c1ccb19d8f967666cd8dac8bdc4e4766fd74eadc6ce947068be607e6c
View file https://github.com/googleapis/python-bigquery-dataframes/blob/c1f59b2b42e5acd25392a33f828e205b81eafa2d/bigframes/core/compile/sqlglot/sqlglot_ir.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/{{ revealButtonHref }}
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-7e28812c1ccb19d8f967666cd8dac8bdc4e4766fd74eadc6ce947068be607e6c
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-7e28812c1ccb19d8f967666cd8dac8bdc4e4766fd74eadc6ce947068be607e6c
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-7e28812c1ccb19d8f967666cd8dac8bdc4e4766fd74eadc6ce947068be607e6c
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-7e28812c1ccb19d8f967666cd8dac8bdc4e4766fd74eadc6ce947068be607e6c
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-7e28812c1ccb19d8f967666cd8dac8bdc4e4766fd74eadc6ce947068be607e6c
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-7e28812c1ccb19d8f967666cd8dac8bdc4e4766fd74eadc6ce947068be607e6c
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-7e28812c1ccb19d8f967666cd8dac8bdc4e4766fd74eadc6ce947068be607e6c
https://github.com/googleapis/python-bigquery-dataframes/blob/main/.github/CODEOWNERS#L9
bigframes/session/bq_caching_executor.pyhttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-a086e80c41226d1dbd5ef6380e9df082cb842b26a84185c4955aac95fe013b50
View file https://github.com/googleapis/python-bigquery-dataframes/blob/c1f59b2b42e5acd25392a33f828e205b81eafa2d/bigframes/session/bq_caching_executor.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/{{ revealButtonHref }}
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-a086e80c41226d1dbd5ef6380e9df082cb842b26a84185c4955aac95fe013b50
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-a086e80c41226d1dbd5ef6380e9df082cb842b26a84185c4955aac95fe013b50
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-a086e80c41226d1dbd5ef6380e9df082cb842b26a84185c4955aac95fe013b50
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-a086e80c41226d1dbd5ef6380e9df082cb842b26a84185c4955aac95fe013b50
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-a086e80c41226d1dbd5ef6380e9df082cb842b26a84185c4955aac95fe013b50
tswasthttps://github.com/tswast
May 16, 2025https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#r2093320655
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
sycaihttps://github.com/sycai
May 16, 2025https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#r2093450799
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
python-bigquery-dataframes/bigframes/dtypes.pyhttps://github.com/googleapis/python-bigquery-dataframes/blob/d937be04c4b2a0dfe6ef5b2d321cac61e8967fba/bigframes/dtypes.py#L717-L722
d937be0https://github.com/googleapis/python-bigquery-dataframes/commit/d937be04c4b2a0dfe6ef5b2d321cac61e8967fba
Please reload this pagehttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
chelsea-linhttps://github.com/chelsea-lin
May 16, 2025https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#r2093459915
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-a086e80c41226d1dbd5ef6380e9df082cb842b26a84185c4955aac95fe013b50
https://github.com/googleapis/python-bigquery-dataframes/blob/main/.github/CODEOWNERS#L9
tests/system/small/test_dataframe_io.pyhttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-96483e6374e43da926825afbb4d140a7e74cc2188cf02f0a3205bb1c2d3e99cf
View file https://github.com/googleapis/python-bigquery-dataframes/blob/c1f59b2b42e5acd25392a33f828e205b81eafa2d/tests/system/small/test_dataframe_io.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/{{ revealButtonHref }}
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-96483e6374e43da926825afbb4d140a7e74cc2188cf02f0a3205bb1c2d3e99cf
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-96483e6374e43da926825afbb4d140a7e74cc2188cf02f0a3205bb1c2d3e99cf
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-96483e6374e43da926825afbb4d140a7e74cc2188cf02f0a3205bb1c2d3e99cf
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-96483e6374e43da926825afbb4d140a7e74cc2188cf02f0a3205bb1c2d3e99cf
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-96483e6374e43da926825afbb4d140a7e74cc2188cf02f0a3205bb1c2d3e99cf
https://github.com/googleapis/python-bigquery-dataframes/blob/main/.github/CODEOWNERS#L9
tests/unit/test_dataframe_io.pyhttps://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-a9e734b9daf0ec803663c728d9e4e49f59eb5a6eec9716b71f566906e33a3b36
View file https://github.com/googleapis/python-bigquery-dataframes/blob/c1f59b2b42e5acd25392a33f828e205b81eafa2d/tests/unit/test_dataframe_io.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/{{ revealButtonHref }}
https://github.com/googleapis/python-bigquery-dataframes/pull/1737/files#diff-a9e734b9daf0ec803663c728d9e4e49f59eb5a6eec9716b71f566906e33a3b36
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.