Title: Expand use of sql parsing string expressions in DataFrame · Issue #1278 · apache/datafusion-python · GitHub
Open Graph Title: Expand use of sql parsing string expressions in DataFrame · Issue #1278 · apache/datafusion-python
X Title: Expand use of sql parsing string expressions in DataFrame · Issue #1278 · apache/datafusion-python
Description: Is your feature request related to a problem or challenge? Please describe what you are trying to do. This is a follow on to #1273 There are a number of places where it would be convenient to pass SQL strings as expressions. For example,...
Open Graph Description: Is your feature request related to a problem or challenge? Please describe what you are trying to do. This is a follow on to #1273 There are a number of places where it would be convenient to pass ...
X Description: Is your feature request related to a problem or challenge? Please describe what you are trying to do. This is a follow on to #1273 There are a number of places where it would be convenient to pass ...
Opengraph URL: https://github.com/apache/datafusion-python/issues/1278
X: @github
Domain: patch-diff.githubusercontent.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Expand use of sql parsing string expressions in DataFrame","articleBody":"**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**\n\nThis is a follow on to https://github.com/apache/datafusion-python/issues/1273\n\nThere are a number of places where it would be convenient to pass SQL strings as expressions. For example, it would be nice to do\n\n```\ndf.select(\n \"a\",\n \"a - b\",\n col(\"c\"),\n)\n```\n\nThis should intuitively know that we are getting column `a`, followed by `col(\"a\") - col(\"b\")` followed by column 'c'.\n\n**Describe the solution you'd like**\n\nUsing the sql parsing on the DataFrame make the following functions handle SQL strings. We must be *very* careful that we do not break things like cases where users have a column name that is not SQL parseable.\n\n**Describe alternatives you've considered**\n\nStatus quo\n\n**Additional context**\n\nDataFrame functions to update:\n\n- [ ] select\n- [ ] remove `select_exprs`\n- [x] `with_column` #1284 \n- [ ] `with_columns` #1286 \n- [ ] aggregate\n- [x] `repartition_by_hash` #1285\n\nWe do **not** want to apply this treatment to joins because there is no easy way to know *which* DataFrame to perform the SQL parsing against.\n","author":{"url":"https://github.com/timsaucer","@type":"Person","name":"timsaucer"},"datePublished":"2025-10-15T13:50:30.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":11},"url":"https://github.com/1278/datafusion-python/issues/1278"}
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:a13dfec4-4a5d-8287-de5a-ba892750a31d |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | A600:267E4D:FAC10CA:14883F34:69772DFD |
| html-safe-nonce | 8f81f6145cd06cde4598d151a1ecb164f1a2fe9e30fdd44ec5bfb2cbc94b098d |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBNjAwOjI2N0U0RDpGQUMxMENBOjE0ODgzRjM0OjY5NzcyREZEIiwidmlzaXRvcl9pZCI6IjMxNzM4NzcxMjU5Nzc5ODM5NyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | c8ed563cd4fdf4359cd87f1608df24763c3973ce0a7d4c6bd12a4306e13ace1b |
| hovercard-subject-tag | issue:3518148395 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/apache/datafusion-python/1278/issue_layout |
| twitter:image | https://opengraph.githubassets.com/4893ed741d52c4fc84a1252a8fe2374070273a5fcd274288532e2ec8c91f0c32/apache/datafusion-python/issues/1278 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/4893ed741d52c4fc84a1252a8fe2374070273a5fcd274288532e2ec8c91f0c32/apache/datafusion-python/issues/1278 |
| og:image:alt | Is your feature request related to a problem or challenge? Please describe what you are trying to do. This is a follow on to #1273 There are a number of places where it would be convenient to pass ... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | timsaucer |
| hostname | github.com |
| expected-hostname | github.com |
| None | 01d198479908d09a841b2febe8eb105a81af2af7d81830960fe0971e1f4adc09 |
| turbo-cache-control | no-preview |
| go-import | github.com/apache/datafusion-python git https://github.com/apache/datafusion-python.git |
| octolytics-dimension-user_id | 47359 |
| octolytics-dimension-user_login | apache |
| octolytics-dimension-repository_id | 515951203 |
| octolytics-dimension-repository_nwo | apache/datafusion-python |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 515951203 |
| octolytics-dimension-repository_network_root_nwo | apache/datafusion-python |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | f752335dbbea672610081196a1998e39aec5e14b |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width