Title: BigQuery: complex repeated schema fields are slow · Issue #6 · googleapis/python-bigquery · GitHub
Open Graph Title: BigQuery: complex repeated schema fields are slow · Issue #6 · googleapis/python-bigquery
X Title: BigQuery: complex repeated schema fields are slow · Issue #6 · googleapis/python-bigquery
Description: When converting rows to JSON, repeated schema fields are deepcopied causing noticeable slowdowns in complex schemas. Since conversion is performed recursively, complex schemas containing multiple levels of repeated fields (e.g. repeated ...
Open Graph Description: When converting rows to JSON, repeated schema fields are deepcopied causing noticeable slowdowns in complex schemas. Since conversion is performed recursively, complex schemas containing multiple l...
X Description: When converting rows to JSON, repeated schema fields are deepcopied causing noticeable slowdowns in complex schemas. Since conversion is performed recursively, complex schemas containing multiple l...
Opengraph URL: https://github.com/googleapis/python-bigquery/issues/6
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"BigQuery: complex repeated schema fields are slow","articleBody":"When converting rows to JSON, repeated schema fields are deepcopied causing noticeable slowdowns in complex schemas.\r\nSince conversion is performed recursively, complex schemas containing multiple levels of repeated fields (e.g. repeated list of structs each containing multiple fields of repeated structs) are copied multiple times when converting a single row - causing even further slowdown due to redundant copying. \r\n\r\nI've created a proposal for removing the deepcopy operation. Will reference relevant PR.","author":{"url":"https://github.com/grooveygr","@type":"Person","name":"grooveygr"},"datePublished":"2020-01-15T07:06:40.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/6/python-bigquery/issues/6"}| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:c1e7ab73-551c-afbe-7eb1-633a0f56c011 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | 891A:16C3D3:240E84C:31D9BA3:6A4F429E |
| html-safe-nonce | ac3203b9eae0d59f1e0686e2325866f2f3689bbdc3415a7ccf71962cbaa8f5d9 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4OTFBOjE2QzNEMzoyNDBFODRDOjMxRDlCQTM6NkE0RjQyOUUiLCJ2aXNpdG9yX2lkIjoiNzk0ODUxODE2MDU0OTc1NzU5OCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 2cf70e925a64d779780fdcc467f340da71cf0fecefbb695bd78db2da2d159e9a |
| hovercard-subject-tag | issue:559701702 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/googleapis/python-bigquery/6/issue_layout |
| twitter:image | https://opengraph.githubassets.com/f1b575fe45d63211f7a1b54066c3e19b816fd04f0b49219004dc1b65afe9b3fb/googleapis/python-bigquery/issues/6 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/f1b575fe45d63211f7a1b54066c3e19b816fd04f0b49219004dc1b65afe9b3fb/googleapis/python-bigquery/issues/6 |
| og:image:alt | When converting rows to JSON, repeated schema fields are deepcopied causing noticeable slowdowns in complex schemas. Since conversion is performed recursively, complex schemas containing multiple l... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | grooveygr |
| hostname | github.com |
| expected-hostname | github.com |
| None | b92d11c0aa4a77d54ef4af1078b6a15fb5a70a215b30c4ecf28889d5a8e656d9 |
| turbo-cache-control | no-preview |
| go-import | github.com/googleapis/python-bigquery git https://github.com/googleapis/python-bigquery.git |
| octolytics-dimension-user_id | 16785467 |
| octolytics-dimension-user_login | googleapis |
| octolytics-dimension-repository_id | 226992475 |
| octolytics-dimension-repository_nwo | googleapis/python-bigquery |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 226992475 |
| octolytics-dimension-repository_network_root_nwo | googleapis/python-bigquery |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 4b249b445842943ed31549e027f57a8ade9881ed |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width