Title: [Performance] Data viewer can't handle large DFs · Issue #3434 · microsoft/vscode-jupyter · GitHub
Open Graph Title: [Performance] Data viewer can't handle large DFs · Issue #3434 · microsoft/vscode-jupyter
X Title: [Performance] Data viewer can't handle large DFs · Issue #3434 · microsoft/vscode-jupyter
Description: Environment data VS Code version: 1.33.1 Extension version (available under the Extensions sidebar): 2019.4.1 OS and version: Windows 7 Python version (& distribution if applicable, e.g. Anaconda): Anaconda distribution, Python 3.6.2 Typ...
Open Graph Description: Environment data VS Code version: 1.33.1 Extension version (available under the Extensions sidebar): 2019.4.1 OS and version: Windows 7 Python version (& distribution if applicable, e.g. Anaconda):...
X Description: Environment data VS Code version: 1.33.1 Extension version (available under the Extensions sidebar): 2019.4.1 OS and version: Windows 7 Python version (& distribution if applicable, e.g. Anacon...
Opengraph URL: https://github.com/microsoft/vscode-jupyter/issues/3434
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"[Performance] Data viewer can't handle large DFs","articleBody":"\u003c!-- \r\nDo you have a question instead of a bug report or enhancement request? Please ask it on https://stackoverflow.com/questions/tagged/visual-studio-code+python. \r\n\r\nUnable to install a linter or formatter? 'No installers available'? \r\nWindows - https://stackoverflow.com/questions/4750806/how-do-i-install-pip-on-windows\r\nLinux - https://www.cyberciti.biz/faq/debian-ubuntu-centos-rhel-linux-install-pipclient/ , https://www.tecmint.com/install-pip-in-linux/\r\n\r\nPython configuration issues? Please check https://code.visualstudio.com/docs/python/python-tutorial#_prerequisites\r\n\r\nOtherwise **please** fill in the requested details below. \"XXX\" markers should not be present in the final bug report.\r\n\r\nIf you think a GIF of what is happening would be helpful, consider tools like https://www.cockos.com/licecap/, https://github.com/phw/peek or https://www.screentogif.com/ .\r\n-->\r\n\r\n## Environment data\r\n\r\n- VS Code version: 1.33.1\r\n- Extension version (available under the Extensions sidebar): 2019.4.1\r\n- OS and version: Windows 7\r\n- Python version (& distribution if applicable, e.g. Anaconda): Anaconda distribution, Python 3.6.2\r\n- Type of virtual environment used (N/A | venv | virtualenv | conda | ...): conda \r\n- Relevant/affected Python packages and their versions: None\r\n\r\n## Expected behaviour\r\n\r\nView large DataFrames (>1000 columns, >1000 rows) in under 1 minute\r\n\r\n## Actual behaviour\r\n\r\nWhen opening large DFs (current is 709x3201) the Data Viewer stops at showing the structure with all values at 'loading ...' (current runtime 20 minutes).\r\n\r\n## Steps to reproduce:\r\n1. Create synthetic data frame: 3000 series of 700 floats each\r\n2. In variable explorer click view in data viewer\r\n\r\n## Logs\r\nOutput for `Python` in the `Output` panel (`View`→`Output`, change the drop-down the upper-right of the `Output` panel to `Python`)\r\n\r\n```\r\nNone\r\n``` \r\n\r\nOutput from `Console` under the `Developer Tools` panel (toggle Developer Tools on under `Help`; turn on source maps to make any tracebacks be useful by running `Enable source map support for extension debugging`)\r\n\r\n```\r\nCan't find relevant logs. Is 'View in Data Viewer' supposed to show up in the logs at some point ?\r\n```\r\n\r\nI was really looking forward to these features, so thanks for getting them in there! However, when dealing with quantitative finance problems we often have very large dataframes, and it would be nice to be able to use the data viewer to explore them.\r\n\r\nBest regards, \r\n\r\nFrancisco","author":{"url":"https://github.com/FranciscoRZ","@type":"Person","name":"FranciscoRZ"},"datePublished":"2019-04-25T08:45:07Z","url":"https://github.com/microsoft/vscode-jupyter/issues/3434"}
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:0731ba8c-b212-f213-a62a-e0bed9b3dba0 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | B2EA:38CE1B:7164F5:9A85E5:6AFE694E |
| html-safe-nonce | d173af868b7d5ab88d80141575dd2dbefe7518fd532331ebfd7dc98b884387fc |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCMkVBOjM4Q0UxQjo3MTY0RjU6OUE4NUU1OjZBRkU2OTRFIiwidmlzaXRvcl9pZCI6IjgzNjkyODM0MzIxMDE4NjU4MDUiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | cf709e43feff29d6ebbe97cb92268a2daf773fa66b2e7b2c2287499cff78bbb3 |
| hovercard-subject-tag | issue:742879992 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/microsoft/vscode-jupyter/3434/issue_layout |
| twitter:image | https://opengraph.githubassets.com/b6554b853cfc6a8ae3a842ce86eec21030ff0ae628dffa4307983a0d52f72302/microsoft/vscode-jupyter/issues/3434 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/b6554b853cfc6a8ae3a842ce86eec21030ff0ae628dffa4307983a0d52f72302/microsoft/vscode-jupyter/issues/3434 |
| og:image:alt | Environment data VS Code version: 1.33.1 Extension version (available under the Extensions sidebar): 2019.4.1 OS and version: Windows 7 Python version (& distribution if applicable, e.g. Anaconda):... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | FranciscoRZ |
| hostname | github.com |
| expected-hostname | github.com |
| None | b3c0f155eafc27e60db6e254d1ffff0e072e9ab3b4018a5ee518797c19d89f86 |
| turbo-cache-control | no-preview |
| go-import | github.com/microsoft/vscode-jupyter git https://github.com/microsoft/vscode-jupyter.git |
| octolytics-dimension-user_id | 6154722 |
| octolytics-dimension-user_login | microsoft |
| octolytics-dimension-repository_id | 294546561 |
| octolytics-dimension-repository_nwo | microsoft/vscode-jupyter |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 294546561 |
| octolytics-dimension-repository_network_root_nwo | microsoft/vscode-jupyter |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 4a10310af51a1bfffbedc4fd81cb582acf0cb0ff |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | issues |
Links:
Viewport: width=device-width