René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"High memory usage","articleBody":"@suiahaw commented on [Tue Mar 26 2019](https://github.com/Microsoft/vscode-python/issues/4952)\n\nIssue Type: \u003cb\u003eBug\u003c/b\u003e\r\n\r\n### Some questions about the python plugin encountered when building python library indexes\r\nI strongly hope that **the python plugin does not `read the information into memory in real time `when creating the python library index**, **but `instead saves the index file`** in order to speed up the time and reduce memory overhead. \r\n\r\nThe python library is really too big. Sometimes I have to wait a few minutes for writing a small amount of code.\r\n\r\nExtension version: 2019.3.6139\r\nVS Code version: Code 1.32.3 (a3db5be9b5c6ba46bb7555ec5d60178ecc2eaae4, 2019-03-14T23:43:35.476Z)\r\nOS version: Windows_NT x64 10.0.17763\r\n\r\n\u003cdetails\u003e\r\n\u003csummary\u003eSystem Info\u003c/summary\u003e\r\n\r\n|Item|Value|\r\n|---|---|\r\n|CPUs|Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz (4 x 2712)|\r\n|GPU Status|2d_canvas: enabled\u003cbr\u003echecker_imaging: disabled_off\u003cbr\u003eflash_3d: enabled\u003cbr\u003eflash_stage3d: enabled\u003cbr\u003eflash_stage3d_baseline: enabled\u003cbr\u003egpu_compositing: enabled\u003cbr\u003emultiple_raster_threads: enabled_on\u003cbr\u003enative_gpu_memory_buffers: disabled_software\u003cbr\u003erasterization: enabled\u003cbr\u003esurface_synchronization: enabled_on\u003cbr\u003evideo_decode: enabled\u003cbr\u003ewebgl: enabled\u003cbr\u003ewebgl2: enabled|\r\n|Memory (System)|15.86GB (8.60GB free)|\r\n|Process Argv||\r\n|Screen Reader|no|\r\n|VM|46%|\r\n\r\n\u003c/details\u003e\r\n\u003c!-- generated by issue reporter --\u003e\n\n---\n\n@algo99 commented on [Wed Mar 27 2019](https://github.com/Microsoft/vscode-python/issues/4952#issuecomment-477034361)\n\nI can confirm, on Windows 10.\r\n\r\nAfter update (yesterday) of Python Language Server and/or vscode_python extension VSCode  not more usable. See the disk I/O and memory consumption:\r\n\r\n![vscode_python_language_server](https://user-images.githubusercontent.com/28513219/55060755-7c18ba80-5072-11e9-8b79-5e5566d9dd69.jpg)\r\n\r\nThe extension proceeds after VSCode start:\r\n\u003e Analyzing in background, 6879 items left ...\r\n\r\nand this process does not stop.\r\nI tried several times to restart VSCode, but it does not help.\r\n\r\n\n\n---\n\n@algo99 commented on [Wed Mar 27 2019](https://github.com/Microsoft/vscode-python/issues/4952#issuecomment-477038799)\n\nJust noted in Python  output pane:\r\n```log\r\n...\r\n[Info  - 09:17:10] Microsoft Python Language Server version 0.2.31.0\r\n[Info  - 09:17:10] Initializing for c:\\3rd\\WinPython\\python-3.7.2.amd64\\python.exe\r\nTraceback (most recent call last):\r\n  File \"C:\\Users\\zkr\\.vscode\\extensions\\ms-python.python-2019.3.6139\\languageServer.0.2.31\\scrape_module.py\", line 1497, in \u003cmodule\u003e\r\n    state.collect_second_level_members()\r\n  File \"C:\\Users\\zkr\\.vscode\\extensions\\ms-python.python-2019.3.6139\\languageServer.0.2.31\\scrape_module.py\", line 944, in collect_second_level_members\r\n    self._collect_members(mi.value, mi.members, substitutes, mi)\r\n  File \"C:\\Users\\zkr\\.vscode\\extensions\\ms-python.python-2019.3.6139\\languageServer.0.2.31\\scrape_module.py\", line 958, in _collect_members\r\n    raise RuntimeError(\"failed to import module\")\r\nRuntimeError: failed to import module\r\nTraceback (most recent call last):\r\n  File \"C:\\Users\\zkr\\.vscode\\extensions\\ms-python.python-2019.3.6139\\languageServer.0.2.31\\scrape_module.py\", line 1497, in \u003cmodule\u003e\r\n    state.collect_second_level_members()\r\n  File \"C:\\Users\\zkr\\.vscode\\extensions\\ms-python.python-2019.3.6139\\languageServer.0.2.31\\scrape_module.py\", line 944, in collect_second_level_members\r\n    self._collect_members(mi.value, mi.members, substitutes, mi)\r\n  File \"C:\\Users\\zkr\\.vscode\\extensions\\ms-python.python-2019.3.6139\\languageServer.0.2.31\\scrape_module.py\", line 958, in _collect_members\r\n    raise RuntimeError(\"failed to import module\")\r\nRuntimeError: failed to import module\r\nTraceback (most recent call last):\r\n  File \"C:\\Users\\zkr\\.vscode\\extensions\\ms-python.python-2019.3.6139\\languageServer.0.2.31\\scrape_module.py\", line 1489, in \u003cmodule\u003e\r\n    state.initial_import(sys.argv[2])\r\n  File \"C:\\Users\\zkr\\.vscode\\extensions\\ms-python.python-2019.3.6139\\languageServer.0.2.31\\scrape_module.py\", line 872, in initial_import\r\n    mod = __import__(self.module_name)\r\n  File \"c:\\3rd\\winpython\\python-3.7.2.amd64\\lib\\site-packages\\cvxopt\\__init__.py\", line 50, in \u003cmodule\u003e\r\n    import cvxopt.base\r\nImportError: DLL load failed: Das angegebene Modul wurde nicht gefunden.\r\n```\r\n\n\n---\n\n@dilzeem commented on [Wed Mar 27 2019](https://github.com/Microsoft/vscode-python/issues/4952#issuecomment-477094651)\n\nI am also getting the same issue as well on Windows 10.\r\n\r\nIt only happens once I start debugging some code. \r\nIt renders VScode unusable.\n\n---\n\n@suiahaw commented on [Wed Mar 27 2019](https://github.com/Microsoft/vscode-python/issues/4952#issuecomment-477104176)\n\nIt only happens when the python plugin loads the python library, which requires a lot of CPU and memory. And these information that is loaded into memory is estimated to be used for IntelliCode.\n\n---\n\n@ray306 commented on [Wed Mar 27 2019](https://github.com/Microsoft/vscode-python/issues/4952#issuecomment-477128112)\n\nThe same problem happens today. I think it's a bug of new Python plugin just released yesterday (March 26).\n\n---\n\n@dilzeem commented on [Wed Mar 27 2019](https://github.com/Microsoft/vscode-python/issues/4952#issuecomment-477183669)\n\nPossibly a duplicate of of this in the python language server:\r\n\r\nhttps://github.com/Microsoft/python-language-server/issues/450\n\n---\n\n@suiahaw commented on [Wed Mar 27 2019](https://github.com/Microsoft/vscode-python/issues/4952#issuecomment-477190477)\n\n\u003e Possibly a duplicate of of this in the python language server:\r\n\u003e \r\n\u003e [Microsoft/python-language-server#450](https://github.com/Microsoft/python-language-server/issues/450)\r\n\r\nI also think that the issues area of the python plugin has a large part of similar content related to such a bug. It seems that this bug is very disturbing programming and needs to be solved urgently. ;-)\n\n","author":{"url":"https://github.com/gramster","@type":"Person","name":"gramster"},"datePublished":"2019-03-27T16:07:26.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":100},"url":"https://github.com/832/python-language-server/issues/832"}