René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"[Bug]: Creating sub-plots is much slower than Plotly","articleBody":"### Bug summary\n\nCreating sub-plots in Matplotlib is typically 4-12x slower than Plotly. This is not a bug per se, but a serious performance issue for time-critical applications such as interactive web-apps. There are several closed GitHub issues about the slowness of creating sub-plots that go back 6-7 years, but it's still a problem.\n\n### Code for reproduction\n\n```python\n%matplotlib inline\r\nfrom matplotlib.figure import Figure\r\nfrom plotly.subplots import make_subplots\r\nimport numpy as np\r\nimport pandas as pd\r\nimport timeit\r\n\r\nrng = np.random.default_rng()\r\n\r\nresults = []\r\n\r\nfor i in range(30):\r\n    # Random number of rows and columns.\r\n    rows, cols = rng.integers(low=1, high=20, size=2)\r\n    \r\n    # Plotly won't accept Numpy ints.\r\n    rows = int(rows)\r\n    cols = int(cols)\r\n\r\n    # Total number of sub-plots.\r\n    total = rows*cols\r\n\r\n    # Timer.\r\n    t1 = timeit.default_timer()\r\n\r\n    # Matplotlib.\r\n    fig_matplotlib = Figure()\r\n    axs_matplotlib = fig_matplotlib.subplots(nrows=rows, ncols=cols)\r\n\r\n    # Timer.\r\n    t2 = timeit.default_timer()\r\n\r\n    # Plotly.\r\n    fig_plotly = make_subplots(rows=rows, cols=cols)\r\n\r\n    # Timer.\r\n    t3 = timeit.default_timer()\r\n    \r\n    # Time-usage.\r\n    t_matplotlib = t2 - t1\r\n    t_plotly = t3 - t2\r\n    \r\n    # Relative time-usage.\r\n    t_relative = t_matplotlib / t_plotly\r\n\r\n    # Save results.\r\n    results.append(dict(rows=rows, cols=cols, total=total,\r\n                        t_matplotlib=t_matplotlib, t_plotly=t_plotly,\r\n                        t_relative=t_relative))\r\n\r\n    # Show status.    \r\n    print(f'{rows}\\t{cols}\\t{total}\\t{t_relative:.3f}')\r\n\r\n# Convert results to Pandas DataFrame.\r\ndf_results = pd.DataFrame(results)\r\n\r\n# Plot relative time-usage.\r\ndf_results.plot(kind='scatter', x='total', y='t_relative', grid=True);\r\n\r\n# Plot individual time-usage.\r\ndf2 = df_results.set_index('total').sort_index()\r\ndf2.plot(y=['t_matplotlib', 't_plotly'], grid=True, ylabel='seconds');\n```\n\n\n### Actual outcome\n\nIn my actual application with 3 columns and 10 rows, the time-usage for Matplotlib is consistently around 1.8 seconds, but for some reason it is only around 0.5 seconds in these tests.\r\n\r\nThis plot shows the individual time-usage for Matplotlib and Plotly, where the x-axis is the total number of sub-plots (cols * rows):\r\n\r\n![image](https://github.com/matplotlib/matplotlib/assets/13588114/17ea6afb-97f5-49e7-98f4-d3eeed50ba99)\r\n\r\nNote the jagged lines for the Matplotlib time-usage. We could average several runs to make the lines smoother, but the trend is clear, and the jaggedness is actually quite strange, that the time changes so much from run to run.\r\n\r\nThis plot shows the relative time-usage (Matplotlib time / Plotly time):\r\n\r\n![image](https://github.com/matplotlib/matplotlib/assets/13588114/9395e127-2361-42dc-9f1b-24c4cd6086f6)\r\n\n\n### Expected outcome\n\nI would like it to run [like this](https://www.youtube.com/watch?v=0hFzpF_gGys) - minus the crashes, please.\r\n\n\n### Additional information\n\nThanks again for making Matplotlib! I don't want to sound ingrateful or too demanding, as this is my second GitHub issue in a few days relating to the performance of using many sub-plots in Matplotlib. But these issues are major bottle-necks in my application that take around 90% of the runtime. I also wonder if perhaps the issues are related. (See https://github.com/matplotlib/matplotlib/issues/26150)\r\n\r\nIs there a technical reason that Plotly is so much faster than Matplotlib when it comes to having sub-plots?\r\n\r\nI imagine that Matplotlib has been made by many different people over a long period of time, so perhaps it is getting hard to understand what the code is doing sometimes?\r\n\r\nPlotly runs very fast and is easy to use, but I have already made everything in Matplotlib, and I'm not even sure Plotly has all the features I need to customize the plots. So I'm hoping it would be possible to improve the speed of Matplotlib when using sub-plots.\r\n\r\nThanks!\r\n\n\n### Operating system\n\nKubuntu 22\n\n### Matplotlib Version\n\n3.7.1\n\n### Matplotlib Backend\n\nmodule://matplotlib_inline.backend_inline\n\n### Python version\n\n3.9.12\n\n### Jupyter version\n\n6.4.12 (through VSCode)\n\n### Installation\n\npip","author":{"url":"https://github.com/Hvass-Labs","@type":"Person","name":"Hvass-Labs"},"datePublished":"2023-06-21T12:14:40.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":14},"url":"https://github.com/26162/matplotlib/issues/26162"}