René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"tex cache lockfile retries should be configurable","articleBody":"I am doing data processing and generating many plots with many scripts running in parallel.  The scripts use texmanager, and many fail when drawing to `png` due to below.  My plots are large, with many subplots, and the filesystem I'm writing to is slow.  Therefore, the hardcoded limit of 50 tries with 0.1 second waits is not appropriate.\r\n\r\nThose hardcoded values should be configurable so that the user can change them if needed.\r\n\r\n```\r\nTraceback (most recent call last):\r\n  File \"/home/users/gholl/venv/stable-3.5/bin/plot_hirs_field_timeseries\", line 11, in \u003cmodule\u003e\r\n    load_entry_point('FCDR-HIRS==0.0.4', 'console_scripts', 'plot_hirs_field_timeseries')()\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/FCDR_HIRS/analysis/timeseries.py\", line 1225, in main\r\n    \"calibpos\": p.corr_calibpos})\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/FCDR_HIRS/analysis/timeseries.py\", line 592, in plot_noise_with_other\r\n    alltemp='_'.join(temperatures), tb=t[0], te=t[-1]))\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/pyatmlab/graphics.py\", line 208, in print_or_show\r\n    fig.canvas.print_figure(str(outf))\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/backend_bases.py\", line 2192, in print_figure\r\n    **kwargs)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/backends/backend_agg.py\", line 545, in print_png\r\n    FigureCanvasAgg.draw(self)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/backends/backend_agg.py\", line 464, in draw\r\n    self.figure.draw(self.renderer)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/artist.py\", line 63, in draw_wrapper\r\n    draw(artist, renderer, *args, **kwargs)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/figure.py\", line 1142, in draw\r\n    renderer, self, dsu, self.suppressComposite)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/image.py\", line 139, in _draw_list_compositing_images\r\n    a.draw(renderer)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/artist.py\", line 63, in draw_wrapper\r\n    draw(artist, renderer, *args, **kwargs)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/axes/_base.py\", line 2405, in draw\r\n    mimage._draw_list_compositing_images(renderer, self, dsu)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/image.py\", line 139, in _draw_list_compositing_images\r\n    a.draw(renderer)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/artist.py\", line 63, in draw_wrapper\r\n    draw(artist, renderer, *args, **kwargs)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/axis.py\", line 1138, in draw\r\n    renderer)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/axis.py\", line 1078, in _get_tick_bboxes\r\n    extent = tick.label1.get_window_extent(renderer)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/text.py\", line 967, in get_window_extent\r\n    bbox, info, descent = self._get_layout(self._renderer)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/text.py\", line 362, in _get_layout\r\n    ismath=ismath)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/backends/backend_agg.py\", line 230, in get_text_width_height_descent\r\n    renderer=self)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/texmanager.py\", line 676, in get_text_width_height_descent\r\n    dvifile = self.make_dvi(tex, fontsize)\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/texmanager.py\", line 406, in make_dvi\r\n    with Locked(self.texcache):\r\n  File \"/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/matplotlib/cbook.py\", line 2738, in __enter__\r\n    raise self.TimeoutError(err_str)\r\nmatplotlib.cbook.TimeoutError: LOCKERROR: matplotlib is trying to acquire the lock\r\n    '/home/users/gholl/.cache/matplotlib/tex.cache/.matplotlib_lock-*'\r\nand has failed.  This maybe due to any other process holding this\r\nlock.  If you are sure no other matplotlib process is running try\r\nremoving these folders and trying again.\r\n```\r\n\r\nUnfortunately, the nature of the problem makes it hard to write a minimum code snippet that reproduces it, because it only occurs with big plots when running many processes in parallel.\r\n\r\nI'm using Matplotlib 2.0.0rc2 (installed through pip) on Python 3.5.\r\n","author":{"url":"https://github.com/gerritholl","@type":"Person","name":"gerritholl"},"datePublished":"2017-01-09T16:34:25.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":7},"url":"https://github.com/7776/matplotlib/issues/7776"}