René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Improve performance of `os.walk()`","articleBody":"There are a couple of minor performance improvements possible in `os.walk()`:\r\n\r\n- We don't need to manually pump the `os.scandir` iterator, given we handle exceptions from `next()` like exceptions from `scandir()` itself, i.e. by ignoring the problematic directory and moving on. We can use a `for` loop like filthy casuals.\r\n- ~In bottom-up mode, we can handle exceptions from `entry.is_symlink()` in the same block as those from `entry.is_dir()`, which avoids a few temporary variables.~\r\n- In top-down mode, we can call `os.path.join()` once on a parent directory rather than for each child path.\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-119186\n* gh-119473\n* gh-119573\n* gh-119750\n* gh-121431\n* gh-121432\n* gh-121433\n* gh-121435\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/barneygale","@type":"Person","name":"barneygale"},"datePublished":"2024-05-19T02:34:52.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":3},"url":"https://github.com/119169/cpython/issues/119169"}