René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Memory Exhausted","articleBody":"I like the concept of this repo and it has worked really well in local environment. In production however, I get this error:\n\n`[2025-09-02 22:29:43] production.ERROR: Allowed memory size of 536870912 bytes exhausted (tried to allocate 2097160 bytes) {\"exception\":\"[object] (Symfony\\\\Component\\\\ErrorHandler\\\\Error\\\\FatalError(code: 0): Allowed memory size of 536870912 bytes exhausted (tried to allocate 2097160 bytes)`\n\nIs there any experience of this? Or ideas of how to avoid? It seems to me that larger websites need to be queued/batched and this package isn't suitable for that use case.","author":{"url":"https://github.com/edstevo","@type":"Person","name":"edstevo"},"datePublished":"2025-09-03T07:21:18.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/285/core/issues/285"}