René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Implement timeout mechanism","articleBody":"Hello,\r\n\r\nas discussed on [Discourse](https://discuss.python.org/t/add-timeout-management-in-pyperformance/63728) it would be nice to implement a timeout within pyperfomance.\r\n\r\nIf a benchmark run hangs, pyperformance doesn’t have a mechanism to time out and terminate the underlying process. We’ve had a few cases where a benchmark was hanging literally forever (deadlock) and the job was terminated by the CI system eventually (after many hours!). This is not ideal because:\r\n\r\n* it’s hard to set an appropriate timeout for the whole process as it might vary from machine to machine\r\n* sometimes folks might not have full control of the CI system hence impossible to set a sensible timeout\r\n* having an early failure by pyperformance is preferred than having a timeout at process (pyperformance) level. This allow better usage of CI resources.\r\n\r\nRequirements:\r\n* Ideally the timeout would be applied at benchmark run level and not for the whole pyperformance process allowing a more fine grained control in case of timeout.\r\n* If a benchmark times out, it should not fail the whole pyperformance suite but we should mark it as failed (there is already a mechanism to do that).\r\n* There should be able to provide an option at cli level to override the default timeout value.","author":{"url":"https://github.com/diegorusso","@type":"Person","name":"diegorusso"},"datePublished":"2024-09-13T13:24:37.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":2},"url":"https://github.com/353/pyperformance/issues/353"}