René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"BUG - aaq_batch does not remove_from_jobqueue on inactive/failed/error job, leading to infinite loop","articleBody":"For jobs with status 'failed', 'inactive' or 'error', there is a difference between the situation before and after aaworkermaximumretry is reached.\r\nBefore the max retry is reached, remove_from_jobqueue() is called, with the retry input set to true. This is ok behaviour.\r\nWhen the max number of retries is reached, aa throws an error (because it calls aas_log with the error input set to true), but does NOT call remove_from_jobqueue first.\r\n\r\nAt least when Parallel Server and MJS are used (instead of a parcluster('local')), since these are persistent, this means that these jobs stay in the pool forever, because they are never removed. They fill up the queue even, so if multiple times an aa script is run that leads to such a job, the nfreeworkers in runall() in aaq_batch becomes zero, without there being any obj.jobinfo, which leads to an infinite loop.\r\n\r\n","author":{"url":"https://github.com/AljenU","@type":"Person","name":"AljenU"},"datePublished":"2021-12-16T15:11:08.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/314/automaticanalysis/issues/314"}