Title: RQ and Logtail/BetterStack issue · Issue #36 · logtail/logtail-python · GitHub
Open Graph Title: RQ and Logtail/BetterStack issue · Issue #36 · logtail/logtail-python
X Title: RQ and Logtail/BetterStack issue · Issue #36 · logtail/logtail-python
Description: Hi! I was having an issue with RQ logs not being picked up by Logtail. Here's my Django setup (sorry for the formatting): settings.py: LOGGING = {'version': 1, 'disable_existing_loggers': False, 'formatters': {'verbose': {'format': '[%(a...
Open Graph Description: Hi! I was having an issue with RQ logs not being picked up by Logtail. Here's my Django setup (sorry for the formatting): settings.py: LOGGING = {'version': 1, 'disable_existing_loggers': False, 'f...
X Description: Hi! I was having an issue with RQ logs not being picked up by Logtail. Here's my Django setup (sorry for the formatting): settings.py: LOGGING = {'version': 1, 'disable_existing_log...
Opengraph URL: https://github.com/logtail/logtail-python/issues/36
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"RQ and Logtail/BetterStack issue","articleBody":"Hi! \n\nI was having an issue with RQ logs not being picked up by Logtail. Here's my Django setup (sorry for the formatting):\n\nsettings.py:\n```python\nLOGGING = {'version': 1,\n 'disable_existing_loggers': False,\n 'formatters': {'verbose': {'format': '[%(asctime)s] %(levelname)s [%(name)s:%(lineno)s] %(message)s',\n 'datefmt': '%d/%b/%Y %H:%M:%S %Z'},\n 'simple': {'format': '%(levelname)s %(message)s'}},\n 'filters': {'require_debug_false': {'()': 'django.utils.log.RequireDebugFalse'},\n 'require_debug_true': {'()': 'django.utils.log.RequireDebugTrue'}},\n 'handlers': {\n 'logtail': {'class': 'logtail.LogtailHandler',\n 'source_token': 'xxx',\n 'host': 'https://xxx.betterstackdata.com',\n 'level': 'INFO',\n 'filters': ['require_debug_false']}},\n 'loggers': {'': {'handlers': ['console', 'file', 'logtail'],\n 'level': 'DEBUG'},\n 'django': {'handlers': ['console', 'file', 'logtail'],\n 'level': 'INFO',\n 'propagate': False},\n 'rq': {'handlers': ['console', 'file', 'logtail'],\n 'level': 'DEBUG',\n 'propagate': False},\n }} \n```\n\ncore/tasks.py:\n\n```\nimport logging\nfrom django_rq import job\n\nlogger = logging.getLogger(__name__)\n\n# An experiment for routing logging via RQ\n@job(\"default\")\ndef log_via_rq(message):\n from core.rq_workers import log_experiment\n\n log_experiment()\n logger.info(f\"📬 Logging via RQ: {message}\")\n```\n\ncore/rq_workers.py:\n\n```\nimport logging\n\ndef log_experiment():\n logger = logging.getLogger(__name__)\n logger.info(\"📧 This is a log message inherited by log_via_rq function in core.tasks.py\")\n\n```\n\nThen, in `python manage.py shell`:\n\n```\nIn [1]: from core.tasks import log_via_rq\n\nIn [2]: log_via_rq.delay('hellojsan')\nOut[2]: Job('1bad5e06-219f-49d2-8fc3-e452b36e0769', enqueued_at=datetime.datetime(2026, 3, 23, 8, 11, 54, 858738, tzinfo=datetime.timezone.utc))\n\n```\n\nAnd finally, the output in BetterStack:\n\nHere's BetterStack (couldn't copy formatted):\n\n```\n2026-03-23 09:10:49.407 CET\nmyapp\ninfo\nWorker cc6750f9ea7a429ab37a43f74e8dba85: cleaning registries for queue: default ../.venv/lib/python3.14/site-packages/rq/worker/base.py:434\nrq.worker\n2026-03-23 09:11:54.872 CET\n\nmyapp\ninfo\ndefault: core.tasks.log_via_rq('hellojsan') (1bad5e06-219f-49d2-8fc3-e452b36e0769) ../.venv/lib/python3.14/site-packages/rq/worker/base.py:1095\nrq.worker\n2026-03-23 09:13:03.815 CET\n\nmyapp\ninfo\npikepdf C++ to Python logger bridge initialized ../lib/python3.14/site-packages/pikepdf/__init__.py:13\npikepdf._core\n```\n\nAfter a lot of debugging, I managed to work around it by creating a custom RQ Worker class and assigning that to RQ:\n```\nclass LoggingWorker(Worker):\n def __init__(self, *args, **kwargs):\n super().__init__(*args, **kwargs)\n logging.getLogger(__name__).info(\"✅ LoggingWorker instantiated\")\n\n def main_work_horse(self, job, queue):\n for handler in logging.getLogger().handlers:\n if isinstance(handler, LogtailHandler):\n handler.ensure_flush_thread_alive()\n super().main_work_horse(job, queue)\n\n def perform_job(self, job, queue):\n try:\n return super().perform_job(job, queue)\n finally:\n for handler in logging.getLogger().handlers:\n if isinstance(handler, LogtailHandler):\n handler.flush()\n if hasattr(handler, \"flush_thread\") and handler.flush_thread is not None:\n handler.flush_thread.join(timeout=2)\n\n```\n\nBut, it would be nice if Logtail could handle this. Is there a way?\n\nThanks! (And please let me know if you need more info!)","author":{"url":"https://github.com/mistalaba","@type":"Person","name":"mistalaba"},"datePublished":"2026-03-23T10:42:17Z","url":"https://github.com/logtail/logtail-python/issues/36"}
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:7071f5d5-21b7-a1b1-8679-998ae2641ce4 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | D42A:13BAA8:1006BA:154637:6AFBAF37 |
| html-safe-nonce | d6a2e00692a2bebafd8d018d977c53594705580639fbdbd2a8544c1d1bba1497 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJENDJBOjEzQkFBODoxMDA2QkE6MTU0NjM3OjZBRkJBRjM3IiwidmlzaXRvcl9pZCI6IjIwNjU0MjgzNDI1NTQ0NzIyNDciLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 4319022bfa9e3930223beb400cedacaebfcec1a1a24429ac31c9bad4521bcba3 |
| hovercard-subject-tag | issue:4119908568 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/logtail/logtail-python/36/issue_layout |
| twitter:image | https://opengraph.githubassets.com/e8eec28a29a8233b3b8171024af672bfcbcf7a0844fca35daddf5fe849f0c9c1/logtail/logtail-python/issues/36 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/e8eec28a29a8233b3b8171024af672bfcbcf7a0844fca35daddf5fe849f0c9c1/logtail/logtail-python/issues/36 |
| og:image:alt | Hi! I was having an issue with RQ logs not being picked up by Logtail. Here's my Django setup (sorry for the formatting): settings.py: LOGGING = {'version': 1, 'disable_existing_loggers': False, 'f... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | mistalaba |
| hostname | github.com |
| expected-hostname | github.com |
| None | e25fbd830d3e6ad0e8935c105cf4fdc70c593dffcd27bb45b790ae4fece5ea55 |
| turbo-cache-control | no-preview |
| go-import | github.com/logtail/logtail-python git https://github.com/logtail/logtail-python.git |
| octolytics-dimension-user_id | 78922349 |
| octolytics-dimension-user_login | logtail |
| octolytics-dimension-repository_id | 351343852 |
| octolytics-dimension-repository_nwo | logtail/logtail-python |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 351343852 |
| octolytics-dimension-repository_network_root_nwo | logtail/logtail-python |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 08c8f17f9d27054a108b8b6254e405de0151f660 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | issues |
Links:
Viewport: width=device-width