Title: Add compression for output file with gzip and MessagePack. Add inbuil… by rahlk · Pull Request #7 · codellm-devkit/codeanalyzer-python · GitHub
Open Graph Title: Add compression for output file with gzip and MessagePack. Add inbuil… by rahlk · Pull Request #7 · codellm-devkit/codeanalyzer-python
X Title: Add compression for output file with gzip and MessagePack. Add inbuil… by rahlk · Pull Request #7 · codellm-devkit/codeanalyzer-python
Description: Add output format flag with MessagePack compression support Address issue #6 by implementing a --format flag that allows users to choose between compact JSON and ultra-compressed MessagePack output formats, achieving 80-90% size reduction for large analysis results. Motivation and Context Large Python codebases generate analysis results that can be several megabytes in size when output as pretty-printed JSON. This creates problems for: Storage efficiency: Large files consume unnecessary disk space Transfer speed: Slow uploads/downloads in CI/CD pipelines Processing performance: Large JSON files are slower to parse Network bandwidth: Inefficient for distributed analysis workflows This change addresses these issues by providing format options optimized for different use cases while maintaining full data fidelity. How Has This Been Tested? ✅ Real codebase testing: Tested on large Python projects (1000+ files) ✅ Format validation: Both JSON and MessagePack outputs validated ✅ Round-trip testing: Serialization → deserialization preserves all data ✅ Compression verification: Confirmed 80-90% size reduction on real data ✅ Error scenarios: Invalid format options handled gracefully ✅ Backward compatibility: Existing workflows continue unchanged Example compression results on real project: ❯ uv run codeanalyzer --input $PWD -vvv --output /tmp --format=msgpack --keep-cache Building symbol table ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 21/21 files 0:00:04 0:00:00 [07/11/25 00:41:57] INFO ✅ Symbol table generation complete. INFO Analysis saved to /tmp/analysis.msgpack INFO Compression ratio: 9.2% of JSON Breaking Changes None. This is a fully backward-compatible addition: Default behavior remains unchanged (compact JSON output) All existing CLI commands work exactly as before No changes to programmatic APIs Types of changes New feature (non-breaking change which adds functionality) Bug fix (non-breaking change which fixes an issue) Breaking change (fix or feature that would cause existing functionality to change) Documentation update Checklist I have read the [Codellm-Devkit Documentation](https://codellm-devkit.info) My code follows the repository's style guidelines New and existing tests pass locally I have added appropriate error handling I have added or updated documentation as needed Additional context N/A
Open Graph Description: Add output format flag with MessagePack compression support Address issue #6 by implementing a --format flag that allows users to choose between compact JSON and ultra-compressed MessagePack output...
X Description: Add output format flag with MessagePack compression support Address issue #6 by implementing a --format flag that allows users to choose between compact JSON and ultra-compressed MessagePack output...
Opengraph URL: https://github.com/codellm-devkit/codeanalyzer-python/pull/7
X: @github
Domain: github.com
| route-pattern | /:user_id/:repository/pull/:id/files(.:format) |
| route-controller | pull_requests |
| route-action | files |
| fetch-nonce | v2:4503300f-5abc-444c-9ee7-76c017df3a26 |
| current-catalog-service-hash | ae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b |
| request-id | 97A2:11ED3F:3B4D21:51CB9E:698E0D3A |
| html-safe-nonce | 095cb91078bdf8dbf521099ef4937f8f1054caf1fb2fb119410722ae5738cd88 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5N0EyOjExRUQzRjozQjREMjE6NTFDQjlFOjY5OEUwRDNBIiwidmlzaXRvcl9pZCI6IjQ5MTQxMjQzODc0NDE3Mzg4MiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 4faed670d7d2fc9ac06ca1ee474e8198465de2a25044dd3469d342719d3e6aec |
| hovercard-subject-tag | pull_request:2657891361 |
| github-keyboard-shortcuts | repository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/codellm-devkit/codeanalyzer-python/pull/7/files |
| twitter:image | https://avatars.githubusercontent.com/u/1433964?s=400&v=4 |
| twitter:card | summary_large_image |
| og:image | https://avatars.githubusercontent.com/u/1433964?s=400&v=4 |
| og:image:alt | Add output format flag with MessagePack compression support Address issue #6 by implementing a --format flag that allows users to choose between compact JSON and ultra-compressed MessagePack output... |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | fdf74c91c9ac187cc5cd7b14d4af2d6ef3e18136d002f5d36253f8538e97ee4c |
| turbo-cache-control | no-preview |
| diff-view | unified |
| go-import | github.com/codellm-devkit/codeanalyzer-python git https://github.com/codellm-devkit/codeanalyzer-python.git |
| octolytics-dimension-user_id | 197800760 |
| octolytics-dimension-user_login | codellm-devkit |
| octolytics-dimension-repository_id | 978344904 |
| octolytics-dimension-repository_nwo | codellm-devkit/codeanalyzer-python |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 978344904 |
| octolytics-dimension-repository_network_root_nwo | codellm-devkit/codeanalyzer-python |
| turbo-body-classes | logged-out env-production page-responsive full-width |
| disable-turbo | true |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 1a5a3e7bbfb3486980e340c242368684156fba87 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width