Title: feat(pii): regex-only block-output redaction + drop GLiNER/GPU image by TheodoreSpeaks · Pull Request #5697 · simstudioai/sim · GitHub
Open Graph Title: feat(pii): regex-only block-output redaction + drop GLiNER/GPU image by TheodoreSpeaks · Pull Request #5697 · simstudioai/sim
X Title: feat(pii): regex-only block-output redaction + drop GLiNER/GPU image by TheodoreSpeaks · Pull Request #5697 · simstudioai/sim
Description: Summary Restrict the block-output PII stage to regex/checksum entities only — drop the 4 spaCy-NER types (PERSON/LOCATION/NRP/DATE_TIME). Enforced at the UI grid, the API contract (migration-safe strip, never reject → existing rules stay saveable), and the resolver (so un-migrated rules can't feed NER into execution). Add a Presidio skip-spaCy fast path: regex-only requests reuse a blank NlpArtifacts to bypass the spaCy NER pass entirely — the per-leaf cost that made bulk block-output redaction slow. redact_batch logs nlp=skip|full. Remove the GLiNER/GPU image: strip torch/CUDA/GLiNER from docker/pii.Dockerfile, delete engines.py/requirements-gliner/bench+tests, restore server.py to a self-contained CPU spaCy service (keeps the NER-only pipe-disable ~2x win + the logging-emit fix), and drop the Helm pii.engine/pii.device wiring. Type of Change New feature + cleanup Testing 43 unit tests pass (regex-only grid + strip, contract transform, resolver strip); type-check, lint, check:api-validation:strict clean; py_compile server.py; helm lint + helm unittest (10/10) pass. ⚠️ The server skip-spaCy path is logic/syntax-verified but not runtime-tested locally (Presidio isn't installable here). Validate on staging: a regex-only block-output redaction should log nlp=skip and run dramatically faster than a NER (nlp=full) request. Checklist Code follows project style guidelines Self-reviewed my changes Tests added/updated and passing No new warnings introduced I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)
Open Graph Description: Summary Restrict the block-output PII stage to regex/checksum entities only — drop the 4 spaCy-NER types (PERSON/LOCATION/NRP/DATE_TIME). Enforced at the UI grid, the API contract (migration-safe ...
X Description: Summary Restrict the block-output PII stage to regex/checksum entities only — drop the 4 spaCy-NER types (PERSON/LOCATION/NRP/DATE_TIME). Enforced at the UI grid, the API contract (migration-safe ...
Opengraph URL: https://github.com/simstudioai/sim/pull/5697
X: @github
Domain: github.com
| route-pattern | /:user_id/:repository/pull/:id/files(.:format) |
| route-controller | pull_requests |
| route-action | files |
| fetch-nonce | v2:2d1e044c-42f9-fd51-89e0-9a3972738b13 |
| current-catalog-service-hash | ae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b |
| request-id | 9832:CDD8D:9E22A0:E3885C:6A63855D |
| html-safe-nonce | 84b40be63d07596fd4c7c51f21fdb194be45400cf26ec2d23738b099b65f79e0 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5ODMyOkNERDhEOjlFMjJBMDpFMzg4NUM6NkE2Mzg1NUQiLCJ2aXNpdG9yX2lkIjoiODczMTk4ODE0MTcyNDEwODEyNiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | d34af6cb493de596595b2641c361ee5458ee684787a97bafa2a86d9dfc125aec |
| hovercard-subject-tag | pull_request:4064026962 |
| github-keyboard-shortcuts | repository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/5697/files |
| twitter:image | https://avatars.githubusercontent.com/u/19564703?s=400&v=4 |
| twitter:card | summary_large_image |
| og:image | https://avatars.githubusercontent.com/u/19564703?s=400&v=4 |
| og:image:alt | Summary Restrict the block-output PII stage to regex/checksum entities only — drop the 4 spaCy-NER types (PERSON/LOCATION/NRP/DATE_TIME). Enforced at the UI grid, the API contract (migration-safe ... |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | e4fb64aef87da454ec25b158147f7f5f14aef29216e5ca1612c2e48faa599d1f |
| turbo-cache-control | no-preview |
| diff-view | unified |
| go-import | github.com/simstudioai/sim git https://github.com/simstudioai/sim.git |
| octolytics-dimension-user_id | 199344406 |
| octolytics-dimension-user_login | simstudioai |
| octolytics-dimension-repository_id | 912559512 |
| octolytics-dimension-repository_nwo | simstudioai/sim |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 912559512 |
| octolytics-dimension-repository_network_root_nwo | simstudioai/sim |
| turbo-body-classes | logged-out env-production page-responsive full-width |
| disable-turbo | true |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | e839936ba5faffb9c836dda1cf4729d50c88a32e |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width