AnonShield: Scalable On-Premise Pseudonymization for CSIRT Vulnerability Data
Organizations: Federal University of Pampa (UNIPAMPA) · Universit´e de Bretagne Occidentale (UBO)
Abstract
We present AnonShield, a high-throughput, on-premise pseudonymization system that combines GPU-accelerated NER, streaming processing, caching, and schema-aware configuration. Evaluated on datasets up to 550 MB (70,951 records), AnonShield reduces processing time from over 92 hours to under 10 minutes (up to 738x speedup) while achieving up to 94.2% F1-score and 96.7% recall. Our results show that scalable pseudonymization of vulnerability data is feasible without sacrificing analytical utility, enabling compliant data sharing in operational CSIRT environments.
Figures & tables
| System | Main Technique | Target Domain | Type | File Formats | Gap in CSIRT context |
| Microsoft Presidio [ 15 ] | NLP + RegEx + extensible recognizers | Generic text | US | – | No CVE/CPE/hash recognizers; domain-irrelevant patterns produce FPs in vulnerability data |
| Google Cloud DLP [ 11 ] | NLP + FPE + PII classification | General data | US+S | .txt, .csv, .json, .pdf, .docx | Cloud endpoint conflicts with CSIRT data sovereignty policies; no cybersecurity-specific entities |
| Amazon Comprehend [ 4 ] | Cloud NLP for PII detection and redaction | Generic text | US | .txt | Cloud endpoint conflicts with CSIRT data sovereignty policies; no vulnerability scanner format support |
| IRI DarkShield [ 12 ] | Multi-source masking + REST API | Corporate data | US+S | .txt, .pdf, .xml, .json, .sql, images | Commercial licence limits adoption in academic and public-sector CSIRTs; no cybersecurity-specific entities |
| LogLicker [ 1 ] | RegEx + masking + remapping manifest | CloudTrail & Generic logs | US+S | .json, .txt | RegEx only; lacks contextual NER; high manual maintenance for custom logs |
| Anonip [ 9 ] | Bit masking of trailing IP bits via pipe | Web server logs | US | .log, .txt | Covers IP addresses only |
| ID | Source | Format | Size | Access |
| D1 | OpenVAS (VulnLab) | CSV/TXT/PDF/XML | 9.29/11.61/33.32/34.11 MB | Public |
| D1C | Converted from D1 | XLSX/DOCX/JSON/PDF(img) | 3.34/7.58/60.72/1,479.56 MB | Public |
| D2 | Tenable (CAIS/RNP) | CSV/JSON | 419.72/550.54 MB | Private |
| D3 | Synthetic (Mock) | CSV/JSON | 247.45/444.56 MB | Public |
| Category | Examples |
| Network & Infrastructure | DNS (Bind), FTP (ProFTPD), OpenLDAP |
| Web Applications & APIs | Juice Shop, DVWA, GraphQL |
| Web Servers & Platforms | Apache, Nginx, Tomcat, WordPress |
| Databases | MySQL, PostgreSQL, MongoDB, Redis |
| Monitoring & Logging | Elasticsearch, Prometheus, Grafana |
| DevOps & CI/CD | Jenkins, GitLab, Nexus |
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Format | Version/Strategy | Mean (s) | Median (s) | Max (s) | CV | Speedup | Cohen’s |
| XML | AnonLFI v2.0 (Baseline) | 191.89 | 176.44 | 1717.71 | 0.96 | – | |
| AnonShield_presidio | 15.62 | 13.69 | 85.58 | 0.60 | 1.29 (Large) | ||
| AnonShield_standalone | 11.62 | 10.02 | 72.34 | 0.63 | 1.32 (Large) | ||
| CSV | AnonLFI v2.0 (Baseline) | 74.18 | 37.01 | 1442.08 | 1.75 | – | |
| AnonLFI v1.0 | 37.92 | 20.41 | 577.96 | 1.55 | 0.35 (Small) | ||
| AnonShield_presidio | 10.65 | 9.08 | 60.62 | 0.53 | 0.67 (Medium) |
| Format | Version/Strategy | Mean (s) | Max (s) | CV | Speedup | Cohen’s |
| JSON | AnonLFI v2.0 (Baseline) | 246.55 | 1861.01 | 1.16 | – | |
| AnonShield_presidio | 20.15 | 110.78 | 0.72 | 1.08 (Large) | ||
| AnonShield_standalone | 10.61 | 49.02 | 0.60 | 1.12 (Large) | ||
| XLSX | AnonLFI v1.0 (Baseline) | 35.51 | 320.73 | 1.37 | – | |
| AnonLFI v2.0 | 60.30 | 596.95 | 1.52 | (Small) | ||
| AnonShield_presidio | 9.86 | 38.64 | 0.47 | 0.73 (Medium) |
| CSV (419.72 MB) | JSON (550.54 MB) | ||||
| Mode | Version / Strategy | Time (s) | KB/s | Time (s) | KB/s |
| No config | AnonLFI v2.0 (est.) | 0.98 | 1.69 | ||
| AnonShield_presidio | 171 | 575 | |||
| AnonShield_standalone | 732 | 1,250 | |||
| With config | AnonShield_presidio | 32,034 | 29,855 | ||
| AnonShield_standalone | 34,341 | 31,272 | |||
| CSV (247.45 MB) | JSON (444.56 MB) | ||||
| Mode | Version / Strategy | Time (s) | KB/s | Time (s) | KB/s |
| No config (GPU) | AnonLFI v2.0 (est.) | 0.98 | 1.69 | ||
| AnonShield_presidio | 797 | 1,343 | |||
| AnonShield_standalone | 3,473 | 2,647 | |||
| No config (CPU) | AnonShield_standalone | 526 | 518 | ||
| With config | AnonShield_presidio | 28,517 | 21,571 | ||
| Version/Strategy | TP | FP | FN | Prec. | Rec. | F1 |
| AnonLFI v1.0 | 106 | 224 | 459 | 32.1% | 18.8% | 23.7% |
| AnonLFI v2.0 | 279 | 68 | 407 | 80.4% | 40.7% | 54.0% |
| AnonShield_presidio | 724 | 287 | 25 | 71.6% | 96.7% | 82.3% |
| AnonShield_filtered | 724 | 64 | 25 | 91.9% | 96.7% | 94.2% |
| AnonShield_hybrid | 724 | 64 | 25 | 91.9% | 96.7% | 94.2% |
| AnonShield_standalone | 739 | 102 | 43 | 87.9% | 94.5% | 91.1% |
Cyber Threat Intelligence
Cyber threat intelligence turns evidence about adversaries, campaigns, and vulnerabilities into knowledge that helps defenders anticipate and respond to attacks.
See all 41 papers