Autonomous Edge-Deployed AI Agents for Electric Vehicle Charging Infrastructure Management
Organizations: Hyperion Consulting, Paris, France
Abstract
Public EV charging infrastructure suffers from significant failure rates -- with field studies reporting up to 27.5% of DC fast chargers non-functional -- and multi-day mean time to resolution, imposing billions in annual economic burden. Cloud-centric architectures cannot achieve the latency, reliability, and bandwidth characteristics required for autonomous operation. We present Auralink SDC (Software-Defined Charging), an architecture deploying domain-specialized AI agents at the network edge for autonomous charging infrastructure management. Key contributions include: (1) Confidence-Calibrated Autonomous Resolution (CCAR), enabling autonomous remediation with formal false-positive bounds; (2) Adaptive Retrieval-Augmented Reasoning (ARA), combining dense and sparse retrieval with dynamic context allocation; (3) Auralink Edge Runtime, achieving sub-50ms TTFT on commodity hardware under PREEMPT_RT constraints; and (4) Hierarchical Multi-Agent Orchestration (HMAO). Implementation uses AuralinkLM models fine-tuned via QLoRA on a domain corpus spanning OCPP 1.6/2.0.1, ISO 15118, and operational incident histories. Evaluation on 18,000 labeled incidents in a controlled environment establishes 78% autonomous incident resolution, 87.6% diagnostic accuracy, and 28-48ms TTFT latency (P50). This work presents architecture and implementation patterns for edge-deployed industrial AI systems with safety-critical constraints.
Figures & tables
| Task | General | Adapted | |
| General knowledge | 89.2% | 87.8% | -1.4 |
| OCPP protocol | 44.7% | 92.1% | +47.4 |
| Fault diagnosis | 38.1% | 87.6% | +49.5 |
| Remediation | 41.8% | 84.3% | +42.5 |
| Safety assessment | 52.3% | 93.2% | +40.9 |
| ISO 15118 | 35.2% | 89.7% | +54.5 |
| Approach | Edge | LLM | Auto | Off. | Open |
| Rule CSMS | ✗ | ✗ | ✗ | Part. | Prop. |
| Cloud AI | ✗ | ✓ | Part. | ✗ | Prop. |
| Edge GW | ✓ | ✗ | ✗ | ✓ | Mix |
| Acad. RAG | Part. | ✓ | Part. | ✗ | ✓ |
| Ours | ✓ | ✓ | ✓ | ✓ | ✓ |
| Domain | N | Functions |
| Station Mgmt | 28 | Registration, provisioning |
| Session | 23 | Auth, metering, billing |
| Grid Integration | 20 | DSO protocols, flex markets |
| AI/ML Pipeline | 35 | Training, eval, distribution |
| Analytics | 25 | BI, dashboards, reporting |
| Operations | 39 | Monitoring, alerting, SRE |
| Component | Specification |
| Configuration A: High Performance | |
| Processor | AMD Ryzen AI Max+ 395 (Strix Halo) |
| NPU | AMD XDNA 2, 50 TOPS |
| Memory | up to 128GB LPDDR5X-8000 |
| Storage | 1TB NVMe Gen4 |
| Configuration B: NVIDIA DGX Spark [ 26 ] | |
| Model | Adapt. | Quant. | Speed | Struct. |
| Mistral | 94.2 | 97.1 | 92.4 | 96.8 |
| Llama 3.3 | 91.8 | 94.3 | 89.7 | 91.2 |
| Qwen 2.5 | 92.4 | 93.8 | 88.2 | 93.4 |
| Phi-4 | 88.7 | 91.2 | 95.1 | 89.3 |
| Gemma 2 | 87.3 | 92.4 | 87.8 | 88.7 |
| Model | Params | Tier | P50 | P99 |
| 675B | 675B MoE | Cloud | 285ms | 890ms |
| 14B | 14B | Edge | 28ms | 78ms |
| 0.5B | 0.5B | Device | 11ms | 34ms |
| Category | Count | Source |
| OCPP 1.6 | 8,432 | Spec + synthetic Q&A |
| OCPP 2.0.1 | 9,847 | Spec + synthetic Q&A |
| Fault Diagnosis | 41,234 | Historical incidents |
| Remediation | 34,567 | Service manuals |
| Power Electronics | 24,891 | Engineering docs |
| Session Management | 18,432 | Operational logs |
| Parameter | Value |
| Rank ( ) | 64 |
| Alpha ( ) | 32 |
| Dropout | 0.05 |
| Target Modules | q,k,v,o,gate,up,down |
| Learning Rate | (cosine) |
| Warmup Steps | 100 |
| Precision | Size | Acc. | P50 |
| FP16 | 28.0 GB | 89.4% | 142ms |
| INT8 (Q8_0) | 14.0 GB | 89.1% | 68ms |
| Q5_K_M | 9.8 GB | 88.4% | 42ms |
| Q4_K_M | 8.2 GB | 87.6% | 28ms |
| Q4_K_S | 7.6 GB | 86.9% | 26ms |
| IQ4_XS | 7.2 GB | 85.8% | 24ms |
| Platform | CPU | NPU | Speedup |
| AMD XDNA 2 | 48ms | 28ms | 1.71 |
| Intel AI Boost | 62ms | 42ms | 1.48 |
| Qualcomm Hexagon | 85ms | 52ms | 1.63 |
| Metric | P99 | Max |
| Interrupt latency | ||
| Scheduling latency | ||
| Timer jitter | ||
| Context switch | ||
| Inference start |
| Confidence | Action |
| Execute autonomously, log only | |
| Execute with operator notification | |
| Recommend, await approval (timeout: 4h) | |
| Escalate with full context | |
| Human expert required |
| Document Type | Docs | Chunks |
| OCPP Specifications | 18 | 18,432 |
| OEM Service Manuals | 347 | 58,234 |
| Technical Bulletins | 1,234 | 42,847 |
| ISO/IEC Standards | 52 | 14,123 |
| Historical Resolutions | 2,847 | 72,345 |
| Grid Codes | 28 | 8,432 |
| Metric | Value |
| Recall@5 | 95.2% |
| Precision@5 | 91.4% |
| MRR (Mean Reciprocal Rank) | 0.924 |
| NDCG@10 | 0.912 |
| Retrieval Latency (P50) | 18ms |
| Retrieval Latency (P99) | 42ms |
| Agent | Responsibility | Model |
| AutoOps | Fault diagnosis | 14B |
| TechSupport | Guided repair | 14B |
| OpsMgmt | Fleet analytics | 14B |
| DriverAssist | Session support | 0.5B |
| CodeGen | API integration | 14B |
| Component | Specification |
| Cloud Infrastructure | |
| GPU Cluster | NVIDIA H100/H200 (distributed) |
| Model | AuralinkLM 675B (675B MoE, 4+1 active experts) |
| Context | 128K tokens (of 256K max) |
| Edge Deployment (Primary) | |
| CPU | AMD Ryzen AI Max+ 395 (Strix Halo) |
| Incident Type | Fraction |
| Communication | 30.0% |
| Authorization | 18.0% |
| Power Elec. | 15.0% |
| Firmware/SW | 13.0% |
| Mechanical | 10.0% |
| Payment Processing | 8.0% |
| System | Auto | Acc. | P50 | MTTR | Off. |
| Rule-Based | 0% | 44.7% | 5ms | 96h | Yes |
| Cloud (A) | 28.4% | 72.3% | 420ms | 28h | No |
| Cloud (B) | 31.2% | 74.8% | 380ms | 24h | No |
| Non-FT | 22.1% | 52.3% | 32ms | 42h | Yes |
| Ours | 78% | 87.6% | 28ms | 4–8h | Yes |
| Parameter | Value (simulation) |
| Simulated stations | 1,000-charger reference |
| Operator profiles | 23 (modeled) |
| Country profiles | 14 (EU + UK + CH + NO) |
| Testing period | Controlled testing |
| Simulated sessions | Representative sample |
| Diagnostic scenarios | Representative corpus |
| System | Auto% | MTTR | FP% | FN% |
| Traditional | 0% | 96h | 42% | – |
| Cloud-AI a | 31.2% | 24h | 11% | 8% |
| Human Expert | – | 68h | 6% | 4% |
| Auralink SDC | 78% | 4–8h | 3.8% | 5.2% |
| Category | Acc. | Prec. | Rec. | |
| Comms | 91.8% | 90.2% | 93.4% | 0.918 |
| Auth | 90.4% | 92.1% | 88.7% | 0.904 |
| Power Elec. | 85.2% | 82.8% | 87.9% | 0.853 |
| Firmware | 89.3% | 91.2% | 87.4% | 0.893 |
| Mechanical | 79.8% | 77.2% | 82.6% | 0.798 |
| Payment | 88.7% | 89.4% | 87.9% | 0.886 |
| Failure Mode | % of Failures |
| Low confidence (escalated) | 50.0% |
| Hardware replacement req. | 28.0% |
| Multi-fault complexity | 11.0% |
| Novel fault pattern | 6.0% |
| False negative (missed) | 5.0% |
| Total failures | 100% |
| Configuration | Acc. | Auto% | Acc |
| Full system | 87.6% | 78% | — |
| Domain fine-tuning | 52.3% | 22.1% | 35.3 |
| ARA retrieval | 79.2% | 61.4% | 8.4 |
| CCAR calibration | 87.1% | 42.8% | 0.5 |
| Curriculum learning | 84.3% | 72.1% | 3.3 |
| Multi-agent routing | 85.8% | 74.2% | 1.8 |
| Configuration | P50 | P95 | P99 |
| Cloud (675B) | 285ms | 520ms | 890ms |
| Edge GPU (14B) | 28ms | 52ms | 78ms |
| Agent FW (0.5B) | 11ms | 24ms | 34ms |
| Full pipeline | 67ms | 124ms | 187ms |
| Horizon | Prec. | Rec. | FPR | |
| 24h | 94.0% | 84.2% | 0.888 | 1.2% |
| 48h | 94.7% | 79.8% | 0.866 | 2.1% |
| 72h | 92.4% | 75.1% | 0.829 | 3.4% |
| 7d | 85.2% | 68.7% | 0.761 | 5.8% |
| Category | Trad. | Auralink |
| SW licensing | $129K | $0 |
| Service | $165K | $126K |
| Field service | $900K | $375K |
| Downtime | $219K | $72K |
| Infrastructure | — | $90K |
| Total | $1,413K | $663K |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| Platform | 0.5B | 14B | TDP |
| AMD Strix Halo | 142 | 38 | 45–120W |
| NVIDIA DGX Spark | 385 | 95 | 140W |
| NVIDIA RTX 5090 | 512 | 128 | 575W |
| NVIDIA Jetson Thor | 52 | 12 | 40–130W |
| Apple M4 Max | 128 | 34 | 50W |
| Qualcomm X Elite | 87 | 21 | 23W |
Electric Vehicle Charging
Electric vehicle charging research studies how to forecast, plan, control, and secure charging while coordinating vehicles, stations, and power grids.
See all 38 papers