cs.AINov 13, 2026

Robustness Evaluation of GPU Cloud Pricing Benchmarks under Incomplete Observations: A Controlled Missingness Study

Authors: Jooya Wong

Organizations: Chongqing College of Mobile Communication, Chongqing, China

Abstract

Daily GPU rental-price benchmarks can fail when marketplace quotes are missing. This article stress-tests a fixed equal-weight median rule under four imposed masking mechanisms and four benchmark-level recovery methods. Across 5,800 Monte Carlo realisations in 27 scenarios on 190 held-out days, whole-source outages reduce publication coverage to 0.77 while preserving zero conditional error on published dates; composition-changing loss retains 0.86 coverage but produces 7.74 log points of error. A separate past-only stratum-level ablation reduces error by 4.15 to 6.70 log points in five composition-changing cases, using a richer information set. An observable-signal withholding rule improves the primary error-coverage criterion in 0 of 10 cases. Results concern observed asking-price measurements, not transaction prices or identified real-world missingness mechanisms.

Explore similar work

CardsList
  1. GPUAlert: A Zero-Instrumentation Process-Boundary Monitor for Diagnosing GPU Training-Job Failures

    Jul 1, 2026Parv Agarwal, Asif EkbalFault DetectionFault Diagnosis

  2. When GPUs Fail Quietly: Observability-Aware Early Warning Beyond Numeric Telemetry

    Mar 17, 2026Michael Bidollahkhani, Freja Nordsiek, Julian M. KunkelFault DetectionPredictive Maintenance

  3. Measuring the Checker: Mutation Analysis for GPU-Kernel Benchmark Oracles

    Sep 2, 2026Mingzhe Du, Anh Tuan Luu, Dong Huang +1GPU Kernel Correctness VerificationBenchmark Auditing