cs.LGNov 13, 2026

Clean Tickets, Wrong Orders: Catching Silent Errors with a Language Model in Your Browser Tab

Authors: Umar Ahmed, Maxim Dunaev, Mohammad Nour Al Awad, Sergey Ivanov, Ivan Khodnenko

Organizations: ITMO University, Saint Petersburg, Russia

Abstract

A small language model that turns a typed order into structure can fail in two ways. It can print something broken, which any system rejects. Or it can print a clean, well formed order that nobody placed. Our companion work calls the second kind a silent error, and it is the dangerous one. We present a web demo in which a fine-tuned 0.8B parameter model runs entirely inside the visitor's browser tab, through llama.cpp compiled to WebAssembly. No order text leaves the device. The page parses orders as the visitor types, scores every ticket with the PIZZA benchmark's own matcher ported to TypeScript, refuses anything off the menu with "?" so the model can face the open web, and lets visitors hunt for silent errors or try to cause one. Run in the browser on all 1,357 PIZZA test orders, the deployed model writes the same output as the server evaluation for 99.0% of them and reaches the same exact match (0.882); we also report its latency on 3 consumer laptops. Demo: https://wrong.cuyor.com

Figures & tables

Explore similar work

CardsList
  1. Parsed, Plausible, Wrong: Output Format Controls Silent Errors in Small-Model Semantic Parsing

    Nov 12, 2026Umar Ahmed, Maxim Dunaev, Mohammad Nour Al Awad +2Semantic Parsing

  2. Obey, Diverge, Collapse: Blind Obedience to Incorrect Instructions Drives Code LLMs to Irrecoverable Code Semantic Collapse

    Jul 5, 2026Raj Jaiswal, Anany Singh Divy, Savar Bhasin +3LLM Self-CorrectionAutomated Program Repair