Latency

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-14

11 new papers

A weekly snapshot of new work published in Latency.

Period ending 2026-09-07

24 new papers

A weekly snapshot of new work published in Latency.

Inside this field

Focused directions

456 papers

Latest in Latency

Open your feed →
CardsList

  1. A 25-μs/inf Event-driven Graph Neural Network Processor with Spatiotemporal Caching and Spline Convolution for Ultra-low-latency AI at the Edge

    Sep 14, 2026Adrian Kneip, Martin Lefebvre, Daniel Gehrig +4Lightweight Convolutional Neural Network Hardware AcceleratorLow-Latency Systems

  2. RetroThinker: Enabling Retrospective Thinking in Speech LLMs

    Sep 12, 2026Yi-Jen Shih, Puyuan Peng, Abdelrahman Mohamed +1Speech-LlmsLLM Reasoning Methods

  3. Improving 5G AI-RAN MCS Selection by Predicting Retransmissions

    Sep 10, 2026Tamerlan Aghayev, Maxime Elkael, Michele Polese +5Open Radio Access NetworksSignal-To-Noise Ratio

  4. DiffLUT-Net: Differentiable Training of FPGA LUT Networks with Learnable Connectivity

    Sep 10, 2026Jiaqi Ye, Xinrui Gong, Jingcun Wang +3Field-Programmable Gate ArraysGraph Neural Network Inference

  5. TRACE: Trajectory-robust Admission with Evidence Ordering for Efficient GUI Agents

    Sep 9, 2026Yuhao Wang, Mu Qiao, Xindong Zhang +3Visual Token PruningTraces

  6. Encrypt What Matters: When Selective Homomorphic Inference Is Efficient

    Sep 8, 2026Ali Backour, Juan Reyes, Jaime Punyed +1Homomorphic EncryptionEfficient Inference System

  7. X2Streaming-ASR: wait when uncertain, emit when ready for streaming ASR

    Sep 8, 2026Zhiwei Lin, Kaiqi Fu, Rime Wen +4Automatic Speech RecognitionStreaming

  8. A Measurement Study of LLM Inference Trade-offs Across Edge Continuum Hardware

    Sep 8, 2026Maysam Khatib, Moysis Symeonides, Demetris Trihinas +2LLM Inference EfficiencyLow-Latency Systems

  9. MetaKV: Adaptive KV Cache Compression for Constrained LLM Inference

    Sep 7, 2026Michael Wang, Keith Li, Roozbeh BostandoostKey-Value Cache CompressionLLM Inference Efficiency

  10. Streaming Hierarchical Inference with Tabular Foundation Models

    Sep 7, 2026Vitor Crista, Afonso Lourenço, Diogo Martinho +1Tabular Foundation ModelsEfficient Inference System

  11. Impact of canny edge detection preprocessing on performance of machine learning models for Parkinson's disease classification

    Sep 7, 2026Sameer Bhat, Piotr SzczukoMachine LearningParkinson

  12. Diffusion Language Models for Mobile Edge Agentic AI: Foundations, Applications, and Challenges

    Sep 7, 2026Chenqi Li, Minghui Min, Dusit Niyato +1Diffusion Language ModelsLow-Latency Systems

  13. Para-Pipe: Exploiting Hierarchical Operator Parallelism of ML Computational Graphs on SoCs

    Sep 3, 2026Yujie Zhang, Huiying Lan, Ehsan Aghapour +5Lightweight Convolutional Neural Network Hardware AcceleratorParallel Decoding and Training

  14. Genetic Algorithms for Tractable Bayesian Network Fusion via Pre-Fusion Edge Pruning

    Sep 3, 2026Pablo Torrijos, José A. Gámez, José M. Puerta +1Bayesian NetworksGenetic Algorithms

  15. Network-Aware Forecasting on Wireless Access Points

    Sep 2, 2026Niloo Bahadori, Swadhin Pradhan, Peiman AminiWireless NetworksSingle-Inference Workloads

  16. ASSERT: Adaptive Stochastic Sampling for Robust Diffusion Models on Analog Compute-in-Memory Hardware

    Sep 1, 2026Yuannuo Feng, Yizhe Chen, Wenshuai Yao +4Diffusion ModelsIn-Memory Computing

  17. DynaNDE: Dynamic Near-Data Expert Scheduling for Batched MoE Inference

    Aug 31, 2026Xiaoyang Lu, Belthangady Akash Vi Narayana Pai, Xian-He SunMixture-Of-Expert InferenceNeural Processing Units

  18. Towards Stream Learning on Embedded Systems: Benchmarking the Memory Consumption of Stream Learning Methods

    Aug 31, 2026Sebastian Buschjäger, Nuwan Gunasekara, Heitor Murilo GomesResource-Constrained DevicesPeak Memory

  19. CANVAS: Consistency-Aware Navigation via Visual Adaptive Sampling for Long-Context Text-to-SVG Generation

    Aug 31, 2026Yichen Wu, Haoxuan Qu, Yihang Lou +2Scalable Vector GraphicAutoregressive Image Generation

  20. OCR-MetaReasoning Benchmark: Evaluating the Meta-Reasoning Ability of MLLMs in Text-Rich Image Understanding

    Aug 31, 2026Gengxu Li, Yuan Wu, Yi ChangImage-Text PairsLarge Multimodal Models

  21. TuringLLM: Efficiently Scaling Foundation Models Toward Physical AI

    Aug 31, 2026Yuheng Zhang, Yizhao Wang, Da Zhu +19Mixture-Of-Expert Language ModelsLow-Latency Systems

  22. Preference Shapes Relevance: Cross-component Hierarchical Semantic Alignment for Personalized Generative Retrieval

    Aug 31, 2026Gaoming Zhang, Angqing Jiang, Jianchun Song +4Recommendation ArchitectureHierarchical Semantic Alignment

  23. PRIME: Mitigating Subgroup Optimization Competition in Shared CTR Top Networks with Plug-in Residual Input-Conditioned Mixture of Expert

    Aug 31, 2026Heng Yao, Siyun Hou, Tianying Liu +8Click-Through Rate PredictionSubgroup Information

  24. SmoothRL: Online Reinforcement Learning During Asynchronous Execution

    Aug 30, 2026Guang Gao, Yuxuan Nong, Baifu Huang +1Asynchronous ExecutionSafe Reinforcement Learning

  25. Graph Neural Assisted Actor-Critic for Latency-Efficient Edge Vision System

    Aug 17, 2026Alam Noor, Luis Almeida, Kai Li +3Low-Latency Systems

  26. FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving

    Aug 13, 2026Zekai Li, Yihao Liang, Hongfei Zhang +3Autonomous DrivingAutonomous Hard Drive Disassembly

  27. User-Assisted Collaborative Distributed Inference for Efficient QoS-Aware Autoscaling

    Aug 12, 2026Alfreds Lapkovskis, Ali Beikmohammadi, Sindri Magnússon +1Rate ScalingScalability

  28. Keep the Future, Drop the Rollout: RIFT for World Action Models

    Aug 12, 2026Chushan Zhang, Jinguang Tong, Xuesong Li +2Reinforcement Learning RolloutsWorld Models

  29. A Cost-Efficient Routing Pipeline for Multilingual Short-Text Classification Using Small Language Models

    Aug 11, 2026Wajdi Ben Saad, Safa MadiouniMultilingualDynamic Routing

  30. InSight-doc: Agentic Visual Perception for Long-Document Understanding

    Aug 11, 2026Kaican Li, Weiyan Xie, Lewei Yao +4Visual Document RetrievalDocument

  31. Actionable Hallucination Detection: Translating Latent Uncertainty into Agentic Critique

    Aug 11, 2026Sanidhya Vijayvargiya, Rahul LokeshHallucination DetectionLarge Language Model Uncertainty

  32. The Parser Already Knows: Lightweight Bias Correction in Constrained Decoding

    Aug 10, 2026Işıl Özgü, Yaoxuan Wu, Guy Van den Broeck +1Context-Free GrammarsConstrained Decoding Strategies

  33. CuteTTS: Efficient and High-Quality Speech Synthesis via Autoregressive Modeling of Continuous Latents

    Aug 9, 2026Yuqian Zhang, Yao Shi, Kexin Huang +6Autoregressive Text-To-SpeechSpeech Synthesis

  34. LLMVisor: A Real-Time Latency Attribution Model for Multi-Tenant LLM Serving

    Aug 9, 2026Shuowei Jin, Xueshen Liu, Jiaxin Shan +4LLM Inference EfficiencyLow-Latency Systems

  35. ScaleSense: Cost-Intelligent Scaling Framework via Learned Resource Estimation in Alibaba AnalyticDB

    Aug 8, 2026Yifan Wu, Yuhan Li, Zhenhua Wang +6Rate ScalingScaling

  36. Synthetic LiDAR Data Generation and Deterministic Downsampling for Point Cloud Classification on the Edge

    Aug 7, 2026Niclas Meyer, Stefan ReitmannLight Detection And Ranging Point CloudsPoint Clouds

  37. MiCoPro: End-to-End Mixed Precision HW/SW Co-design with HW-aware Proxy Model

    Aug 7, 2026Zijun Jiang, Yangdi LyuMixed-Precision QuantizationLightweight Convolutional Neural Network Hardware Accelerator

  38. Cascade: Exploiting SLO-Aware latency budget for fair and high goodput LLM inference serving

    Aug 6, 2026Muhammad Adnan, Rohan Mahapatra, Prashant J. Nair +4Large Language Model ServingLow-Latency Systems

  39. Threshold-Based Early Stopping of Accumulations in Neural Networks with Binary Activation

    Aug 6, 2026Quentin Luquet de Saint-Germain, Massil Ait Abdeslam, Jean Pierre DavidEarly StoppingBinarization

  40. BALANCE: Hybrid Autoregressive-Speculative LLM Inference in Wireless Edge Networks

    Aug 6, 2026Guanqiao Qu, Shuo Chen, Qian Chen +2LLM Inference EfficiencyLow-Latency Systems

  41. LiteKD-Net: Lightweight Knowledge-Distilled Network for Mobile Image Denoising

    Aug 6, 2026Zhou ZhiyiFaster InferenceRestoration

  42. Multi-Agent Transformer for Queue-Level XR Traffic Scheduling in TSN Networks

    Aug 5, 2026Marcos Carvalho, Fatih Temiz, Shavbo Salehi +2Multi-Agent Reinforcement LearningScheduling

  43. Enabling Urgency-aware Robot Swarm Intralogistics using Smart IoT Tags

    Aug 5, 2026Youssef Alboraei, Murray Groves, Shane Wen +6Multi-Agent PickupSwarms

  44. Static Timing Orchestration for Tree-Structured Robot Control Firmware

    Aug 5, 2026Wang Xi, Feiran Wei, Mo Deng +3Inference-Time ControlRobots

  45. Architectural Implications of Agentic AI Workflows

    Aug 5, 2026Jirong Yang, Peizhe Liu, Chaojie Zhang +1Agentic WorkflowsAdaptive Scheduling

  46. Deltoris: Enabling Real-time VLA Inference in Embodied AI via Bit-level Sparsity and Speculative Inference

    Aug 5, 2026Zheng Liu, Zeyu Guo, Zihan Liu +9Faster InferenceDiffusion-Based Vision-Language-Actions

  47. Bimanual Manipulation Within an 8 GB Budget: Zero-Copy Sensing and Quantized ACT on an Entry-Level Jetson

    Aug 4, 2026Ekansh Singh, Eva Samuel, Alessandra Reneau +2Nvidia Jetson Orin NanoImitation Learning

  48. SAT-Edge-Agent: Hardware-in-the-Loop Edge-Agent Orchestration for Onboard Satellite Intelligence

    Aug 4, 2026Longji He, Jeto XuIntelligent EdgeNew Satellites

  49. PhyAI: Real-Time Physical AI at the Edge, Scalable Rollouts in the Cloud

    Aug 4, 2026Chenghua Wang, Daliang Xu, Dongqi Cai +21Faster InferencePhysics-Aware Models

  50. When Do Fewer Visual Tokens Accelerate Multimodal Inference? A Break-Even Study Across Decision Locations and Hardware

    Aug 4, 2026Hao Dou, Ruiwen TianVisual Token PruningLow-Latency Systems

  51. Gecko: Fast Private Inference via Secure Public Encoder Offloading

    Aug 3, 2026Cheng'an Wei, Kai Chen, Yue Zhao +2Efficient Inference SystemText Encoders

  52. CARE: A Cascaded Framework for Efficient and Reliable Time Series Anomaly Detection

    Aug 3, 2026Zemin Chao, Qianhui Xu, Jianhe Cen +3Time-Series Anomaly DetectionAnomaly Detection

  53. RADAR Perception for Dynamic Obstacle Avoidance onboard small-scale Quadrotor UAVs

    Aug 3, 2026Dnyandeep Mandaokar, Bernhard RinnerUnmanned Aerial VehiclesRadar

  54. FinHardBench: Can LLMs Generate Latency-Aware Hardware for Financial Computing?

    Aug 2, 2026Weimin Fu, Hejia Zhang, Minghao Shao +6Hardware Description LanguagesField-Programmable Gate Arrays

  55. CascadeLUT: Information-Ordered Streaming Inference for Bandwidth-Constrained FPGAs

    Aug 1, 2026Oliver Cassidy, Marta Andronic, George A. ConstantinidesField-Programmable Gate ArraysFaster Inference

  56. AttnLink: Turning Attention into Schema Links for Text-to-SQL

    Aug 1, 2026Jinwang Song, Tao Liu, Haowen Zheng +3Text-To-SqlAttention-Based Methods

  57. PixelSR: Efficient Screen Content Super-Resolution via Pixel Classification

    Aug 1, 2026Zhiheng Li, Lei Chen, Jie Zhou +1Real-World Image Super-ResolutionHigh-Resolution

  58. BANDMAS: Causality-Inspired Semantic Packet Scheduling for Bandwidth-Efficient Multi-Agent Collaboration

    Aug 1, 2026Jiangwen Dong, Wanyu LinDecentralized Multi-Agent SystemMulti-Agent Coordination

  59. OrEdge: Efficient Multi-Modal Anomaly Detection in Distributed Software Systems via Orthogonal-Domain Learning

    Jul 31, 2026Amr M. Zaki, Farhoud Jafari Kaleibar, Honggeun Ji +2Graph Anomaly DetectionAnomaly Detection

  60. Studying quantization trade-offs for efficient inference deployment in machine translation

    Jul 31, 2026Jim Zhao, Sohir Maskey, Koen Oostermeijer +2Large Language Model QuantizationMachine Translation Quality