cs.LGOct 29, 2026

Topology Survives Shuffling: Robust Long-Context Memory Access Prediction for Graph Analytics

Authors: Dongyan Sun, Neelesh Gupta, Rajgopal Kannan, Viktor K. Prasanna

Organizations: University of Southern California, USA · DEVCOM Army Research Office, USA

Abstract

Graph analytics generates irregular, topology-dependent memory-access streams via indirect traversals, limiting data prefetching. Accurate prediction enables timely prefetches that hide memory latency. However, ML predictors couple short histories with fixed horizons, fitting the training trace's node layout rather than learning transferable graph patterns. We propose LoCoMAP, a long-context representation-learning framework for memory-access prediction with independently controlled observation history and prediction horizon. We evaluate Connected Components (CC), PageRank (PR), and Single-Source Shortest Paths (SSSP) on six synthetic graph families, with Erdos-Renyi (ER) and Grid as random and deterministic controls. We test two interventions: same-family regeneration changes connectivity, while node shuffling disrupts layout but preserves connectivity. Across 18 graph-workload pairs, extending history from 8 to 128 accesses improves F1 by 7.8%, while extending prediction horizon from 8 to 512 improves F1 by 88.3%. For CC, regeneration is less disruptive than shuffling: without retraining, long context retains 95.4% of original F1 and outperforms short context in six families. Under full shuffle, long context improves CC F1 by 33.6% across ER, Barabasi-Albert, Copying Model, and Stochastic Block Model (SBM), with a 2.06x gain on SBM, but not on Watts-Strogatz or Grid, where near-zero delta mass shifts into heavy tails beyond the predictor's range. Long context outperforms short context on six real-world CC graphs. At full shuffle, long-context PR retains 57.6% of original F1 and averages 11.0% above short context. Both SSSP models retain about 30% of original F1 under full shuffle as distance updates access vertex data in a new order. Within these bounds, long-context predictors are robust across related graphs and layouts without retraining, enabling a generalizable graph prefetcher.

Figures & tables

Explore similar work

CardsList
  1. CoPE-CGL: Community-aware Prototype Extraction for Replay-Free Continual Graph Learning

    Oct 26, 2026Bo-Young Lim, Seokhwan Kim, Kisung Lee +1Incremental Learning

  2. Incremental Strongly Connected Components with Predictions

    Apr 28, 2026Ronald Deng, Samuel McCauley, Aidin Niaparast +5Learning-Augmented Algorithms

  3. From Complex Histories to Simple Predictors: Predictive Dimension in Dynamic Graph Learning

    Oct 20, 2026Hantong Feng, Duxin Chen, Wenwu YuDynamic Graph LearningPredictive Representation Learning