RAMA: Retrieval-Augmented Multi-Agent Routing with Episodic Memory for LEO Satellite Networks

This paper proposes a spatial-temporal learning-based routing framework for dynamic low Earth orbit (LEO) satellite networks. The routing problem is formulated as a partially observable Markov decision process (POMDP), where each satellite independently selects its next hop using network-state observations and destination information. A graph attention network (GAT) extracts spatial features from the dynamic satellite topology and queue states, while a long short-term memory (LSTM) network captures their temporal evolution. The resulting representation is integrated into a deep Q-network (DQN) for destination-aware next-hop selection without a separate traffic-prediction stage. Simulations in a 45-satellite LEO constellation under normal and bursty traffic demonstrate packet delivery performance comparable to a graph neural network (GNN)-enhanced routing baseline, although the proposed method incurs higher delay and queue occupancy. Ablation studies further demonstrate the complementary benefits of spatial and temporal learning.

LEO satellite networks feature dynamic topologies, time-varying links, and diverse service requirements, which make conventional routing schemes difficult to support fine-grained quality-of-service (QoS) provisioning. Existing studies mainly optimize routing over network states with predefined objectives, but rarely address the practical challenge of translating unstructured natural-language service requests into adaptive routing decisions. To bridge this gap, we propose STR-Agent, an LLM-driven framework for QoS-aware routing in LEO satellite networks. The key innovation of STR-Agent lies in unifying intent perception, tool-based execution, experience accumulation, and reflection-based policy adaptation within a single agent architecture. Specifically, the Perception Module converts natural-language requests into structured routing semantics, while the Reflection Module dynamically adjusts the service-to-routing-policy mapping according to real-time congestion conditions and historical routing outcomes, rather than relying on a fixed routing objective. In addition, we develop a specialized perception model, and construct a domain-specific supervised fine-tuning dataset for LEO service understanding. Simulation results in a Walker-Delta constellation show that STR-Agent significantly outperforms conventional baselines: it reduces end-to-end delay by up to 60% compared with DQ-Dijkstra, improves average intent-understanding accuracy from 45.4% to 92.45% after supervised fine-tuning, and the Reflection Module further reduces the delay by 120 ms at 600 Mbps. These results demonstrate the potential of LLM-driven agent architectures to enable service-aware and adaptive QoS routing in future LEO satellite networks.

Frequent handovers and finite satellite capacity make multi-user mobility management challenging in low Earth orbit (LEO) satellite networks. This paper develops a capacity-aware multi-user handover framework based on a double deep Q-network (DDQN) with a dueling architecture. Both training and evaluation employ sequential user equipment (UE) processing with shared satellite occupancy, while action masking excludes invisible or capacity-infeasible satellites. The state incorporates satellite visibility, achievable link quality, remaining capacity, previous association, short-term visibility, and time information. A fixed multi-criteria reward balances throughput, blocking, handover cost, connection persistence, and short-term visibility, while expert trajectories are used only for replay-buffer initialization. Simulations under different UE densities and satellite capacities show that the proposed framework maintains high average throughput per UE and low blocking rates with moderate handover frequency. Ablation results show that removing the remaining-capacity vector has only a limited effect on performance when sequential occupancy tracking and feasible-action masking are retained.