cs.ARNov 4, 2026

Enabling AWS Cloud FPGA Development Using High-Level Vitis HLS

Authors: David Rostcheck

Abstract

We present a toolchain for development of ML models on AWS EC2 F2 cloud FPGA infrastructure from high-level language, implementing a complete Vitis HLS to HDK bridge to AFI workflow that has been absent from the academic literature despite eight years of AWS FPGA availability. We introduce a four-level methodology (FP32 PyTorch, bit-accurate quantized Python, HLS C-simulation, physical FPGA) to aid in localizing errors, including FPGA-specific circuit errors. Together these tools allow coding agents to effectively implement FPGA designs from user directions, testing and debugging as needed. We document the deployment workflow, timing closure strategies, and practical HLS engineering decisions that proved crucial. We validate using TinyBERT fine-tuned for address Named Entity Recognition, implementing the embedding layer and the first of four encoder layers on the FPGA hardware. Our implementation streams weights from host DRAM, yielding poor performance compared to CPU/GPU implementations; we discuss forward paths.

Figures & tables

Explore similar work

CardsList
  1. Enabling Low-Latency Machine learning on Radiation-Hard FPGAs with hls4ml

    Feb 17, 2026Katya Govorkova, Julian Garcia Pardinas, Vladimir Loncar +5Hardware-Aware QuantizationFPGA-Based Neural Network Acceleration

  2. Spiking Neural Network inference on FPGAs with hls4ml

    Jun 8, 2026Barry M. DillonEfficient Neural Network InferenceSpiking Neural Networks