Transformer Based Generative Adversarial

Transformer-based generative adversarial networks (GANs) combine the strengths of transformer architectures for capturing long-range dependencies with the generative power of GANs to create realistic data. Current research focuses on improving the robustness of these models in adversarial settings, enhancing their ability to incorporate external knowledge, and addressing challenges related to computational efficiency and data limitations across diverse applications like image generation, segmentation, and time-series analysis. This burgeoning field is significantly impacting various domains, including medical image analysis, conversational AI, and cybersecurity, by enabling the generation of high-quality synthetic data and improving the performance of existing models.

Papers

November 7, 2024

Adversarial Robustness of In-Context Learning in Transformers for Linear Regression
Usman Anwar, Johannes Von Oswald, Louis Kirsch, David Krueger, Spencer Frei
Transformer Megatron Decepticons Context Learning Adversarial Training Adversarial Robustness Novel Regression Layer Transformer Linear Ordered Data Transformer Based Generative Adversarial Gradient Based Adversarial

July 25, 2024

Adversarially Robust Decision Transformer
Xiaohang Tang, Afonso Marques, Parameswaran Kamalaruban, Ilija Bogunovic
Native Robustness Decision Transformer Minimax Optimality Adversarial Reinforcement Learning Adversarial Environment Transformer Based Generative Adversarial

February 29, 2024

Memory-Augmented Generative Adversarial Transformers
Stephan Raaijmakers, Roos Bakker, Anita Cremers, Roy de Kleijn, Tom Kouwenhoven, Tessa Verhoef
Transformer Architecture Conversational AI Goal Oriented Transformer Based Generative Adversarial Memory Augmented Transformer

December 3, 2023

QuantAttack: Exploiting Dynamic Quantization to Attack Vision Transformers
Amit Baras, Alon Zolfi, Yuval Elovici, Asaf Shabtai
Adversarial Attack Vision Transformer Transformer Based Model Quantization Technique Dynamic Quantization Transformer Based Generative Adversarial

November 29, 2023

Focus on Query: Adversarial Mining Transformer for Few-Shot Segmentation
Yuan Wang, Naisong Luo, Tianzhu Zhang
Segmentation Based Approach Query Information Shot Segmentation Human Driving Focus Transformer Based Generative Adversarial Query Image Segmentation Mining Transformer

October 17, 2023

The Efficacy of Transformer-based Adversarial Attacks in Security Domains
Kunyang Li, Kyle Domico, Jean-Charles Noirot Ferrand, Patrick McDaniel
Adversarial Example Adversarial Perturbation Transformer Architecture Adversarial Sample Adversarial Evaluation Transformer Based Generative Adversarial

October 2, 2023

Efficient Remote Sensing Segmentation With Generative Adversarial Transformer
Luyi Qiu, Dayu Yu, Xiaofeng Zhang, Chenxiao Zhang
Semantic Segmentation Remote Sensing Segmentation Accuracy Local Transformer Transformer Based Generative Adversarial

July 22, 2023

SCPAT-GAN: Structural Constrained and Pathology Aware Convolutional Transformer-GAN for Virtual Histology Staining of Human Coronary OCT images
Xueshen Li, Hongshan Liu, Xiaoyu Song, Brigitta C. Brott, Silvio H. Litovsky, Yu Gan
Optical Coherence Tomography C Gan Transformer Based Generative Adversarial Structural Constraint H&E Stained

March 15, 2023

Investigating GANsformer: A Replication Study of a State-of-the-Art Image Generation Model
Giorgia Adorni, Felix Boelter, Stefano Carlo Lambertenghi
Generative Adversarial Network Image Generation Model Transformer Based Generative Adversarial Replication Study

February 17, 2023

Transformer-based Generative Adversarial Networks in Computer Vision: A Comprehensive Survey
Shiv Ram Dubey, Satish Kumar Singh
Generative Adversarial Network Computer Vision Comprehensive Survey GAN Architecture Transformer Based Generative Adversarial

October 21, 2022

Adversarial Transformer for Repairing Human Airway Segmentation
Zeyu Tang, Nan Yang, Simon Walsh, Guang Yang
Refinement Network Patch Level Airway Segmentation Airway Tree Transformer Based Generative Adversarial Bronchus Segmentation

September 14, 2022

TASKED: Transformer-based Adversarial learning for human activity recognition using wearable sensors via Self-KnowledgE Distillation
Sungho Suh, Vitor Fortes Rey, Paul Lukowicz
Adversarial Learning Activity Recognition Deep Learning Based Wearable Sensor Self Knowledge Distillation Transformer Based Generative Adversarial Based Human Activity Recognition

July 28, 2022

A Transformer-based Generative Adversarial Network for Brain Tumor Segmentation
Liqun Huang, Long Chen, Baihai Zhang, Senchun Chai
Brain Tumor Segmentation Medical Image Segmentation Task Multi Modal MRI Transformer Based Generative Adversarial Medical Semantic Segmentation

July 16, 2022

Structural Prior Guided Generative Adversarial Transformers for Low-Light Image Enhancement
Cong Wang, Jinshan Pan, Xiao-Ming Wu
Image Restoration Low Light Image Enhancement Structural Prior Transformer Based Generative Adversarial

February 6, 2022

TTS-GAN: A Transformer-based Time-Series Generative Adversarial Network
Xiaomin Li, Vangelis Metsis, Huangyingrui Wang, Anne Hee Hiong Ngu
Generative Adversarial Network Time Series Transformer Based Generative Adversarial

January 27, 2022

Generalised Image Outpainting with U-Transformer
Penglei Gao, Xi Yang, Rui Zhang, John Y. Goulermas, Yujie Geng, Yuyao Yan, Kaizhu Huang
Image Outpainting Transformer Based Generative Adversarial

January 26, 2022

Class-Aware Adversarial Transformers for Medical Image Segmentation
Chenyu You, Ruihan Zhao, Fenglin Liu, Siyuan Dong, Sandeep Chinchali, Ufuk Topcu, Lawrence Staib, James S. Duncan
Medical Image Segmentation Medical Image Datasets Transformer Based Generative Adversarial Recent Transformer Based

January 3, 2022

RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmark
Zhuo Deng, Yuanhao Cai, Lu Chen, Zheng Gong, Qiqi Bao, Xue Yao, Dong Fang, Shaochong Zhang, Lan Ma
Fundus Image Image Analysis Medical Benchmark Transformer Based Generative Adversarial