FreeLB

DataFunTalk

Feb 24, 2020 · Artificial Intelligence

Adversarial Training for Transformer‑Based Natural Language Models: Methods, Variants, and Experimental Results

This presentation reviews adversarial training techniques for transformer‑based NLP models, covering the motivation, image‑based and text‑based attack generation, standard PGD, its variants FreeAT and YOPO, the proposed FreeLB method, extensive GLUE experiments, and conclusions about robustness and future directions.