This paper presents a novel method, called Progressive Autoregressive AdvGAN (PAR-AdvGAN), to address the adversarial example problem, a vulnerability of deep neural networks. To overcome the limitation of single-iteration generation in existing GAN-based methods, PAR-AdvGAN introduces an autoregressive iterative mechanism to generate adversarial examples with enhanced attack capabilities. Through extensive experiments, PAR-AdvGAN demonstrates superior performance against various state-of-the-art black-box adversarial attacks and existing AdvGANs. In particular, it achieves a maximum frame rate of 335.5 frames per second on the Inception-v3 model, significantly faster than gradient-based transferable attack algorithms. The source code is available on GitHub.