Main Contribution: This paper replaces the commonly-used U-Net backbone with a transformer structure to improve diffusion models.