A Versatile Diffusion Transformer with Mixture of Noise Levels for Audiovisual Generation

Instead of the standard fixed diffusion timestep, we propose applying variable diffusion timesteps across the temporal dimension and across modalities of the inputs.