Generative Models

ARM: next token prediction

Text-to-image

• Diffusion
• flow

过时的：GAN

normalizing flow

基于masked掩码方式的离散扩散模型

next token prediction: ARM

next frequency prediction: DM

next "set of token" prediction: MaskGiT

VAR

损失函数分离

• 基于对抗均衡GAN
• 交叉熵：ARM