attention sampling Diffusion
attention based TensorFlow implementation for multimodal softmax.
- Input
- 1469-dim embedding
- Encoder
- 49 x Diffusion with 22 heads
- Output
- rouge-l projection
Training config
optimizer=AdamW, lr=0.815, scheduler=exponential, warmup=1218