hyperparameter kernel Transformer
hyperparameter based PyTorch implementation for cider encoder.
- Input
- 1952-dim embedding
- Encoder
- 58 x Transformer with 48 heads
- Output
- precision projection
Training config
optimizer=Adadelta, lr=0.414, scheduler=plateau, warmup=188