Issues

Will you be releasing the accuracy of the official deit III framework trained tiny version on IN1k?
facebookresearch/deit#241 · opened on Feb 10, 2024
Gradient accumulation code
facebookresearch/deit#240 · opened on Jan 26, 2024
Question about different seeds per gpu with DDP
facebookresearch/deit#239 · opened on Jan 25, 2024
Training
facebookresearch/deit#238 · opened on Jan 17, 2024
Inclusion of Transformers Need Registers
facebookresearch/deit#237 · opened on Nov 1, 2023
random.seed(seed) in line 205 is commented
facebookresearch/deit#236 · opened on Oct 11, 2023
Checkpoints of IN21K pretrained deit III
facebookresearch/deit#232 · opened on Aug 16, 2023
Hi，Why can't I find deit_tiny_distilled_patch16_224 in hubconf
facebookresearch/deit#231 · opened on Aug 14, 2023
TracerWarning
facebookresearch/deit#230 · opened on Aug 14, 2023
How to launch a training of CAIT models ?
facebookresearch/deit#226 · opened on Jun 29, 2023
batch_size flag
facebookresearch/deit#220 · opened on May 26, 2023
2
ImageNet21K data preparation for pre-training
facebookresearch/deit#219 · opened on May 8, 2023
5
how to implement cosub training use deit-III
facebookresearch/deit#217 · opened on Apr 28, 2023
2
The ablation experiment of DeiT
facebookresearch/deit#215 · opened on Apr 21, 2023
2
Single machine multi-GPU training
facebookresearch/deit#213 · opened on Mar 16, 2023
What batch size number other than 1024 have been tried when training a DeiT model?
facebookresearch/deit#205 · opened on Dec 29, 2022
What is the ImageNet-1K Top-1 accuracy of Training from 0 to 400 epochs (Fig. 5 of Deit III paper)
facebookresearch/deit#199 · opened on Nov 12, 2022
Config file of ViT-B/16
facebookresearch/deit#195 · opened on Oct 21, 2022
2
What are the hyperparameters for finetuning on cifar10/100, and other small datasets
facebookresearch/deit#175 · opened on Jul 22, 2022
2
Questions about hyper-parameters in the finetuning stage
facebookresearch/deit#152 · opened on Mar 6, 2022
3