Moco based discriminative training
Moco based Fine-tune is good choice in duplicate/near duplicate tasks such as same image/ document detection, person identification, ….. amazing performance increase. As a discriminative training framework can fine-Tune any models vit, resnet, clip ….
Have fine-tuned resnet, vit, clip. AUC improvement is amazing.