Skip to content

CutMix + Mixup overhaul#218

Merged
rwightman merged 6 commits intomasterfrom
cutmix
Aug 13, 2020
Merged

CutMix + Mixup overhaul#218
rwightman merged 6 commits intomasterfrom
cutmix

Conversation

@rwightman
Copy link
Collaborator

@rwightman rwightman commented Aug 13, 2020

Finally a cleaned up impl of CutMix, integrated with Mixup.

A number of mode options... some examples (command line arg combos), to cut & paste into docs at some point

  • Mixup active w/ alpha 0.2, performed on every batch, lambda sampled for each batch (old behaviour)
    • --mixup 0.2
  • Mixup active w/ alpha 0.3, cutmix active with alpha 1.0, lambda sampled for each batch, cutmix used 50% of the time
    • --mixup 0.3 --cutmix 1.0
  • Mixup active w/ alpha 0.2, cutmix active with alpha 1.0, cutmix used 30% of the time, a different lambda and cutmix vs mixup decision sampled for each batch element
    • --mixup 0.2 --cutmix 1.0 --mixup-switch-prob 0.3 --mixup-elem
  • Mixup active w/ alpha 0.2, cutmix active with minmax ratio set to [0.3, 0.8], cutmix used 30% of the time, some sort of mixing active 70% of the time, a different lambda, cutmix vs mixup, mixing active sampled for each batch element
    • --mixup 0.2 --cutmix-minmax 0.3 0.8 --mixup-switch-prob 0.3 --mixup-prob 0.7 --mixup-elem

Fix #8

@rwightman rwightman merged commit b423bc8 into master Aug 13, 2020
@rwightman rwightman changed the title CutMix + MixUp overhaul CutMix + Mixup overhaul Aug 13, 2020
@thepowerfuldeez
Copy link

Hi! Do you have in mind to test training with Attentive Cutmix? It seems that this simple technique improves scores by 1%
https://arxiv.org/abs/2003.13048

@rwightman rwightman deleted the cutmix branch November 19, 2021 16:45
guoriyue pushed a commit to guoriyue/pytorch-image-models that referenced this pull request May 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

2 participants