General training discoveries
#2
by CodeExplode - opened
Hi!
I'm just wondering if there are any general discoveries regarding training that the creators are willing to share? e.g. Does caption dropout seem to help? Did you settle on randomizing all tags or sometimes leave some at the front? (e.g. 1man, 1woman, etc)
Most of our info is in the release notes. Partial caption dropout seems to work well, but we don't really have the resources to do a proper test. Tags are completely randomized. The training code is here if you want to see https://github.com/waifu-diffusion/network-trainer
Thanks!
CodeExplode changed discussion status to closed