training set up

#3
by ar3cho - opened

This is amazing, it works really well! Thanks for sharing! Could you give some guidelines on how you prepared the training set?

This is amazing, it works really well! Thanks for sharing! Could you give some guidelines on how you prepared the training set?

The dataset for this first version of material transfer contains a over 30 enteries of :

  • Target image (the result example),
  • Controle 1 image (the same subject without the desired material),
  • Control 2 image (a reference image containing the desired material).

You can get that by sourcing things online, some artists share their material reference or material board for their product design, so you can take both their final result and material reference, all that's left is to use a QEdit or NB to change the result's materials into something else to serve as a Control 1 image.
You can also source the dataset synthetically, by doing a lot of cherry picking, meaning attempting the material transfer in QEdi t or NB by trying different prompts and generating many images until you get the ideal one and take it into your dataset.

My dataset is a mix of the above, but far from ideal as of right now, I've been improving with more cherry picking for a better v2 material transfer LoRA

Sign up or log in to comment