NYAI - A Path To Unsupervised Learning Through Adversarial Networks by Soumith Chintala
-
Upload
rizwan-a-habib -
Category
Technology
-
view
210 -
download
3
Transcript of NYAI - A Path To Unsupervised Learning Through Adversarial Networks by Soumith Chintala
Overviewof the talk
• Unsupervised Learning • Generative Adversarial Networks • Advances • Using the learnt representations • What’s next?
Generative Adversarial NetworksAlternating optimization
Generator Sample Optimizer
Training Data
Loss: Looks Real
Generative Adversarial NetworksAlternating optimization
Generatornoise SampleClassification
Loss
Training Data
Learnt Real/Fake Cost function
Discriminator
Generative Adversarial NetworksAlternating optimization
Generatornoise SampleClassification
Loss
Training Data
Discriminator
Trained via Gradient Descent
Generative Adversarial NetworksAlternating optimization
Generatornoise SampleClassification
Loss
Training Data
Discriminator
Optimizing to fool D
Generative Adversarial NetworksAlternating optimization
Generatornoise SampleClassification
Loss
Training Data
Discriminator
Optimizing to not get fooled by G
Generatornoise
SampleClassification
Loss
Training Data
Discriminator
Class-conditional GANsNot unsupervised
class
Generatornoise SampleClassification
Loss
Training Data
Discriminator
Video Prediction GANs
Generatornoise SampleClassification
Loss
Training Data
Discriminator
MSE Loss
Stability and Representation Reuse
• Feature matching • Minibatch discrimination • Label smoothing • What’s next?