Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning:...
Transcript of Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning:...
![Page 1: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/1.jpg)
CienciasdeDatosyDeepLearning:Neuronasartificialesparaaprender
Francisco Herrera
![Page 2: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/2.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
2
Historyof
DataScience
BigDataDeepLearning
![Page 3: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/3.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
3
En1943WarrenMcCullochyWalterPitts presentaronsumodelodeneuronaartificial,ydescribieronlosprimerosfundamentosdeloquesellamaríaposteriormenteredesneuronales.
W.McCullochandW.Pitts(1943).ALogicalCalculusofideasImmanentinNervousActivity.BulletinofMathematicalBiophysics5:115-133.
RedesNeuronales
![Page 4: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/4.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
4
RedesNeuronales
Unaredneuronalseproponecomounsistemainteligentequeimitaalsistemanerviosoyalaestructuradelcerebro,peromuydiferenteentérminosdesuestructurayescala.Aligualquelasneuronasbiológicas,lasneuronasartificialesseinterconectanparaformarredesdeneuronasartificiales.Cadaneuronaartificialutilizaunafunciónprocesamiento queagregalainformacióndeconexionesdeentradaconotrasneuronalesartificiales,unafuncióndeactivaciónyunafuncióndetransferenciaparadarunasalidadelaneuronaensusconexionesdesalida.
Netj
x1
x2
xn
wj1
wj2
wjn
yj å=
×=×++×+×=n
iijinjnjjj xwxwxwxwNet
12211 !
÷÷ø
öççè
æ-×=-= å qq ijijjj xwfNetfy )(
![Page 5: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/5.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
5
RedNeuronalClásica:Backpropagation
Credits:TheEvolutionofNeuralLearningSystems:ANovelArchitectureCombiningtheStrengthsofNTs,CNNs,andELMs.NMartinel, CMicheloni…- IEEESMCMagazine,2015- ieeexplore.ieee.org
![Page 6: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/6.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
6
• Múltiples capasocultas• Aprendizajejerárquico
• Característicascadavezmáscomplejas• Muybuencomportamiento enmútiplesdominios:Vision,Audio,…
DeepArchitecture(Redes Neuronales conmuchas capas)
![Page 7: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/7.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
7
UnsupervisedDeepArchitecture: Autoencoder
An autoencoder neuralnetworkisanunsupervisedlearningalgorithmthatappliesbackpropagation,settingthetargetvaluestobeequaltotheinputs.
Theaimofanautoencoder istolearnarepresentation(encoding)forasetofdata,typicallyforthepurposeofdimensionalityreduction.
![Page 8: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/8.jpg)
Andrew Ng
Unsupervised feature learning with a neural network
x4
x5
x6
+1
Layer1
Layer2
x1
x2
x3
x4
x5
x6
x1
x2
x3
+1
Layer3
a1
a2
a3
![Page 9: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/9.jpg)
Andrew Ng
x4
x5
x6
+1
Layer1
Layer2
x1
x2
x3
+1
a1
a2
a3
New representation for input.
Unsupervised feature learning with a neural network
![Page 10: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/10.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
10
DeepArchitecture: Autoencodern BreastCancerWisconsin(Diagnostic)DataSet
Autoencoder (f(x)=x) (unasolacapainternade3neuronasy1000"epochs".WDBC(569instanciascon32atributosdeentrada)
Credito:D.Charte
![Page 11: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/11.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
11
http://arxiv.org/abs/1312.5602
DeepMind:Start up-2011Demis Hassabis,Shane Legg yMustafa Suleyman
![Page 12: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/12.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
12
JuegosArcade(Breakout)
![Page 13: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/13.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
13
DeepLearningRetos enla“pintura”
![Page 14: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/14.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
14
http://www.deepart.io/
DeepLearning: DeepART
![Page 15: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/15.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
15
Ejemplos delresultado deDeepART
http://www.deepart.io/
vanGoth
![Page 16: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/16.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
16
Ejemplos delresultado deDeepART
http://www.deepart.io/
![Page 17: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/17.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
17
ModelodeDLutilizadoydescripcióndelametodología
http://arxiv.org/abs/1508.06576
![Page 18: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/18.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
18
Supervised DeepLearning:Convolutional NeuralNetworks
http://parse.ele.tue.nl/cluster/2/CNNArchitecture.jpg
![Page 19: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/19.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
19
Supervised DeepLearning:Convolutional NeuralNetworks
Eachmoduleconsistsofaconvolutional layerandapoolinglayer.
Typicallytriestocompresslargedata(images)intoasmallersetofrobustfeatures,basedonlocalvariations.
Basicconvolutioncanstillcreatemanyfeatures.
CNNshavebeenfoundhighlyeffectiveandbeencommonlyusedincomputervisionandimagerecognition.
![Page 20: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/20.jpg)
DeepLearning
Convolutional steps
https://github.com/rasbt/python-machine-learning-book/blob/master/faq/difference-deep-and-normal-learning/convolution.png
![Page 21: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/21.jpg)
http://neuralnetworksanddeeplearning.com/chap6.html
DeepLearningDigitRecognizerandConvolutional NN
Convolutional neuralnetworks usethreebasicideas:localreceptivefields,sharedweights,andpooling.
Localreceptive fields:Tobemoreprecise,eachneuroninthefirsthiddenlayerwillbeconnectedtoasmallregionoftheinputneurons,say,forexample,a5×5region,correspondingto25inputpixels.So,foraparticularhiddenneuron,wemighthaveconnectionsthatlooklikethis:
![Page 22: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/22.jpg)
http://neuralnetworksanddeeplearning.com/chap6.html
DeepLearningDigitRecognizerandConvolutional NN
Localreceptive fields:
24×24 neurons
28×28 input image
![Page 23: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/23.jpg)
http://neuralnetworksanddeeplearning.com/chap6.html
DeepLearningDigitRecognizerandConvolutional NN
Shared weights andbiases:thesame weightsandbiasforeachofthe24×24hiddenneurons(sigmoide function)
Themapfromtheinputlayertothehiddenlayerafeaturemap.
![Page 24: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/24.jpg)
http://neuralnetworksanddeeplearning.com/chap6.html
DeepLearningDigitRecognizerandConvolutional NN
Shared weights andbiases:
In the example shown, there are 3 feature maps.
If we have 20 feature maps that's a total of 20×26=520 parameters defining the convolutional layer. By comparison, suppose we had a fully connected first layer, with 784=28×28 input neurons, 30 hidden neurons, 23,550 parameters.
![Page 25: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/25.jpg)
http://neuralnetworksanddeeplearning.com/chap6.html
DeepLearningDigitRecognizerandConvolutional NN
Pooling layers: thepoolinglayersdoissimplifytheinformationintheoutputfromtheconvolutional layer,onecommonprocedureforpoolingisknownasmax-pooling,inthe2x2regioninput.
![Page 26: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/26.jpg)
DeepLearningDigitRecognizerandConvolutional NN
Pooling layers:
![Page 27: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/27.jpg)
http://neuralnetworksanddeeplearning.com/chap6.html
DeepLearningDigitRecognizerandConvolutional NN
The20imagescorrespondto20differentfeaturemaps
![Page 28: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/28.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
28
Credits:https://www.datarobot.com/blog/a-primer-on-deep-learning/
Alaizquierda,losdígitosdeentradasinprocesar.Aladerecha,representacionesgráficasdelascaracterísticasaprendidas.Enesencia,laredaprendea"ver"líneasybucles.
DeepLearning:MNISTdata
![Page 29: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/29.jpg)
Asnapshotofimagepre-processingforconvolutional neuralnetworks:casestudyofMNISTSiham Tabik,DanielPeralta,AndrésHerrera-Poyatos,FranciscoHerreraInternationalJournal ofComputational Intelligence Systems,Vol.10(2017)555–56899.72accuracy
DeepLearningDigitRecognizerandpreprocessing
CNNmodels:LeNet,Network3,DropConnet
Preprocessing andaugmentation
Ensembles
![Page 30: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/30.jpg)
DeepLearningDigitRecognizerandpreprocessing
CNNmodels:LeNet [4]
[4]Yann LeCun,Leon Bottou,Yoshua Bengio,andPatrickHaffner.Gradient-basedlearningappliedtodocumentrecognition.Proc.IEEE,86(11):2278– 2324,1998.
![Page 31: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/31.jpg)
DeepLearningDigitRecognizerandpreprocessing
CNNmodels:Network3[13]
[13]MichaelANielsen.Neuralnetworksanddeep learning.URL:http://neuralnetworksanddeeplearning.com,2015.
![Page 32: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/32.jpg)
DeepLearningDigitRecognizerandpreprocessing
CNNmodels:DropConnet [14]
[14]LiWan,Matthew Zeiler,Sixin Zhang,Yann LCun,andRobFergus.Regularizationofneuralnetworksusingdropconnect.InProceedingsofthe30thInternationalConferenceonMachineLearning(ICML- 13),pages 1058–1066,2013.
![Page 33: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/33.jpg)
DeepLearningDigitRecognizerandpreprocessing
Preprocessing andaugmentation
Translation.Theimageistranslatedanumberofpixelstowardagivendirection.
Centering.Toeliminatewhitecolumns/rows,andtoresize by scaling.
Rotation.Theimageisrotatedtoagivenangleθ.
Elastic deformation.Image pixels areslightly movedinrandomdirections,keepingtheimage’stopology.
![Page 34: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/34.jpg)
DeepLearningDigitRecognizerandpreprocessing
Preprocessing andaugmentation
![Page 35: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/35.jpg)
DeepLearningDigitRecognizerandpreprocessing
Preprocessing andaugmentation
![Page 36: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/36.jpg)
DeepLearningDigitRecognizerandpreprocessing
Preprocessing andaugmentation
![Page 37: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/37.jpg)
DeepLearningDigitRecognizerandpreprocessing
Preprocessing andaugmentation
![Page 38: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/38.jpg)
DeepLearningDigitRecognizerandpreprocessing
Preprocessing andaugmentation
![Page 39: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/39.jpg)
DeepLearningDigitRecognizerandpreprocessing
Preprocessing andaugmentation
![Page 40: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/40.jpg)
DeepLearningDigitRecognizerandpreprocessing
Preprocessing andaugmentation
![Page 41: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/41.jpg)
DeepLearningDigitRecognizerandpreprocessing
Preprocessing andaugmentation
Ensembles
![Page 42: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/42.jpg)
DeepLearningDigitRecognizerandpreprocessing
Preprocessing andaugmentation
The28handwrittendigitsmisclassifiedbyensemble-5ofNetwork3Thedigitbetween()representsthecorrectclass.The13digitslabeledwithasterisksarealsomisclassifiedbyDropConnect
![Page 43: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/43.jpg)
Deep Learning: MNIST data Asnapshotofimagepre-processingforconvolutional neuralnetworks:casestudy ofMNISTSiham Tabik,DanielPeralta,AndrésHerrera-Poyatos,FranciscoHerreraInternationalJournal ofComputational Intelligence Systems,Vol.10(2017)555–56899.72accuracy
The28handwrittendigitsmisclassifiedbyensemble-5ofDropConnetThedigitbetween()representsthecorrectclass.The13digitslabeledwithasterisksarealsomisclassifiedbyNetwork3
![Page 44: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/44.jpg)
DeepLearningDigitRecognizerandpreprocessing
Preprocessing andaugmentation
The13handwrittendigitsmisclassifiedbyensemble-5ofDropConnetandNetwork3
![Page 45: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/45.jpg)
DeepLearningMXNet
http://mxnet.io/get_started/index.html
![Page 46: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/46.jpg)
DeepLearningMXNet
http://mxnet.io/how_to/finetune.html
![Page 47: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/47.jpg)
DeepLearningLearningfromscratchvs fine-tuning(GoogLeNet yVGG-16)
VGG16http://www.robots.ox.ac.uk/~vgg/research/very_deep/
https://gist.github.com/ksimonyan/211839e770f7b538e2d8#file-readme-md
##Informationname:16-layermodelfromthearXiv paper:"VeryDeepConvolutional NetworksforLarge-ScaleImageRecognition"caffemodel:VGG_ILSVRC_16_layerscaffemodel_url: http://www.robots.ox.ac.uk/~vgg/software/very_deep/caffe/VGG_ILSVRC_16_layers.caffemodellicense:see http://www.robots.ox.ac.uk/~vgg/research/very_deep/caffe_version:trainedusingacustomCaffe-basedframework
VGGisaconvolutional neuralnetworkmodelproposedbyK.Simonyan andA.ZissermanfromtheUniversityofOxfordinthepaper“VeryDeepConvolutional NetworksforLarge-ScaleImageRecognition”.Themodelachieves92.7%top-5testaccuracyinImageNet ,whichisadatasetofover14millionimagesbelongingto1000classes.
K.Simonyan,A.ZissermanVeryDeepConvolutional NetworksforLarge-ScaleImageRecognitionarXiv technicalreport,2014https://arxiv.org/pdf/1409.1556.pdf
![Page 48: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/48.jpg)
DeepLearningLearningfromscratchvs fine-tuning(GoogLeNet yVGG-16)
VGG16
Source:https://www.cs.toronto.edu/~frossard/post/vgg16/
![Page 49: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/49.jpg)
Modelandpre-trainedparametersforVGG16inTensorFlowhttps://www.cs.toronto.edu/~frossard/post/vgg16/
Keras:https://keras.io/https://keras.io/applications/DeepLearninglibraryforTheano andTensorFlowKeras isahigh-levelneuralnetworksAPI,writteninPythonandcapableofrunningontopofeither TensorFlow or Theano.Itwasdevelopedwithafocusonenablingfastexperimentation. Beingabletogofromideatoresultwiththeleastpossibledelayiskeytodoinggoodresearch.
Models for image classificationwith weights trained on ImageNet
DeepLearningLearningfromscratchvs fine-tuning(GoogLeNet yVGG-16)
VGG16
![Page 50: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/50.jpg)
DeepLearningLearningfromscratchvs fine-tuning(GoogLeNet yVGG-16)
GoogLeNethttps://research.google.com/pubs/pub43022.html
Weproposeadeepconvolutional neuralnetworkarchitecturecodenamedInceptionthatachievesthenewstateoftheartforclassificationanddetectionintheImageNet Large-ScaleVisualRecognitionChallenge2014(ILSVRC2014).Themainhallmarkofthisarchitectureistheimprovedutilizationofthecomputingresourcesinsidethenetwork.Byacarefullycrafteddesign,weincreasedthedepthandwidthofthenetworkwhilekeepingthecomputationalbudgetconstant.Tooptimizequality,thearchitecturaldecisionswerebasedontheHebbian principleandtheintuitionofmulti-scaleprocessing.Oneparticularincarnationofthisarchitecture,GoogLeNet,a22layersdeepnetwork,wasusedtoassessitsqualityinthecontextofobjectdetectionandclassification.
Going Deeper with ConvolutionsChristianSzegedy, Wei Liu, Yangqing Jia, PierreSermanet, ScottReed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, AndrewRabinovicharXiv technicalreport,2014https://arxiv.org/pdf/1409.4842.pdf
![Page 51: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/51.jpg)
DeepLearningLearningfromscratchvs fine-tuning(GoogLeNet yVGG-16)
GoogLeNethttp://www.robots.ox.ac.uk/~vgg/research/very_deep/
GooglLeNet inCaffehttps://github.com/BVLC/caffe/tree/master/models/bvlc_googlenet
GooglLeNet inKerashttps://gist.github.com/joelouismarino/a2ede9ab3928f999575423b9887abd14http://joelouismarino.github.io/blog_posts/blog_googlenet_keras.html
![Page 52: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/52.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
52
Deep Learning: Detección de Armas en Video
R. Olmos, S. Tabik, F. Herrera (UGR) Video:Skyfall,201252
![Page 53: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/53.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
53
Deep Learning: Detección de Armas en Video
R. Olmos, S. Tabik, F. Herrera (UGR) Video:Skyfall,2012
![Page 54: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/54.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
54
Underwaterimagepatchesofcorals
Cellclassificationfromcervixsmears Fingerprintidentification/classificationEjemplosdeaplicaciones
![Page 55: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/55.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
55
DeepLearningLectura:RecentOverview
http://www.nature.com/nature/journal/v521/n7553/full/nature14539.html
![Page 56: Ciencias de Datos y Deep Learning: Neuronas artificiales ... · Ciencia de Datos y Deep Learning: Neuronas artificiales para aprender 19 SupervisedDeep Learning: ConvolutionalNeural](https://reader031.fdocuments.us/reader031/viewer/2022011908/5f617b4b50be400327455063/html5/thumbnails/56.jpg)
Ciencia deDatosyDeepLearning:Neuronasartificialesparaaprender
56
LeCum,Bengio yHinton,2015:“Ultimately,majorprogressinartificialintelligencewillcomeaboutthroughsystemsthatcombinerepresentationlearningwithcomplexreasoning.Althoughdeeplearningandsimplereasoninghavebeenusedforspeechandhandwritingrecognitionforalongtime,newparadigmsareneededtoreplacerule-basedmanipulationofsymbolicexpressionsbyoperationsonlargevectors”
Losavancesenelconocimientodelcerebroyelrazonamientohumanopermitirándiseñarnuevosparadigmasderepresentaciónyrazonamientocomplejo.