Machine Learning Applied to Image Classification
Keywords:
Regularization, Machine Learning, Image ClassificationAbstract
Machine Learning is a field of computer science with severe applications in the modern world. One of the main applications is the use of neural networks in computer vision, recognizing faces in a photo, analyzing x-rays, or identifying an artwork. This paper aims to explore the concepts of machine learning, supervised learning, and neural networks, applying the learned concepts in the CIFAR10 dataset, which is a problem of image classification, trying to build a neural network with high accuracy. To avoid overfitting we proposed trying to use two different methods of regularization: L2 and dropout. We find that using dropout regularization gives the best accuracy on our model when compared with the L2 regularization.
References or Bibliography
IBM Cloud Education. (2021, March 3). Overfitting. Retrieved from https://www.ibm.com/cloud/learn/overfitting.
IBM Cloud Education. (2020, August 17). Neural Networks. Retrieved from https://www.ibm.com/cloud/learn/neural-networks.
IBM Cloud Education. (2020, August 19). Supervised Learning. Retrieved from https://www.ibm.com/cloud/learn/supervised-learning.
Prasad, Ashu. (2020, June 10). Understanding Regularization in Machine Learning. Retrieved from https://towardsdatascience.com/understanding-regularization-in-machine-learning-d7dd0729dde5.
Brownlee, J. (2016, June 20). Dropout Regularization in Deep Learning Models With Keras. Retrieved from https://machinelearningmastery.com/dropout-regularization-deep-learning-models-keras/
Nagpal, Anuja. (2017, October 13). L1 and L2 Regularization Methods. Retrieved from https://towardsdatascience.com/l1-and-l2-regularization-methods-ce25e7fc831c.
Das, Angel. (2020, August 20). Convolution Neural Network for Image Processing — Using Keras. Retrieved from https://towardsdatascience.com/convolution-neural-network-for-image-processing-using-keras-dc3429056306.
Saha, Sumi. (2018, December 15). A Comprehensive Guide to Convolutional Neural Networks — the ELI5 way. Retrieved from https://towardsdatascience.com/a-comprehensive-guide-to-convolutional-neural-networks-the-eli5-way-3bd2b1164a53.
Brownlee, Jason. (2018, December 3). A Gentle Introduction to Dropout for Regularizing Deep Neural Networks. Retrieved from https://machinelearningmastery.com/dropout-for-regularizing-deep-neural-networks/.
Krizhevsky, A. (2009). Learning Multiple Layers of Features from Tiny Images.
Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, Ruslan Salakhutdinov. (2014, January 01). Dropout: a simple way to prevent neural networks from overfitting. Journal of Machine Learning Research 15, 2014. https://jmlr.org/papers/volume15/srivastava14a/srivastava14a.pdf.
Downloads
Posted
License
Copyright (c) 2021 Zuilho Segundo
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The copyright holder for this article has granted JSR.org a license to display the article in perpetuity.
