Scribd
Upload
30 views1 page

CS25B7

This document outlines the objectives and units of a course on deep learning. The course covers the basics of machine learning, neural networks, and deep learning techniques. It examines major topics in deep learning and dimensionality reduction. The objectives are to present challenges of building neural networks, study concepts of deep learning, introduce dimensionality reduction techniques, and examine case studies of deep learning applications.

Uploaded by

srigvp
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOC, PDF, TXT or read online on Scribd
30 views1 page

CS25B7

This document outlines the objectives and units of a course on deep learning. The course covers the basics of machine learning, neural networks, and deep learning techniques. It examines major topics in deep learning and dimensionality reduction. The objectives are to present challenges of building neural networks, study concepts of deep learning, introduce dimensionality reduction techniques, and examine case studies of deep learning applications.

Uploaded by

srigvp
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOC, PDF, TXT or read online on Scribd
You are on page 1/ 1

CS25B7 DEEP LEARNING 3003

OBJECTIVES:
This course covers the basics of machine learning, neural networks and deep learning. Model for deep
learning technique and the various optimization and generalization mechanisms are included. Major topics
in deep learning and dimensionality reduction techniques are covered. The objective of this course is:
 To present the mathematical, statistical and computational challenges of building neural networks
 To study the concepts of deep learning
 To introduce dimensionality reduction techniques
 To enable the students to know deep learning techniques to support real-time applications
 To examine the case studies of deep learning techniques
UNIT I INTRODUCTION 9
Introduction to machine learning- Linear models (SVMs and Perceptrons, logistic regression)- Intro to
Neural Nets: What a shallow network computes- Training a network: loss functions, back propagation and
stochastic gradient descent- Neural networks as universal function approximates
UNIT II DEEP NETWORKS 9
History of Deep Learning-A Probabilistic Theory of Deep Learning-Backpropogation and
regularization,batch normalization-VC Dimension and Neural Nets-Deep Vs Shallow Networks-
Convolutional Networks-Generative Adversarial Networks(GAN),Semi-supervised Learning.

UNIT III DIMENTIONALITY REDUCTION 9


Linear (PCA,LDA) and manifolds, metric learning-Auto encoders and dimensionality reduction in
networks-Introduction to convent -Architectures-AlexNet, VGG, Inception. ResNet-Training a convnet:
weights initialization, batch normalization, hyper parameter optimization.
UNIT IV OPTIMIZATION AND GENERALIZATION 9
Optimization in deep learning-Non-convex optimization for deep networks-Stochastic Optimization-
Generalization in neural networks-Spatial Transformer Networks-Recurrent networks,LSTM-Recurrent
Neural Network Language Models-Word Level RNNs & Deep Reinforcement Learning-Computational &
Artificial Neuroscience.
UNIT V CASE STUDY AND APPLICATIONS 9
Imagenet Detection-Audio WaveNet-Natural Language Processing Word2Vec-Joint Detection-
BioInformatics-Face Recognition-Scene Understanding-Gathering Image Captions
REFERENCES
1. Cosma Rohilla Shalizi, Advanced Data Analysis from an Elementary Point of View, 2015.
2. Deng & Yu, Deep Learning: Methods and Applications, Now Publishers, 2013.

3. Ian Goodfellow, Yoshua Bengio, Aaron Courville, Deep Learning, MIT Press, 2016.

4. Michael Nielsen, Neural Networks and Deep Learning, Determination Press, 2015

You might also like