Scribd
Upload
9 views25 pages

Algorithm of Neural Network M4

Uploaded by

Anushree Idekar
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
9 views25 pages

Algorithm of Neural Network M4

Uploaded by

Anushree Idekar
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 25

Algorithms of

Neural
Networks
M4-CONTI
Contents

• Basic concept of Machine learning


• Definition of machine learning
• Support Vector Machine
• SVM algorithm
• LMS algorithm
Basic concept of Machine learning

• Definition: Machine learning is a branch of artificial intelligence


(AI) and computer science which focuses on the use of data
and algorithms to imitate the way that humans learn, gradually
improving its accuracy.
• Types of Machine learning:
• Supervised learning
• Unsupervised learning
• Semi supervised learning
• Reinforcement learning
Supervised learning

• Supervised learning, also known as supervised machine learning, is defined


by its use of labelled datasets to train algorithms to classify data or predict
outcomes accurately.
• As input data is fed into the model, the model adjusts its weights until it has
been fitted appropriately.
• This occurs as part of the cross validation process to ensure that the model
avoids overfitting or underfitting.
• Supervised learning helps organizations solve a variety of real-world
problems at scale, such as classifying spam in a separate folder from your
inbox.
• Some methods used in supervised learning include neural networks, naïve
bayes, linear regression, logistic regression, random forest, and support
vector machine (SVM)
Unsupervised learning

• Unsupervised learning, also known as unsupervised machine learning, uses


machine learning algorithms to analyse and cluster unlabelled datasets.
• These algorithms discover hidden patterns or data groupings without the
need for human intervention.
• This method’s ability to discover similarities and differences in information
make it ideal for exploratory data analysis, cross-selling strategies,
customer segmentation, and image and pattern recognition.
• It’s also used to reduce the number of features in a model through the
process of dimensionality reduction. Principal component analysis (PCA)
and singular value decomposition (SVD) are two common approaches for
this.
• Other algorithms used in unsupervised learning include neural networks, k-
means clustering, and probabilistic clustering methods
Semi-Supervised learning

• Semi-supervised learning offers a happy medium solution


between supervised and unsupervised learning.
• During training, it uses a smaller labelled data set to guide
classification and feature extraction from a larger, unlabeled
data set.
• Semi-supervised learning can solve the problem of not having
enough labeled data for a supervised learning algorithm. It also
helps if it’s too costly to label enough data.
Reinforcement machine learning

• Reinforcement machine learning is a machine learning


model that is similar to supervised learning, but the
algorithm isn’t trained using sample data. This model
learns as it goes by using trial and error. A sequence of
successful outcomes will be reinforced to develop the
best recommendation or policy for a given problem.
Most popular machine learning method

• Supervised learning is the most popular learning method.


• Here data set is given by (x).
• We find the function: {f(x)} which is an output.
• The aim is to find {f(x)} for new data (x).
• If f(x) is discrete we use classification
• If f(x) is continuous we use Regression
• Probability estimation: if the output is in terms of probability
Application of Machine learning

• Search engines
• E-Commerce
• Weather forecasting
• Image processing
• Robotics
• Social Network
Support Vector Machine or SVM

• Support Vector Machine or SVM is one of the most popular


Supervised Learning algorithms, which is used for Classification as
well as Regression problems. However, primarily, it is used for
Classification problems in Machine Learning.
• The goal of the SVM algorithm is to create the best line or decision
boundary that can segregate n-dimensional space into classes so that
we can easily put the new data point in the correct category in the
future. This best decision boundary is called a hyperplane.
Hyperplane
• SVM chooses the extreme points/vectors
that help in creating the hyperplane. These
extreme cases are called as support
vectors, and hence algorithm is termed as
Support Vector Machine. Consider the
below diagram in which there are two
different categories that are classified using
a decision boundary or hyperplane
Example of SVM

• Example: Suppose we see a strange cat that also has some features of
dogs, so if we want a model that can accurately identify whether it is a cat
or dog, so such a model can be created by using the SVM algorithm.
• We will first train our model with lots of images of cats and dogs so that it
can learn about different features of cats and dogs, and then we test it with
this strange creature.
• So as support vector creates a decision boundary between these two data
(cat and dog) and choose extreme cases (support vectors), it will see the
extreme case of cat and dog. On the basis of the support vectors, it will
classify it as a cat. Consider the below diagram:
Example
Applications of SVM

• SVM algorithm can be used for Face detection, image classification,


text categorization, etc.
Types of SVM

• Linear SVM: Linear SVM is used for linearly separable data, which
means if a dataset can be classified into two classes by using a single
straight line, then such data is termed as linearly separable data, and
classifier used is called as Linear SVM classifier.
• Non-linear SVM: Non-Linear SVM is used for non-linearly separated
data, which means if a dataset cannot be classified by using a straight
line, then such data is termed as non-linear data and classifier used is
called as Non-linear SVM classifier
SVM based Binary classification

• If there are only two classes,this case is known as binary


classification.
• An optimal Hyperplane separates the two classes
• Example:classification of cats and Dogs
Optimal Hyperplane for Linearly separable
pattern.

• Let Xi be the input patterns


• Let di be the desired output patterns
• Let us use “n” training samples ie.{[xi,di ]} where i=1,2,…..n
• Let us represent two patterns in the bipolar form
• Ie.di =+1 and di =-1 and they are linearly separable
• The decision hyperplane is WT x+b=0
• If we write WT x+b≥0 for di =+1 and WT x+b<0 for di =-1 The
separation between the hyperplane and the closest data
point is called margin of separation.
Conti…………..

• Let us consider that Wo as the optimum weight and boas


the optimum bias.
• Then decision hyperplane can be return as WoTx+bo=0
• Let g(x)= WoTx+bo =r 𝑊𝑜 = where “r” is the algebraic
distance and given by
𝑔(𝑥)
•𝑟=
𝑊𝑜
Least Mean Square (LMS) algorithm

• LMS algorithm uses the estimates of the gradient vector from the
available data. LMS incorporates an iterative procedure that makes
successive corrections to the weight vector in the direction of the
negative of the gradient vector which eventually leads to the
minimum mean square error.
• LMS algorithm estimates the cost
Steepest
Descent
Algorithm
Advantages of LMS

• Low computational complexity


• Simple to implement
• Allows real time operation
• Does not need statistic signals such as Rxx….
Disadvantages of LMS

• Slow rate of convergence


• No of iterations required is more.

You might also like