Soft computing

BY:
ARUN PRASAD K.M.
Assistant Professor
Model Engineering College
27-Jan-15

Soft computing techniques

Artificial Neural Networks (ANN)

Fuzzy Logic

Genetic Algorithms

27-Jan-15

Reference Books
S.N. Shivnandam, Principle of soft computing,
Wiley.
S. Rajshekaran and G.A.V. Pai, Neural Network
, Fuzzy logic And Genetic Algorithm, PHI.
Jack M. Zurada, Introduction to Artificial Neural
Network System JAico Publication.
Simon Haykins, Neural Network- A
Comprehensive Foudation
Timothy J.Ross, Fuzzy logic with Engineering
Applications, McGraw-Hills 1.
27-Jan-15

Artificial neural network

Human brain is a highly complex, nonlinear,
and parallel information processing system

Human Brain is made up of cells called Neurons

27-Jan-15

Syllabus
Module 1
Introduction to Neural Network: Concept,
biological neural network, evolution of artificial
neural network, McCulloch-Pitts neuron models,
Learning (Supervise & Unsupervise) and activation
function, Models of ANN-Feed forward network and
feed back network, Learning Rules- Hebbian,
Delta, Perceptron Learning and Windrow-Hoff,
winner take all.
27-Jan-15

Brain Computer: What is it?

Human brain contains
a massively
interconnected net of
1010-1011 (10 billion)
neurons (cortical
cells)

Biological
Neuron
- The simple
arithmetic
computing
element

BIOLOGICAL NEURON

27-Jan-15

BIOLOGICAL NEURON

27-Jan-15

BIOLOGICAL NEURON
In the human brain, a typical neuron collects
signals from others through a host of fine
structures called dendrites.
The neuron sends out spikes of electrical
activity through a long, thin strand known as
an axon, which splits into thousands of
branches.
At the end of each branch, a structure called
a synapse converts the activity from the
axon into electrical effects that inhibit or
excite activity from the axon into electrical
effects in the connected neurons.
27-Jan-15

27-Jan-15

10

The Artificial Neuron model

27-Jan-15

11

The analogy between HUMAN

NEURON and the ANN
Human

Artificial

Neuron

Processing Element

Dendrites

Combining Function

Cell Body

Transfer Function

Axons
Synapses
27-Jan-15

Element Output
Weights
12

Activation Functions
1.
2.
3.
4.
5.

Threshold
Signum
Sigmoid
Hyperbolic tangent (tanh)
Piece-wise linear

27-Jan-15

13

1.Threshold function

27-Jan-15

14

2.Signum Function

27-Jan-15

15

3.Sigmoid Function

27-Jan-15

16

4.Hyperbolic Tangent

27-Jan-15

17

5.Piece-wise linear

27-Jan-15

18

Applications of Artificial
Neural Networks

27-Jan-15

Speech Recognition
Pattern Recognition
Signal processing
Text to speech Conversion
Robotics
Control
Medical diagnosis
Stock Market Prediction
Sales Forecasting
Energy Demand Forecasting
Parameter Estimation

19

Mc-Culloch and Pitts Model

For Mc-Culloch & Pitts Model, the activation function is

Threshold or signum
27-Jan-15

20

27-Jan-15

21