Simple NN for pattern classification Supervised

1
Simple NN for pattern classificationSupervised
Rules/ Algorithm/ Technique
2
Linear Separability
3
Linear Separability
4
Linear Separability Response regions for the AND
function
5
Linear Separability Response regions for the AND
function
Desired response for the logic function AND
A possible decision boundary
6
Supervised - Feedback Nets

• Brain-State-in-a-Box (BSB)
• Fuzzy Congitive Map (FCM)
• Boltzmann Machine (BM)
• Mean Field Annealing (MFT)
• Recurrent Cascade Correlation (RCC)
• Learning Vector Quantization (LVQ)
• Backpropagation through time (BPTT)
• Real-time recurrent learning (RTRL)
• Recurrent Extended Kalman Filter (EKF)

7
Supervised- ). Feedforward-only Nets

• Perceptron
• Adaline, Madaline
• Backpropagation (BP)
• Cauchy Machine (CM)
• Adaptive Heuristic Critic (AHC)
• Time Delay Neural Network (TDNN)
• Associative Reward Penalty (ARP)
• Avalanche Matched Filter (AMF)
• Backpercolation (Perc)
• Artmap
• Adaptive Logic Network (ALN)
• Cascade Correlation (CasCor)
• Extended Kalman Filter(EKF) 

8
Unsupervised - Feedback Nets

• Additive Grossberg (AG)
• Shunting Grossberg (SG)
• Binary Adaptive Resonance Theory (ART1)
  
• Analog Adaptive Resonance Theory (ART2, ART2a)
  
• Discrete Hopfield (DH)
• Continuous Hopfield (CH)
• Discrete Bidirectional Associative Memory (BAM)
  
• Temporal Associative Memory (TAM)
• Adaptive Bidirectional Associative Memory (ABAM)
  
• Kohonen Self-organizing Map/Topology-preserving
  map (SOM/TPM)
• Competitive learning

9
Unsupervised - Feedforward-only Nets

• Learning Matrix (LM)
• Driver-Reinforcement Learning (DR)
• Linear Associative Memory (LAM)
• Optimal Linear Associative Memory (OLAM)
• Sparse Distributed Associative Memory (SDM)
• Fuzzy Associative Memory (FAM)
• Counterprogation (CPN) 

10
Hebb Net
11
Hebb Net
12
Hebb Net Algorithm
13
Hebb Net
14
Hebb Net Application Logic functions AND
15
Hebb Net Application Logic functions AND
16
Hebb Net Application Logic functions AND
Decision boundary for binary AND func. after
first training pair
17
Hebb Net Application Logic functions AND
18
Hebb Net Application Logic functions AND
19
Perceptron
20
Perceptron
21
Perceptron Architecture
Perceptron to perform single classification
22
Perceptron Algorithm
23
Perceptron Algorithm
24
Perceptron Algorithm
25
Perceptron Application Logic functions AND
26
Adaline
27
Adaline
28
Adaline Architecture
Architecture of an Adaline
29
Adaline Algorithm
30
Adaline Algorithm
31
Adaline Algorithm
32
Adaline Applications
33
Madaline
A MADALINE with two hidden ADALINEs and one
output ADALINE
34
Madaline
35
Madaline Algorithm
36
Madaline MRI Algorithm
37
Madaline MRI Algorithm
38
Madaline MRI Algorithm
39
Madaline MRII Algorithm
40
Madaline MRII Algorithm