Incorrect Recall of BAM

Consider the pattern pairs in bipolar form as

x1=[-1 -1 -1 1 1 1 -1 -1 1]; y1=[-1 1 -1 -1 -1 -1 1 1 1];
x2=[1 1 1 -1 -1 1 1 1 -1]; y2=[1 -1 -1 -1 -1 -1 -1 -1 1]
x3=[1 1 -1 1 1 -1 1 -1 1] y3=[1 -1 1 -1 -1 1 -1 1 -1]

W=x1T*y1+x2 T *y2+x3 T *y3

W=

3 -3 1 -1 -1 1 -3 -1 -1
3 -3 1 -1 -1 1 -3 -1 -1
1 -1 -1 1 1 -1 -1 -3 1
-1 1 1 -1 -1 1 1 3 -1
-1 1 1 -1 -1 1 1 3 -1
-1 1 -3 -1 -1 -3 1 -1 3
3 -3 1 -1 -1 1 -3 -1 -1
1 -1 -1 1 1 -1 -1 -3 1
-1 1 1 -1 -1 1 1 3 -1

Let us feed α =x2 =[1 1 1 -1 -1 1 1 1 -1], hoping to retrieve y2.

Then, αW = [13 -13 -5 1 1 -5 -13 -19 5]

β = f(αW) = [1 -1 -1 1 1 -1 1 -1 -1 -1 1]

Hamming distance between x2 and β is

HD(x2, β) = 4 ≠ 0. Hence, y2 is not retrieved in this step.

Again, βWT= [5 5 11 -11 -11 5 5 11 -11]

α’ = f(βWT) = [1 1 1 -1 -1 1 1 1 -1], which is same as α.

Then, again α’W=[13 -13 -5 1 1 -5 -13 -19 5]

β’ = f(α’W) = [1 -1 -1 1 1 -1 -1 -1 1]
=β which is not y2 at all (converged without recall).
Hence, the cycle terminates without correct retrieve.

Energy values for the pairs:

E(x2, y2) = - x2*W*y2T = -71
E(α’, β’) = - β’*W* β’T = -75
That means (x2,y2) pairs do not constitute the energy minimum point, hence not recalled
correctly.

Multiple Training Encoding Strategy (MTES)

Wang et al., (1990)1 proposed the MTES which is an enhancement of the encoding
strategy purposed by Kosko. The correlation matrix obtained according to Kosko’s
method is generalized as

W= Xi

where qi are positive real numbers.

By suitable selection of q, the energy functional value can be reduced to arbitrarily low
value.

Let us consider the same example just described above, which was not recalled by
Kosko’s correlation matrix.

For three pair of data pattern, choose q1= 1, q2=2 and q3=3.

Then, generalized correlation matrix will be

W= x1T*y1+2 * x2 T *y2+x3 T *y3 =

4 -4 0 -2 -2 0 -4 -2 0
4 -4 0 -2 -2 0 -4 -2 0
2 -2 -2 0 0 -2 -2 -4 2
-2 2 2 0 0 2 2 4 -2
-2 2 2 0 0 2 2 4 -2
0 0 -4 -2 -2 -4 0 -2 4
4 -4 0 -2 -2 0 -4 -2 0
2 -2 -2 0 0 -2 -2 -4 2
-2 2 2 0 0 2 2 4 -2

Take α =x2 =[1 1 1 -1 -1 1 1 1 -1],

αW = [22 -22 -14 -8 -8 -14 -22 -28 14]

β = f(αW) = [1 -1 -1 -1 -1 -1 -1 -1 1], which is the expected y2.

Take, α =x1 =[-1 -1 -1 1 1 1 -1 -1 1] , to recall y1.

αW = [-22 22 6 4 4 6 22 24 -6]
β = f(αW) = [-1 1 1 1 1 1 1 1 -1], which is not the expected y1.
Hence, the generalized correlation matrix is modified choosing q1=q2=2 & q3=1. Then,
W= 2* x1T*y1+2 * x2 T *y2+2*x3 T *y3 =

5 -5 1 -1 -1 1 -5 -3 -1
5 -5 1 -1 -1 1 -5 -3 -1
3 -3 -1 1 1 -1 -3 -5 1
1
Wang Y.F, Jose B.C Jr. and James H.M. Jr (1990). On Multiple Training for Bidirectional Associative
Memory, Letters, IEEE Transaction on Neural Network,Vol. 1 No.3, pp275-76.
 -3 3 1 -1 -1 1 3 5 -1
-3 3 1 -1 -1 1 3 5 -1
-1 1 -5 -3 -3 -5 1 -1 5
5 -5 1 -1 -1 1 -5 -3 -1
3 -3 -1 1 1 -1 -3 -5 1
-3 3 1 -1 -1 1 3 5 -1

Take, α =x1 =[-1 -1 -1 1 1 1 -1 -1 1] , to recall y1.

αW = [-31 31 -3 -5 -5 -3 31 33 3]
β = f(αW) = [-1 1 -1 -1 -1 -1 1 1 1], which is our y1.

Take, α =x2 =[1 1 1 -1 -1 1 1 1 -1], to recall y2.

αW = [29 -29 -7 -1 -1 -7 -29 -35 7]
β = f(αW)= [1 -1 -1 -1 -1 -1 -1 -1 1] , which is y2.
Take, α =x3 =[1 1 -1 1 1 -1 1 -1 1], to recall y3.
αW = [1 -1 13 -5 -5 13 -1 17 -13]
β = f(αW)= [1 -1 1 -1 -1 1 -1 1 -1] , which is y3.

Energy function with final wt. matrix

E(x2,y2) = - x2 * W* y2T = -145 which is lower than before.