Professional Documents
Culture Documents
Outline of Topics
3 / 14
4 / 14
Networks of Neurons
Neurons compose networks
5 / 14
6 / 14
Spike Trains
The collection of the action potential occurrences compose the spike train
7 / 14
Neural Code
Neural code is likely to directly represent information just memorized or recalled; In the late 40s Donald Hebb postulated that sequences of neural activations could be expressions of memory traces (cell assemblies). The neural activity of each neuron is strongly inuenced by the activities of thousands other neurons. Therefore, to identify cell assemblies is hard task. Common approaches are based on correlation analyses but fails in presence of noise, i.e. the product of other neural interactions.
8 / 14
Symbol Sources
Neural activities can be considered as unknown discrete symbol sources S = , P where is the source alphabet and P is the unknown symbol probability distribution. A VOMM outlines the possibility to take in consideration only transition probabilities that eectively appear in an examined sequence. Namely, there exist p ( |ck ) with k {1, 2, . . . , K } only for the ck contexts encountered in the training sequence, where K is the maximum order of temporal dependency allowed.
9 / 14
An example of VLMCs
Suppose that we observe the sequence T = x x x = x 11 = abracadabra generated by the source x1 1 2 T 1 S = , P with = {a, b, c, d, r}. Then, we let K = 2. To build a VOMM for this sequence, we need to estimate the symbol through the estimation of probability distribution P with P conditional probabilities p ( |s ) such that s is a subsequence of T . Thus, we rst extract the contexts of length 1 that trivially x1 are the alphabet symbols and then we proceed with contexts of length 2 that are s {ab, br, ra, ca, ac, ad, da}.
11 / 14
Prex Trees
Ecient data structures that help to estimate the conditional probabilities for a given sequence are the Prex Trees. These data structures store in their nodes every prex of a given sequence. Recalling the previous toy example, we can build a prex ||-ary 11 = abracadabra that is tree with depth K for sequence x1
12 / 14
...
13 / 14
14 / 14