You are on page 1of 14

Outline Biological Background Motivations Mathematical Model Results

Outline Biological Background Motivations Mathematical Model Results

Outline of Topics

Outline Biological Background Motivations Mathematical Model Results

The Brain and Neurons


The Brain as a computational device

3 / 14

Outline Biological Background Motivations Mathematical Model Results

The Brain and Neurons


Among the brain cells, neurons are the main characters and the fundamental functional unit for information processing

4 / 14

Outline Biological Background Motivations Mathematical Model Results

Networks of Neurons
Neurons compose networks

5 / 14

Outline Biological Background Motivations Mathematical Model Results

Electrophysiological Recordings and Spike Sorting


Neural activity can be tracked by means of micro-electrodes matrices which capture activities of several neurons; the spike sorting procedure separate the activity of each neurons; the neural event of action potential represents the information carrier

6 / 14

Outline Biological Background Motivations Mathematical Model Results

Spike Trains

The collection of the action potential occurrences compose the spike train

7 / 14

Outline Biological Background Motivations Mathematical Model Results

Neural Code

Neural code is likely to directly represent information just memorized or recalled; In the late 40s Donald Hebb postulated that sequences of neural activations could be expressions of memory traces (cell assemblies). The neural activity of each neuron is strongly inuenced by the activities of thousands other neurons. Therefore, to identify cell assemblies is hard task. Common approaches are based on correlation analyses but fails in presence of noise, i.e. the product of other neural interactions.

8 / 14

Outline Biological Background Motivations Mathematical Model Results

Symbol Sources

Neural activities can be considered as unknown discrete symbol sources S = , P where is the source alphabet and P is the unknown symbol probability distribution. A VOMM outlines the possibility to take in consideration only transition probabilities that eectively appear in an examined sequence. Namely, there exist p ( |ck ) with k {1, 2, . . . , K } only for the ck contexts encountered in the training sequence, where K is the maximum order of temporal dependency allowed.

9 / 14

Outline Biological Background Motivations Mathematical Model Results

Variable Length Markov Chains


Let {Xt }t N be a stationary stochastic process with values Xt , || < . Let K be the maximum allowed order with 0 K and let c () be the function that establish the order s for any given context xij = xi xi +1 . . . xj with j < i and i , j N, so that P {Xt = xt |Xt 1 = xt 1 , Xt 2 = xt 2 , . . . } = P {Xt = xt |Xt 1 = xt 1 , . . . , Xt s = xt s }
1 with s = c (Xtt K ). Then {Xt } is called the Variable Length Markov Chain of order K .

B uhlmann P, Wyner AJ (1999). The Annals of Statistics 27(2):480-513.


10 / 14

Outline Biological Background Motivations Mathematical Model Results

An example of VLMCs

Suppose that we observe the sequence T = x x x = x 11 = abracadabra generated by the source x1 1 2 T 1 S = , P with = {a, b, c, d, r}. Then, we let K = 2. To build a VOMM for this sequence, we need to estimate the symbol through the estimation of probability distribution P with P conditional probabilities p ( |s ) such that s is a subsequence of T . Thus, we rst extract the contexts of length 1 that trivially x1 are the alphabet symbols and then we proceed with contexts of length 2 that are s {ab, br, ra, ca, ac, ad, da}.

11 / 14

Outline Biological Background Motivations Mathematical Model Results

Prex Trees

Ecient data structures that help to estimate the conditional probabilities for a given sequence are the Prex Trees. These data structures store in their nodes every prex of a given sequence. Recalling the previous toy example, we can build a prex ||-ary 11 = abracadabra that is tree with depth K for sequence x1

12 / 14

Outline Biological Background Motivations Mathematical Model Results

...

13 / 14

Outline Biological Background Motivations Mathematical Model Results

14 / 14

You might also like