Random processes. Matlab What is a random process?
-
Upload
roderick-cross -
Category
Documents
-
view
241 -
download
2
Transcript of Random processes. Matlab What is a random process?
![Page 1: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/1.jpg)
Random processes
![Page 2: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/2.jpg)
Matlab
What is a random process?
![Page 3: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/3.jpg)
A random process
• Is defined by its finite-dimensional distributions– The probability of events at a finite number of time
points• The finite dimensional distributions have to be
‘consistent’– Integrating over one time point gives the finite-
dimensional distribution for the other time points• Given a consistent family of finite-dimensional
distributions on ‘good enough’ spaces, there is a unique process with those distributions (Kolmogorov)– ‘Good enough’ means Borel
![Page 4: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/4.jpg)
Stationarity and ergodicity
How to measure the resting membrane potential of a neuron?
![Page 5: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/5.jpg)
Stationarity and ergodicity
• I arrive this morning to the lab, prepare a neuron for recording and measure its membrane potential at 10am sharp. The value is -75.3 mV.
• Is this the resting potential of the neuron?
![Page 6: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/6.jpg)
Stationarity and ergodicity
• The measurement is noisy
• We want to have a number of repeats of the same measurement
• How to get repeated measurements?
![Page 7: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/7.jpg)
Stationarity and ergodicity
• Repeated measurement:– I arrive this morning a second time to the lab,
prepare a neuron for recording and measure its membrane potential at 10am sharp. The value is -80.9 mV.
• What is the problem?
![Page 8: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/8.jpg)
Stationarity and ergodicity
• Repeated measurement 1:– I arrive this morning to the lab 600 times,
prepare a neuron for recording and measure its membrane potential at 10am sharp.
• Repeated measurement 2:– I measure the membrane potential of the
same neuron as before once a second from 10:00 to 10:10 (I get 600 measurements)
![Page 9: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/9.jpg)
Go to Matlab
![Page 10: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/10.jpg)
Theoretically,
• Repeated measurement 1:– I arrive this morning to the lab 600 times,
prepare a neuron for recording and measure its membrane potential at 10am sharp.
• Repeated measurement 2:– I measure the membrane potential of the
same neuron as before once a second from 10:00 to 10:10 (I get 600 measurements)
![Page 11: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/11.jpg)
Practically,
• Repeated measurement 1:– I arrive this morning to the lab 600 times,
prepare a neuron for recording and measure its membrane potential at 10am sharp.
• Repeated measurement 2:– I measure the membrane potential of the
same neuron as before once a second from 10:00 to 10:10 (I get 600 measurements)
![Page 12: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/12.jpg)
What to do?
![Page 13: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/13.jpg)
Ergodicity
• For an ergodic process,– Averaging across many repeated trials
(repeated measurements 1)– Averaging across time for a single trial
(repeated measurements 2)– Are equal
• An ergodic process is always stationary, the reverse may not be true
![Page 14: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/14.jpg)
What makes a stationary process ergodic?
• Asymptotic independence
• Samples that are far enough in time are independent
![Page 15: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/15.jpg)
Correlation, independence, gaussian and non-gaussian
processes
![Page 16: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/16.jpg)
Independence vs. lack of correlation
• Two variables are independent if knowing anything about one of them doesn’t allow you to make any deductions that you couldn’t already make about the other one
• Two variables are uncorrelated if their covariance is 0
• Independence implies lack of correlation• Lack of correlation in general does not
imply independence
![Page 17: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/17.jpg)
Go to Matlab
![Page 18: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/18.jpg)
Independence vs. lack of correlation
• For variables that are jointly Gaussian, lack of correlation implies independence
• What are jointly Gaussian variables?
![Page 19: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/19.jpg)
Jointly Gaussian variables
• The distribution of each by itself is gaussian
• The joint distribution of each pair is gaussian
• The joint distribution of each triplet is gaussian
• …
• (allowing for degeneracy)
![Page 20: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/20.jpg)
Go to Matlab
![Page 21: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/21.jpg)
Jointly gaussian variables
• Because of the issue of degeneracy, the formal definition is indirect
• For example: random variables are jointly gaussian if all linear combinations are gaussian (allowing the degenerate case of identically 0 variables)
• Or using characteristic functions
![Page 22: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/22.jpg)
Characterizing jointly gaussian variables
• A 1-d Gaussian variable is fully characterized by its mean and variance
• These determine its probability density function and therefore all other quantifiers
• An n-d Gaussian variable is fully characterized by the mean of each component and their covariances
• These determine the joint probability density and therefore all other quantifiers
![Page 23: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/23.jpg)
Gaussian process
• A random process is gaussian if all finite-dimensional distributions are jointly gaussian
• A Gaussian process is determined by specifying the mean at each moment in time and a matrix of covariances between the values at different moments in time
• All finite-dimensional distributions are Gaussian, and are therefore determined by the above data
![Page 24: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/24.jpg)
Stationary Gaussian processes
• If the process is in addition stationary– The mean and variances are constant as a function of
time– the 2-d distributions do not depend on the absolute
time
• In that case, the covariance matrix is constant along the diagonals– ‘Toeplitz matrices’
• The covariance is specified by a function of the delay between samples
![Page 25: Random processes. Matlab What is a random process?](https://reader035.fdocuments.us/reader035/viewer/2022081421/56649f515503460f94c74f42/html5/thumbnails/25.jpg)
Stationary gaussian processes
• The autocovariance function is also called– Autocorrelation function– Covariance function– Correlation function– …
• Make sure you know the normalization (what is the value of the function at 0)