EECS 422: Random Processes in Communications and Control I
Winter 2013


Lecture 1Introduction, Probability spaces, properties of probability measures, conditional probability, independence.
Lecture 2Bayes' rule and inference, independent trials, discrete random variables and probability mass functions, cumulative distribution functions, continuous random variables and densities.
Lecture 3 Mixed and singular random variables, conditional distributions, functions of random variables, expected values.
Lecture 4Moments, Gaussian random variables, Markov's inequality, Chebyshev's inequality, Chernoff bounds, Moment Generating Functions.
Lecture 5Random vectors, joint cdfs, pdfs and pmfs, marginal distributions, independence.
Lecture 6 Conditional Distributions, functions of multiple random variables, sums of random variables, characteristic functions, linear transformations of random vectors, expectation and moments of random vectors, correlation and covariance.
Lecture 7Correlation coeeficients, jointly Gaussian random variables, Gaussian Random variables and linear transformations.
Lecture 8 Covariance matrices, conditioning and jointly Gaussian Random variables, conditional expectation, iterated expectation, introduction to estimation.
Lecture 9 Baysian MMSE estimation, estimation and jointly Gaussian random variables, LLSE estimation.
Lecture 10Orthogonality property of MMSE estimates, Discrete-time random processes, i.i.d. processes and laws of large numbers, mean square convergence, convergence in probability, Almost sure convergence.
Lecture 11Convergence in distribution, the central limit theorem.
Lecture 12Finite dimensional distributions and Kolmogorov's theorem, Stationary processes, memoryless processes, stationary increments, independent increments, Markov property, counting processes, random walks.
Lecture 13Markov chains: transition matrices/graphs, n-step transistions, first-step analysis.
Lecture 14Markov chains: state classification, stationary distribtuions.
Lecture 15Arrival processes/counting processes, Poisson processes.
Lecture 16Mean and correlation/covariance functions, wide sense stationary processes, Gaussian Processes, Wiener processes.
Lecture 17 Multiple random processes, cross correlation functions, Mean-square calculus.
Lecture 18 Mean-square integration, random processes and linear systems, power spectral density functions.
Lecture 19 Systems driven by white noise; optimal linear filtering; the non-causal Wiener filter; overview of related courses.

A list of lecture topics from 2012 can be found here.