| Lecture | Date | Topics and Textbook Section(s) |
| 1 | Jan. 4 |
Introduction to course;
1.1-1.2. |
| 2 | Jan 6 |
Sample spaces, events, notions of probability;
1.3, 2.1, 2.2 |
| 3 | Jan. 8 |
Class cancelled due to the "Ottawa trip"
|
| 4 | Jan. 11 |
Set theory, axiomatic definition of probability-corollaries;
2.1,2.2 |
| 5 | Jan. 13 |
Probability space as a triple(Sample Space, Event Space, Pro
bability Measure);
2.1,2.2 |
| 6 | Jan. 15 |
Class cancelled due to the "Snow Storm"
|
| 7 | Jan. 18 |
Counting methods; Sampling with and without replacement or ordering;
Binomial coefficient;
2.3 |
| 8 | Jan. 20 |
Conditional and total probability;Independence of events; Examples;
2.4, 2.5 |
| 9 | Jan. 22 |
Bayes rule; Sequencial Experiments; Bernoulli Trials; Examples;
2.5, 2.6 |
| 10 | Jan. 25 |
Sequencial Experiments;Markov Chains; Examples;
2.6 |
| 11 | Jan 27 |
The concept of a real random variable;
the Cumulative Distribution Function (cdf);
3.1, 3.2 |
| 12 | Jan 29 |
Properties of the Cumulative Distribution Function;
The Probability Density Function (pdf); Examples;
3.2, 3.3 |
| 13 | Feb 1 |
Conditional CDF and pdf; Discrete random variables: Bernoulli, Binomial; Geometric;
3.4 |
| 14 | Feb 3 |
Class cancelled due to "Visionary Seminar".
|
| 15 | Feb 5 |
Discrete random variables: Poisson r.v.;
Relation between Binomial and Poisson rvs.;
3.4 |
| 16 | Feb. 8 |
Continuous rvs: Uniform r.v. Exponential r.v; Relation between Geometric and Exponential r.vs; Gaussian r.v.;
3.4 |
| 17 | Feb. 10 |
Functions of a random variable; Examples;
3.5 |
| 18 | Feb. 12 |
Functions of a random variable - Fundamental Theorem; Examples;
3.5 |
| 19 | Feb. 22 |
Review class
|
| 20 | Feb. 24 |
Expected value of a r.v.; The mean and variance;
3.6 |
| 21 | Feb. 26 |
Moments of a r.v; Examples on signal detection and estimation;
3.6 |
| 22 | March 1 |
Markov and Chebyshev inequalities; Examples on parameter estimation -Unbiased and consistent estimators;
3.7 |
| 23 | March 3 |
Characteristic function of a r.v.; Moment theorem;examples;
3.9 |
| 24 | March 5 |
Pairs of r.vs; Joint distribution and density functions;
4.2 |
| 25 | March 8 |
More examples on pairs of r.vs; independence of r.vs;
4.1, 4.2, 4.3 |
| 26 | NMarch 10 |
Jointly Gaussian r.v.s;
Conditional distributions and densities; Examples
4.4 |
| 27 | March 12 |
Conditional expectation; Examples; Mean-Square-Estimation;
4.4, 4.9 |
| 28 | March 15 |
One fuction of two random variables; Examples;
4.6 |
| 29 | March 17 |
Two fuctions of two random variables; Fundamental Theorem;
Auxiliary variable method;
4.6 |
| 30 | March 19 |
Expected values of functions of r.vs; Joint moments;
Correlation, orthogonality,independence or r.vs
4.7 |
| 31 | March 22 |
Schwarz Inequality; Covariance and correlation matrices; Examples
4.7 |
| 32 | March 24 |
Affine/linear transformations of Gaussian vectors (two r.v.s); Linear prediction;
4.8, 4.9 |
| 33 | March 26 |
Multiple random variables (more than two);
Definitions and properties;
4.5, 4.6 |
| 34 | March 29 |
Multiple random variables (more than two);
The fundamental theorem; Applications to linear filtering;
4.5, 4.6 |
| 35 | March 31 |
Multiple random variables (more than two);
Correlation and Covariance matrices; Applications to linear prediction;
4.5, 4.6, 4.9 |
| April 2 |
No lecture (Good Friday) |
| 36 | April 5 |
Sums and sequences of random variables; Sample mean and variance;
5.1, 5.2 |
| 37 | April 7 |
Law of large numbers; The central limit theorem
5.2, 5.3 |
| 38 | April 9 |
Review class; Material required in final exam.
|