PROBABILITY AND STATISTICS

 

Ma 527

 

 

Course Description

 

Prefaced by a study of the foundations of probability and statistics, this course is an extension of the elements of probability and statistics introduced in an undergraduate course.  Topics include: unlimited sequences, random variables, expectation, law of large numbers and generating functions. 3 credits. 

 

Goals of the Course

 

1.       To teach a knowledge of combinatorial reasoning.

 

2.       To increase the student's appreciation of how combinatorial reasoning differs from other approaches to proof and problem solving.

 

3.       To teach a knowledge of random variables that forms a basis for studying the most useful distributions.

 

4.       To increase the student's ability to prove theorems.

 

5.       To improve the student's ability to apply the calculus.

 

6.       To introduce the student to common notations for summations and products.

 

7.       To increase the student's ability to use calculators and computers.

 

8.       To encourage the student to attack interesting problems not presented in class.

 

9.       To encourage the student to use criteria of consistency and reasonableness in evaluating his solutions to problems.

 

10.       To apply the knowledge of probability and random variables to sampling distributions, estimation theory, and hypothesis testing.

 

11.       To understand the mathematical model and assumptions which underlie regression and correlation and the analysis of variance.

 

12.       To solve problems using commonly available statistical packages.

 

Instructional Procedures

  1. Lecture/Discussion
  2. Step-by-step problem calculations with calculators or computers.
  3. Cooperative assignments.
  4. Student critiques of erroneous solutions.
  5. Daily homework assignments

 

Course Content

 

  1. Combinatorics

1.      Combinatorial methods

2.      Binomial coefficients

 

  1. Probability

1.      Sample spaces

2.      Events

3.      Probability of an event

4.      Some rules of probability

5.      Conditional probability

6.      Independent events

7.      Bayer’ Theorem

 

  1. Probability Distributions & Probability Densities

1.      Discrete random variables and probability distributions

2.      Continuous random variables and probability density functions

3.      Multivariate distributions

4.      Marginal distributions

5.      Conditional distributions

 

  1. Mathematical Expectation

1.      Expected value of a random variable

2.      Moments

3.      Chebyshev’s Theorem

4.      Moment-generating functions

5.      Product moments

6.      Moments of linear combinations of random variables

7.      Conditional expectations

 

  1. Special Probability Distributions

1.      Discrete uniform distribution

2.      Bernoulli distribution

3.      Binomial distribution

4.      Negative binomial & geometric distributions

5.      Multinomial distribution

 

  1. Special Probability Densities

1.      Uniform density

2.      Normal distribution

3.      Normal approximation to the binomial distribution

 

  1. Functions of Random Variables

1.      Distribution function techniques

2.      Transformation technique: one variable

3.      Transformation technique: two variables

4.      Moment-generation function technique

 

  1. Sampling Distributions
    1. Distribution of the mean
    2. The Chi-square distribution
    3. The t distribution
    4. The F distribution
    5. The Poisson distribution

 

  1. Point Estimation

1.      Point estimation

2.      Unbiased estimators

3.      The Method of moments

4.      The Method of maximum likelihood

 

  1. Interval Estimations
    1. Confidence intervals for means
    2. Confidence intervals for difference in means
    3. Confidence intervals for proportions
    4. Confidence intervals for differences in proportions
    5. Confidence intervals for variances
    6. Confidence intervals for ratios of two variances

 

  1. Hypothesis Testing Theory

1.      Testing a statistical hypothesis

2.      Losses and risks

3.      Power function of a test

 

  1. Hypothesis Testing: Applications
    1. Tests concerning means
    2. Differences between means
    3. Tests concerning variances
    4. Tests concerning proportions
    5. Differences among K proportions
    6. r x c tables
    7. Goodness of fit

 

 

  1. Regression and Correlation

1.      Linear Regression

2.      Method of least squares

3.      Normal regression analysis

4.      Normal correlation analysis

5.      Multiple Linear regression (opt)

6.      Multiple Linear regression (Matrix notation)

 

  1. Analysis of Variance

1.      One-way anova; uses of variance

2.      Two-way analysis of variance

 

Evaluations methods

  1. Daily homework assignments. Students are expected to do their assignments and be prepared to discuss the problems in class.
  2. Special take-home problems. Problems will be counted collectively as an additional test.
  3. Quizzes. Quizzes will be counted collectively as an additional test. Quizzes will be given when necessary.
  4. Tests. Tests will be given every three to four weeks. The results will be discussed in class.
  5. Comprehensive final exam. This will test whether the student has finally learned to do the problems which are representative of the course and to what extent he possesses these skills at the conclusion of the course.

 

Tests                            2/3

Final Exam                   1/3

 

* Grading procedures vary with Instructor.

 

Bibliography

 

Required Text:        Walpole, Myers, Myers, Ye, Probability and Statistics for Engineers and Scientists, 7th Ed., Upper Saddle River, N.J., Prentice Hall, 2002.

 

Cramer, H., Mathematical Methods of Statistics, Princeton, N.J., Princeton University Press, 1950 (in print 1988-1989).

 

Feller, W., An Introduction to Probability Theory and its Applications,

Volume I, 3rd Ed., New York, N.Y., John Wiley & Sons, 1968.

 

Freund, John E., Mathematical Statistics, 6th Ed., Englewood Cliffs, N.J., Prentice-Hall, 1999.

 

Freund, John /e. & Miller, I., Probability and Statistics for Engineers, 3rd Ed., Englewood Cliffs, N.J., Prentice-Hall, 1985.

 

Hogg, Robert V. & Craig, Allen T., Introduction to Mathematical Statistics, 5th Ed., Englewood Cliffs, N.J. Prentice-Hall, 1995.

 

Hogg, Robert V. & Tanis, Elliot A., Probability and Statistical Inference, 3rd Ed., Macmillan Publishing Co., 1988.

 

Lehmann, E.L., Theory of Point Estimation, New York, N.Y., John Wiley & Sons, 1983.

 

Lindgren, B.W., Statistical Theory, 2nd Ed, New York, N.Y., Macmillan Publishing Co., 1989.

 

Port, Probability and Its Applications, New York, N.Y., John Wiley & Sons, 1988.

 

Rosenkrantz, Walter A., Introduction to Probability and Statistics for Scientists and Engineers, McGraw-Hill, 1997.

 

Scheffe, H., The Analysis of Variance, New York, N.Y., John Wiley & Sons, 1959 (in print 1988-1989).

 

Watanabe, S. & Prokhorov, Y.V., Probability Theory and Mathematical Statistics, Springer-Verlag, 1988.

 

Weisberg, S., Applied Linear Regression, 2nd Ed., New York, N.Y., John Wiley & Sons, 1985.

 

Software

 

            Schaefer, Robert & Anderson, Richard Anderson, Student Edition of MINITAB, Released 9.5, Addison-Wesley, Reading MA., 1996.