MMath Mathematics

Year of entry: 2024

Course unit details:
Linear Models with Nonparametric Regression

Course unit fact file
Unit code MATH48011
Credit rating 15
Unit level Level 4
Teaching period(s) Semester 1
Offered by Department of Mathematics
Available as a free choice unit? No

Overview

In many areas of science, technology, social science and medicine one often wishes to explore the relationship between one observable random response and a number of 'factors' which may influence simultaneously the response. The techniques developed to study such relationships fall in three broad categories:

  • Regression Analysis where the influence of the factors is quantitative;
  • Analysis of Variance where each factor's influence is qualitative; and
  • Analysis of Covariance where both qualitative and quantitative factors are present.

However, these three valuable techniques can be studied together as special cases of a unified theory of Linear Models. The course starts with a study of estimation and hypothesis testing in the general linear problem. Once the principles and techniques are established practical applications in the three types of analysis are examined in greater detail.

Nonparametric regression provides a very flexible approach to exploring the relationship between a response and an associated covariate but without having to specify a parametric model. The different techniques available are essentially based on forms of local averaging controlled by the value of a smoothing parameter. In this part of the module we will study a few different techniques, along with their statistical properties. We will also look briefly at how such estimators can be used in more inferential procedures.

Pre/co-requisites

Unit title Unit code Requirement type Description
Linear Algebra A MATH10202 Pre-Requisite Compulsory
Linear Algebra B MATH10212 Pre-Requisite Compulsory
Probability 2 MATH20701 Pre-Requisite Compulsory
Statistical Methods MATH20802 Pre-Requisite Compulsory
MATH48011 pre-requisites

Students are not permitted to take more than one of MATH48011 or MATH68011 for credit in an undergraduate programme and then a postgraduate programme, as the contents of the courses overlap significantly.

Aims

  • To introduce the theory and application of linear models, including multiple regression, analysis of variance and analysis of covariance
  • To introduce the theory and application of nonparametric regression techniques, with a focus on local polynomial regression

Learning outcomes

On successful completion of this course unit students will be able to: 

  • estimate the regression relationship between covariates and response variables using both linear modelling and nonparametric techniques, making use of appropriate transformations where necessary,
  • explain key ideas underpinning parametric and nonparametric approaches, such as the impact of colinearity in linear modelling and how to select an appropriate value of the smoothing parameter in nonparametric problems,
  • make inferences about the fit of a linear model, the values of its parameters, and of simple functions of the parameters, using confidence intervals and hypothesis tests,
  • derive key theoretical properties of both parametric and nonparametric estimators, such as the form of the estimators and their asymptotic mean squared error,
  • use the statistical software R to analyse real data using both parametric and nonparametric approaches.

 

Syllabus

Linear Models

  • General Linear Models: Least squares estimators (l.s.e) and their properties. Residuals and residual sum of squares. Leverage. Distribution of l.s.e and of the residual sum of squares. [5]
  • The general linear hypothesis. Extra sum of squares, sequential sum of squares, partial sum of squares. The test statistic of the general linear hypothesis and its distribution. Confidence intervals and prediction intervals. [5]
  • Linear regression: Simple regression, multiple regression, dummy variables and analysis of covariance. [6]
  • Analysis of Variance. One and two way analysis of variance. Use of comparisons. Interactions. [6]

Nonparametric Regression

  • Least squares regression, local averaging. [2]
  • Local polynomial kernel regression. [3]
  • Choosing the value of the smoothing parameter. [1]
  • Variability bands, checking the validity of a parametric regression model. [3]
  • Introduction to spline regression. [2]

Assessment methods

Method Weight
Other 20%
Written exam 80%
  • Take-home coursework: weighting 20%
  • End of semester examination: weighting 80%

Feedback methods

Feedback tutorials will provide an opportunity for students' work to be discussed and provide feedback on their understanding.  Coursework or in-class tests (where applicable) also provide an opportunity for students to receive feedback.  Students can also get feedback on their understanding directly from the lecturer, for example during the lecturer's office hour.
 

Recommended reading

  • Core/essential: none

Recommended:

  • Weisberg, S. (2005) Applied linear regression. Wiley.
  • Montgomery, D.C., Peck, E.A. and Vining, G.G. (2012) Introduction to linear regression analysis. Wiley.
  • Rawlings, J.O. (1998) Applied regression analysis: a research tool.  Wadsworth and Brooks/Cole.
  • Bowman, A.W. and Azzalini, A. (1998) Applied Smoothing Techniques for Data Analysis. Oxford University Press.
  • Wand, M.P. and Jones, M.C. (1995) Kernel Smoothing. Chapman and Hall. 
  • Eubank, R.L. (1999) Nonparametric regression and spline smoothing. Dekker.
  • Hardle, W. (1990) Applied Nonparametric Regression. Cambridge University Press.

Study hours

Scheduled activity hours
Lectures 33
Tutorials 11
Independent study hours
Independent study 106

Teaching staff

Staff member Role
Timothy Waite Unit coordinator

Additional notes

This course unit detail provides the framework for delivery in 20/21 and may be subject to change due to any additional Covid-19 impact.  

Please see Blackboard / course unit related emails for any further updates.

Return to course details