Lecture 11 – Introduction to Modeling
Presented by Fernando Perez and Suraj Rampure
Content by Fernando Perez, Suraj Rampure, Ani Adhikari, Deborah Nolan, Joseph Gonzalez
A random one of the following Google Forms will give you an alphanumeric code once you submit; you should take this code and enter it into the “Lecture 11” question in the “Quick Check Codes” assignment on Gradescope to get credit for submitting this Quick Check. You must submit this by Monday, October 5th at 11:59PM to get credit for it.
Motivating examples of models.
Defining the constant model. Formalizing the notion of a parameter.
Loss functions and their purpose. Squared loss and absolute loss. Minimizing average loss (i.e. empirical risk).
Minimizing mean squared error for the constant model using calculus, to show that the sample mean is the optimal model parameter in this case.
Performing the same optimization as in the last video, but by using a non-calculus algebraic manipulation.
Minimizing mean absolute error for the constant model using calculus, to show that the sample median is the optimal parameter in this case. Identifying that this solution isn't necessarily unique.
Comparing the loss surfaces of MSE and MAE for the constant model. Discussing the benefits and drawbacks of squared and absolute loss. Recapping the "modeling process".