Lecture 1. Supervised Learning 1
Learning Goals: You should know the concepts and basic mathematics of Linear Regression, Least squares optimization, overfitting/underfitting, the bias-variance tradeoff, cross-validation, regularization, k-nearest neighbor regression/classification. You should also be able to run and make modifications to basic matlab and python (scikit-learn) code for such algorithms.
IntroSlides2024 Download IntroSlides2024
Lecture01slides.pdf Download Lecture01slides.pdf (2023 version - includes correction of one or two typos)
Lecture01small.pdf Download Lecture01small.pdf
Available via youtube: https://youtu.be/JF6BugAf0wA
Links to an external site.
and with subtitles via Canvas Studio here
Reading Assignment (this refers to the book Machine Learning (Links to an external site.) by Lindholm et al):
- Ch 2.1 and 2.2
- Ch 3.1 and 3.3
- Ch 4.1-4.4
- Ch 5.1 and 5.3
Videos related to the lecture:
- Data-driven swingup of single inverted pendulum: https://www.youtube.com/watch?v=Lt-KLtkDlh8 (Links to an external site.)
- Physical modeling supported swingup of triple inverted pendulum: https://www.youtube.com/watch?v=SWupnDzynNU
Code used in the lecture (please don't worry about the unlogical naming of some of these files...)
- crazyflie_matlab.zip Download crazyflie_matlab.zip - polynomial regression, matlab
- lec3_cosinus.ipynb Links to an external site. - overfitting and crossvalidation, google colab
- lec3_ridge.ipynb Links to an external site. - decreasing overfitting problem with ridge regularisation, google colab
- knnfig.m Download knnfig.m - knn, matlab
- iris.m Download iris.m - knn on flower example, matlab