Welcome
BERN04/EXTQ41/NMV012F: Introduction to Artificial Neural Networks and Deep Learning, 7.5 credits
Advanced level (second cycle) course in computational science, course code BERN04, given by CEC. Also available as EXTQ41 (LTH) and NMV012F (phd). The course replaces FYTN14/EXTQ40/NTF005F with minor differences.
Note: this page contains general information about the course. If you are a student on the course you have to log in to the Canvas portal to the left to see the current course instance. The course calendar and course stream on this page are not active.
Contents
The course covers the most common models in artificial neural networks with a focus on the multi-layer perceptron. The course also provides an introduction to deep learning. Selected topics:
Feed-forward neural networks
The simple perceptron and the multi-layer perceptron, choice of suitable error functions and techniques to minimize them, how to detect and avoid overtraining, ensembles of neural networks and techniques to create them, Bayesian training of multi-layer perceptrons.
Recurrent neural networks
Simple recurrent networks and their use in time series analysis, fully recurrent for both time series analysis and associative memories (Hopfield model), the simulated annealing optimization technique.
Deep learning
Overview of deep learning, convolutional neural networks for classification of images, different techniques to avoid overtraining in deep networks, techniques to pre-train deep networks, the attention mechanism and transformers.
General information
- Semester: autumn
- Study period: 2
- Level: master (second cycle)
- Language: English
- Form of teaching: Lectures, computer exercises, problem solving sessions
- Assessment: Written exam, computer exercise reports
- Grading scale: U-G-VG (BERN04), U-3-4-5 (EXTQ41)
- Syllabus: BERN04 in English, BERN04 in Swedish, EXTQ41 in English Links to an external site., EXTQ41 in Swedish Links to an external site.
- Syllabus for PhD course: NMV012F in Swedish Download NMV012F in Swedish, (English version coming soon).
Course literature
- Printed lecture notes "Introduction to Artificial Neural Networks and Deep Learning", M. Ohlsson and P. Edén, available at Media-Tryck, and as pdf on course website.
- Supplemental online literature "Deep Learning Book Links to an external site."
Teachers
Schedule
Through Time Edit. Information about the compulsory introductory meeting can be found in TimeEdit.
Application
Apply through antagning.se Links to an external site.