Deep learning

The course introduces the fundamental and current topics of deep learning. The course covers the most recent advances (such as unsupervised and self-supervised deep leaning) to give the student a good starting position to do research in this field.
Image for course subject

Schedule:

Teaching time:

Daytime

Location:

Online

Topic:

Information and communications technology

Form of learning:

Online

Provider:

Aalto University, FITech

Level:

Advanced

Credits:

5 By Aalto University (ECTS)

Fee:

Free of charge

Application period:

7.11.2022 – 20.2.2023

Target group and prerequisites

Good knowledge of Python and numpy (important!), basics of linear algebra (vectors, matrices, eigenvalues and eigenvectors) and basics of probability and statistics (sum rule, product rule, Bayes' rule, expectation, mean, variance, maximum likelihood, Kullback-Leibler divergence)

Course description

The course introduces the fundamental and current topics of deep learning.

In every weekly assignment, the students get to train a deep neural network for various tasks including image classification, machine translation, solving reasoning problems, few-shot learning and generative modeling. The course covers the most recent advances (such as unsupervised and self-supervised deep leaning) to give the student a good starting position to do research in this field.

After the course, the student

  • understands the general principles of training deep neural networks (backpropagation, stochastic gradient descent, regularization)
  • knows the most common neural network architectures (convolutional and recurrent neural networks, graph neural networks and transformers)
  • has practical experience in implementing these models from scratch in PyTorch.

Course material

Lecture slides and lecture notes, research papers, online tutorials on PyTorch.

Teaching methods

The lectures are organised in class (voluntary). The material including the lectures will be available online. The exercises are organised via Zoom.

  • Updated:
Share
URL copied!

You might be interested in these

Fundamental courses

Image for course subject

Introduction to Virtual Reality

Information and communications technology

Location:
Espoo
Level:
Beginner
Image for course subject

Game Design

Information and communications technology

Location:
Espoo
Level:
Beginner
Image for course subject

FITech 101: Tietorakenteet ja algoritmit

Information and communications technology

Location:
Online
Level:
Beginner
Image for course subject

Machine learning transforms our lives

Information and communications technology

Location:
Online
Level:
Beginner
Image for course subject

Informaatioteknologian perusteet

Information and communications technology

Location:
Espoo
Level:
Beginner
Image for course subject

Cybersecurity

Information and communications technology

Location:
Online
Level:
Beginner

Intermediate courses

Image for course subject

Data Analytics

Information and communications technology

Location:
Espoo
Level:
Intermediate
Image for course subject

Digital Platform Economy

Information and communications technology

Location:
Online
Level:
Intermediate
Image for course subject

Deep learning with Python

Information and communications technology

Location:
Online
Level:
Intermediate
Image for course subject

Tietokannat

Information and communications technology

Location:
Espoo
Level:
Intermediate
Image for course subject

Tietokoneverkot

Information and communications technology

Location:
Espoo
Online
Level:
Intermediate
Image for course subject

Tietoliikenteen siirtomenetelm├Ąt

Information and communications technology

Location:
Espoo
Level:
Intermediate

Advanced courses

Image for course subject

Federated learning

Information and communications technology

Location:
Online
Level:
Advanced
Image for course subject

Speech Recognition

Information and communications technology

Location:
Espoo
Level:
Advanced
Image for course subject

ICT Enabled Service Business and Innovation

Information and communications technology

Location:
Online
Espoo
Level:
Advanced
Image for course subject

Value network design for internet services

Information and communications technology

Location:
Espoo
Level:
Advanced
Image for course subject

SDN fundamentals & techniques

Information and communications technology

Location:
Espoo
Level:
Advanced
Image for course subject

Performance analysis

Information and communications technology

Location:
Espoo
Level:
Advanced