DDA4220 Fall 2026
Deep Learning and Applications
- Lectures
- Tue & Thu · 10:30–12:00
- Room
- J_E205
- First lecture
About the course
This course introduces the foundations of deep learning: neural network architectures, training objectives, optimization, regularization, and the engineering practices behind effective models. We explore supervised, self-supervised, unsupervised, and reinforcement learning, with applications in computer vision, natural language processing, and robotics.
You will learn to design, implement, and train models with tools such as PyTorch and TensorFlow, gaining practical experience through hands-on assignments and projects. Advanced topics will be introduced as time permits.
Prerequisites & preparation
Python proficiency is required. The course prerequisites are:
- CSC1001 / CSC1003
- MAT2040 / MAT2041, or equivalent courses
- DDA3020 / CSC4020 / DDA2020 / FTE4560
Prior coursework or projects in computer vision or natural language processing, and familiarity with PyTorch or TensorFlow, are helpful. There are no co-requisites.
Lecture schedule
The course schedule is tentative and subject to change. Lecture materials will be linked below as they become available.
| Lecture | Date | Topics | Materials | Deadlines |
|---|---|---|---|---|
| 01 | Course introduction & history | Slides (PDF) | ||
| 02 | Neural networks: representation and learning | Slides (PDF) | ||
| 03 | Training neural networks I: backpropagation and optimizers | Slides (PDF) | ||
| 04 | Training neural networks II: initialization, normalization | Slides (PDF) | ||
| 05 | Training neural networks III: generalization, regularization, and training practice | Slides (PDF) | ||
| 06 | Convolutional networks and object recognition | Slides (PDF) | ||
| 07 | Visual representations and transfer learning | Slides (PDF) | ||
| No lecture— | National holiday — no class | — | ||
| No lecture— | National holiday — no class | — | ||
| 08 | Dense prediction and segmentation | Slides (PDF) | ||
| 09 | Object detection and instance segmentation | Slides (PDF) | ||
| 10 | Sequence models and language modeling | Slides (PDF) | Assignment 1 (due ) Proposal (due ) | |
| 11 | Sequence-to-sequence models and attention | — | ||
| 12 | Transformers and Vision Transformers | — | ||
| 13 | Self-supervised learning | — | ||
| 14 | Autoencoders & variational autoencoders | — | ||
| 15 | Midterm review | — | ||
| Assessment— | Midterm exam (tentative) | — | ||
| 16 | Generative adversarial networks | — | ||
| 17 | Diffusion models | — | Assignment 2 (due ) | |
| 18 | Conditional generation and flow matching | — | Midterm report (due ) | |
| 19 | Reinforcement Learning: Foundations and Value-Based Methods | — | ||
| 20 | Reinforcement Learning: Policy Gradients and Actor–Critic Methods | — | ||
| 21 | Language foundation models | — | ||
| 22 | Multimodal & generative foundation models | — | ||
| 23 | 3D vision | — | ||
| 24 | Robot learning | — | ||
| 25 | Advanced topics I | — | ||
| 26 | Advanced topics II | — | ||
| 27 | Course review & discussion | — |
Recommended reading
Assessment & policies
- 3 homework assignments
- 45%
- Final projectProject description, milestones, and requirements.
- 25%
- Midterm exam
- 30%
Assignments
- Assignment 1Package (ZIP)Due
- Assignment 2Package (ZIP)Due
- Assignment 3Not yet released
Course policies
See L01 for coursework and AI-use guidance.
Late submissions: You have 3 grace days for all homework combined. Each 24-hour period, or part of one, uses 1 grace day: 23 hours late uses 1 day; 25 hours uses 2.
For late days not covered by grace days, deductions are based on your earned mark before any late penalty: 30% for 1 day, 60% for 2 days, and 100% (no marks) for 3 or more days. Partial days count as full days.
Teaching team & office hours
Instructor office hours
Tuesday 09:00–10:00 · every other week
First session: .
Daoyuan 323B (道远楼323B)
Held only by request; please email at least one day in advance.
Lead teaching assistant
Wenqian Zhang 张文谦
225040483@link.cuhk.edu.cnOffice hours
Tuesday 17:00–18:00
Thursday 14:30–15:30
Zhixin (知新楼) 408
Teaching assistant
Ruixiang Wang 王瑞翔
225040514@link.cuhk.edu.cnOffice hours
Saturday 17:00–18:00
Sunday 17:00–18:00
Teaching Complex B 609 (教学综合楼B 609)
Teaching assistant
Yifan Peng 彭一凡
225040521@link.cuhk.edu.cnOffice hours
Monday 19:00–20:00
Wednesday 19:00–20:00
Zhixin (知新楼) 429
Acknowledgments
This course draws inspiration from Stanford CS231n, Georgia Tech CS 4644/7643 (Danfei Xu), CMU 11-785, and MIT 6.S191. We also borrow a few figures from their teaching materials.