login sign up

Learning resources

by @stats385 · 12 nodes · curated

Tutorials, courses, and concept primers — SGD, backprop, initialization, and companion courses.

untagged
MIT 6.S191 Intro to Deep Learning youtube.com · Sep 24 youtube.com · Sep 24
1 person saved or upvoted this

Short modern intro lecture series — good warm-up week material.

Andrew Ng Deep Learning Specialization coursera.org · Sep 24 coursera.org · Sep 24
1 person saved or upvoted this

Widely used MOOC primer before diving into the research papers.

fast.ai practical deep learning fast.ai · Sep 24 fast.ai · Sep 24
1 person saved or upvoted this

Top-down practical course — useful complement to STATS 385’s theory focus.

Course definitions page stats385.github.io · Sep 24 stats385.github.io · Sep 24
1 person saved or upvoted this

On-site glossary of deep learning motifs — pair with this list for vocabulary.

Deep Visualization Toolbox (video) youtube.com · Sep 24 youtube.com · Sep 24
1 person saved or upvoted this

Lecture 1 recommended video — interactive CNN feature visualization.

Delving Deep into Rectifiers (He initialization) arxiv.org · Sep 24 arxiv.org · Sep 24
1 person saved or upvoted this

He et al. — principled weight init for ReLU nets; course learning.md points here.

Gradient descent en.wikipedia.org · Sep 24 en.wikipedia.org · Sep 24
1 person saved or upvoted this

Basic optimizer primer — steps along the negative gradient of the loss.

Backpropagation en.wikipedia.org · Sep 24 en.wikipedia.org · Sep 24
1 person saved or upvoted this

Chain-rule engine for computing all parameter gradients efficiently.

Stochastic gradient descent en.wikipedia.org · Sep 24 en.wikipedia.org · Sep 24
1 person saved or upvoted this

Course cheat-sheet concept: SGD approximates full gradients with random minibatches.

Deep Learning Book — MLPs chapter deeplearningbook.org · Sep 24 deeplearningbook.org · Sep 24
1 person saved or upvoted this

Core textbook chapter on multilayer perceptrons; assign early.

Stanford CS231n — CNNs for Visual Recognition cs231n.stanford.edu · Sep 24 cs231n.stanford.edu · Sep 24
1 person saved or upvoted this

Sibling Stanford course; outstanding notes if you need vision/architecture grounding.

Dive into Deep Learning (interactive book) d2l.ai · Sep 24 d2l.ai · Sep 24
2 people saved or upvoted this

Primary hands-on tutorial listed by the course — code + math together.