-
DenseNet Block: Brute-Force Feature Reuse
Implementing a DenseNet dense block from scratch and comparing it to ResNet.
-
Pegasos Kernel SVM: The Hardest Math So Far
Implementing a deterministic Pegasos algorithm for kernel SVMs and diving deep into the mathematics of support vector machines.
-
Building a Primitive GPT-2: Layers & Dimensions
Merging deep learning concepts to build a simplified GPT-2 text generator and understanding the importance of dimensions.
-
Building Autograd: Chain Rule and Topo-Sort
Implementing a basic autograd engine from scratch and discovering the real-world power of topological sorting.
-
Understanding LSTMs: A Hands-on Intuition
Implementing Long Short-Term Memory (LSTM) from scratch and exploring the intuition behind its gates.